2023-10-06T04:09:27.609 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T04:09:27.610 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412260 --verbose -- /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412260/orig.config.yaml 2023-10-06T04:09:27.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T04:09:27.736 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412260 branch: wip-yuri3-testing-2023-10-05-0943-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} email: yweinste@redhat.com first_in_suite: false job_id: '7412260' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri3-testing-2023-10-05-0943-quincy ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2023-10-05-0943-quincy sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4002 sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri3-testing-2023-10-05-0943-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 targets: smithi060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMVOnWzSqUPydJV3XCwvfYgNl6e6b5Jw6JKDCvniUJDn9u8TBV3JlpyRnzOsbda1moAJgq/s42Y4Uiiv5riGegQ= smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGYm5XCchr5cYsUBiHMbdCdN7DT6uOWCv3DehH55x9W3V7CcFFddTd9K6VQM6WlY72JboXRbPAGGu8Hp4ADsufg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_acls teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:54:57 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T04:09:27.737 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa; will attempt to use it 2023-10-06T04:09:27.738 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa/tasks 2023-10-06T04:09:27.738 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T04:09:27.740 INFO:teuthology.task.internal:Checking packages... 2023-10-06T04:09:27.764 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564' 2023-10-06T04:09:27.765 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T04:09:27.765 INFO:teuthology.packaging:ref: None 2023-10-06T04:09:27.765 INFO:teuthology.packaging:tag: None 2023-10-06T04:09:27.765 INFO:teuthology.packaging:branch: wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T04:09:27.765 INFO:teuthology.packaging:sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:09:27.765 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T04:09:27.998 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1274.g68e53a4a 2023-10-06T04:09:27.998 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T04:09:28.005 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T04:09:28.005 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T04:09:28.024 INFO:teuthology.task.internal:Saving configuration 2023-10-06T04:09:28.041 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T04:09:28.047 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:09:28.073 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412260', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:04:31.241305', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMVOnWzSqUPydJV3XCwvfYgNl6e6b5Jw6JKDCvniUJDn9u8TBV3JlpyRnzOsbda1moAJgq/s42Y4Uiiv5riGegQ='} 2023-10-06T04:09:28.097 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412260', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:04:31.239965', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGYm5XCchr5cYsUBiHMbdCdN7DT6uOWCv3DehH55x9W3V7CcFFddTd9K6VQM6WlY72JboXRbPAGGu8Hp4ADsufg='} 2023-10-06T04:09:28.097 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T04:09:28.104 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T04:09:28.104 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T04:09:28.104 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T04:09:28.182 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9f16c58b80>, signals=[15]) 2023-10-06T04:09:28.182 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T04:09:28.188 INFO:teuthology.task.internal:Opening connections... 2023-10-06T04:09:28.188 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2023-10-06T04:09:28.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:09:28.259 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2023-10-06T04:09:28.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:09:28.365 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T04:09:28.372 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2023-10-06T04:09:28.390 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2023-10-06T04:09:28.390 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-10-06T04:09:28.448 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T04:09:28.448 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T04:09:28.448 INFO:teuthology.orchestra.run.smithi060.stdout:ID="rhel" 2023-10-06T04:09:28.448 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="fedora" 2023-10-06T04:09:28.449 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8.4" 2023-10-06T04:09:28.449 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8" 2023-10-06T04:09:28.449 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T04:09:28.449 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2023-10-06T04:09:28.449 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T04:09:28.449 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T04:09:28.449 INFO:teuthology.orchestra.run.smithi060.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T04:09:28.449 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T04:09:28.449 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:09:28.449 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T04:09:28.450 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T04:09:28.450 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T04:09:28.450 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T04:09:28.450 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-10-06T04:09:28.478 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2023-10-06T04:09:28.495 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2023-10-06T04:09:28.496 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-10-06T04:09:28.555 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T04:09:28.555 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T04:09:28.555 INFO:teuthology.orchestra.run.smithi135.stdout:ID="rhel" 2023-10-06T04:09:28.555 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="fedora" 2023-10-06T04:09:28.556 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8.4" 2023-10-06T04:09:28.556 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-10-06T04:09:28.556 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T04:09:28.556 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-10-06T04:09:28.556 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T04:09:28.556 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T04:09:28.556 INFO:teuthology.orchestra.run.smithi135.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T04:09:28.556 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T04:09:28.556 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:09:28.556 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T04:09:28.557 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T04:09:28.557 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T04:09:28.557 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T04:09:28.557 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-10-06T04:09:28.577 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T04:09:28.588 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T04:09:28.593 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T04:09:28.593 DEBUG:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2023-10-06T04:09:28.595 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2023-10-06T04:09:28.611 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T04:09:28.617 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T04:09:28.617 DEBUG:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2023-10-06T04:09:28.652 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2023-10-06T04:09:28.668 INFO:teuthology.orchestra.run.smithi060.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T04:09:28.669 INFO:teuthology.orchestra.run.smithi135.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T04:09:28.669 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T04:09:28.719 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T04:09:28.735 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-10-06T04:09:28.736 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-10-06T04:09:28.736 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-10-06T04:09:28.736 DEBUG:teuthology.orchestra.run.smithi060:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T04:09:28.737 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T04:09:28.754 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:09:28.757 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-10-06T04:09:28.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:09:28.761 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-10-06T04:09:28.994 DEBUG:teuthology.task.kernel:sha1 for client.1 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T04:09:28.994 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-06T04:09:28.994 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2023-10-06T04:09:29.011 INFO:teuthology.orchestra.run.smithi135.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T04:09:29.012 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.25.1.el8_4.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T04:09:29.012 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-06T04:09:29.012 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum upgrade -y linux-firmware 2023-10-06T04:09:29.017 DEBUG:teuthology.task.kernel:sha1 for client.0 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T04:09:29.017 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-06T04:09:29.018 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2023-10-06T04:09:29.035 INFO:teuthology.orchestra.run.smithi060.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T04:09:29.035 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.25.1.el8_4.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T04:09:29.035 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-06T04:09:29.035 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum upgrade -y linux-firmware 2023-10-06T04:09:30.459 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-10-06T04:09:30.460 INFO:teuthology.orchestra.run.smithi135.stdout:Unable to read consumer identity 2023-10-06T04:09:30.549 INFO:teuthology.orchestra.run.smithi060.stdout:Updating Subscription Management repositories. 2023-10-06T04:09:30.550 INFO:teuthology.orchestra.run.smithi060.stdout:Unable to read consumer identity 2023-10-06T04:09:31.864 INFO:teuthology.orchestra.run.smithi135.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-06T04:09:32.024 INFO:teuthology.orchestra.run.smithi060.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-06T04:09:32.592 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2023-10-06T04:09:33.690 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 16 MB 00:01 2023-10-06T04:09:35.903 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2023-10-06T04:09:36.802 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-10-06T04:09:36.804 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2023-10-06T04:09:36.804 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-10-06T04:09:36.926 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-10-06T04:09:36.926 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T04:09:37.141 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-06T04:09:37.141 DEBUG:teuthology.orchestra.run.smithi135:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-06T04:09:37.143 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi135.front.sepia.ceph.com to complete... 2023-10-06T04:09:37.244 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-10-06T04:09:38.157 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-06T04:09:38.158 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2023-10-06T04:09:38.158 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-06T04:09:38.278 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-06T04:09:38.278 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T04:09:38.491 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-06T04:09:38.491 DEBUG:teuthology.orchestra.run.smithi060:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-06T04:09:38.493 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi060.front.sepia.ceph.com to complete... 2023-10-06T04:09:59.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06 04:09:59 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-06T04:09:59.204 INFO:teuthology.orchestra.run.smithi060.stderr:FINISHED --2023-10-06 04:09:59-- 2023-10-06T04:09:59.205 INFO:teuthology.orchestra.run.smithi060.stderr:Total wall clock time: 21s 2023-10-06T04:09:59.205 INFO:teuthology.orchestra.run.smithi060.stderr:Downloaded: 1 files, 363M in 20s (17.9 MB/s) 2023-10-06T04:09:59.206 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-06T04:09:59.206 DEBUG:teuthology.orchestra.run.smithi060:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-06T04:10:01.048 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying... ######################################## 2023-10-06T04:10:01.465 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing... ######################################## 2023-10-06T04:10:01.617 INFO:teuthology.orchestra.run.smithi060.stdout:Updating / installing... 2023-10-06T04:10:02.442 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06 04:10:02 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-06T04:10:02.442 INFO:teuthology.orchestra.run.smithi135.stderr:FINISHED --2023-10-06 04:10:02-- 2023-10-06T04:10:02.443 INFO:teuthology.orchestra.run.smithi135.stderr:Total wall clock time: 25s 2023-10-06T04:10:02.443 INFO:teuthology.orchestra.run.smithi135.stderr:Downloaded: 1 files, 363M in 25s (14.5 MB/s) 2023-10-06T04:10:02.444 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-10-06T04:10:02.444 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-06T04:10:04.183 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying... ######################################## 2023-10-06T04:10:04.723 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing... ######################################## 2023-10-06T04:10:04.851 INFO:teuthology.orchestra.run.smithi135.stdout:Updating / installing... 2023-10-06T04:10:42.298 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-06T04:10:42.841 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-06T04:11:07.317 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi060.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-06T04:11:07.317 DEBUG:teuthology.orchestra.run.smithi060:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-06T04:11:07.372 INFO:teuthology.orchestra.run.smithi060.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T04:11:07.372 INFO:teuthology.orchestra.run.smithi060.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-06T04:11:07.373 INFO:teuthology.orchestra.run.smithi060.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-06T04:11:07.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-06T04:11:07.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-06T04:11:07.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-06T04:11:07.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-06T04:11:07.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-06T04:11:07.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-06T04:11:07.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-06T04:11:07.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-06T04:11:07.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-06T04:11:07.373 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-06T04:11:07.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-06T04:11:07.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-06T04:11:07.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-06T04:11:07.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-06T04:11:07.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-06T04:11:07.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-06T04:11:07.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-06T04:11:07.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-06T04:11:07.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-06T04:11:07.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-06T04:11:07.374 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-06T04:11:07.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-06T04:11:07.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-06T04:11:07.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-06T04:11:07.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-06T04:11:07.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-06T04:11:07.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-06T04:11:07.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-06T04:11:07.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-06T04:11:07.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-06T04:11:07.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-06T04:11:07.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-06T04:11:07.375 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-06T04:11:07.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-06T04:11:07.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-06T04:11:07.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-06T04:11:07.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-06T04:11:07.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-06T04:11:07.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-06T04:11:07.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-06T04:11:07.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-06T04:11:07.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-06T04:11:07.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-06T04:11:07.376 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-06T04:11:07.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-06T04:11:07.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-06T04:11:07.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-06T04:11:07.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-06T04:11:07.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-06T04:11:07.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-06T04:11:07.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-06T04:11:07.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-06T04:11:07.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-06T04:11:07.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-06T04:11:07.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-06T04:11:07.377 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-06T04:11:07.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-06T04:11:07.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-06T04:11:07.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-06T04:11:07.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-06T04:11:07.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-06T04:11:07.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-06T04:11:07.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-06T04:11:07.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-06T04:11:07.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-06T04:11:07.378 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-06T04:11:07.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-06T04:11:07.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-06T04:11:07.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-06T04:11:07.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-06T04:11:07.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-06T04:11:07.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-06T04:11:07.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-06T04:11:07.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-06T04:11:07.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-06T04:11:07.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-06T04:11:07.379 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-06T04:11:07.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-06T04:11:07.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-06T04:11:07.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-06T04:11:07.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-06T04:11:07.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-06T04:11:07.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-06T04:11:07.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-06T04:11:07.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-06T04:11:07.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-06T04:11:07.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-06T04:11:07.380 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-06T04:11:07.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-06T04:11:07.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-06T04:11:07.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-06T04:11:07.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-06T04:11:07.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-06T04:11:07.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-06T04:11:07.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-06T04:11:07.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-06T04:11:07.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-06T04:11:07.381 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-06T04:11:07.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-06T04:11:07.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-06T04:11:07.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-06T04:11:07.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-06T04:11:07.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-06T04:11:07.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-06T04:11:07.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-06T04:11:07.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-06T04:11:07.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-06T04:11:07.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-06T04:11:07.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-06T04:11:07.382 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-06T04:11:07.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-06T04:11:07.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-06T04:11:07.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-06T04:11:07.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-06T04:11:07.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-06T04:11:07.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-06T04:11:07.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-06T04:11:07.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-06T04:11:07.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-06T04:11:07.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-06T04:11:07.383 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-06T04:11:07.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-06T04:11:07.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-06T04:11:07.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-06T04:11:07.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-06T04:11:07.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-06T04:11:07.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-06T04:11:07.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-06T04:11:07.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-06T04:11:07.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-06T04:11:07.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-06T04:11:07.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-06T04:11:07.384 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-06T04:11:07.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-06T04:11:07.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-06T04:11:07.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-06T04:11:07.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-06T04:11:07.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-06T04:11:07.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-06T04:11:07.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-06T04:11:07.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-06T04:11:07.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-06T04:11:07.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-06T04:11:07.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-06T04:11:07.385 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-06T04:11:07.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-06T04:11:07.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-06T04:11:07.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-06T04:11:07.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-06T04:11:07.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-06T04:11:07.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-06T04:11:07.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-06T04:11:07.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-06T04:11:07.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-06T04:11:07.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-06T04:11:07.386 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-06T04:11:07.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-06T04:11:07.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-06T04:11:07.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-06T04:11:07.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-06T04:11:07.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-06T04:11:07.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-06T04:11:07.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-06T04:11:07.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-06T04:11:07.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-06T04:11:07.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-06T04:11:07.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-06T04:11:07.387 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-06T04:11:07.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-06T04:11:07.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-06T04:11:07.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-06T04:11:07.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-06T04:11:07.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-06T04:11:07.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-06T04:11:07.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-06T04:11:07.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-06T04:11:07.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-06T04:11:07.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-06T04:11:07.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-06T04:11:07.388 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-06T04:11:07.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-06T04:11:07.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-06T04:11:07.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-06T04:11:07.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-06T04:11:07.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-06T04:11:07.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-06T04:11:07.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-06T04:11:07.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-06T04:11:07.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-06T04:11:07.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-06T04:11:07.389 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-06T04:11:07.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-06T04:11:07.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-06T04:11:07.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-06T04:11:07.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-06T04:11:07.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-06T04:11:07.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-06T04:11:07.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-06T04:11:07.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-06T04:11:07.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-06T04:11:07.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-06T04:11:07.390 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-06T04:11:07.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-06T04:11:07.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-06T04:11:07.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-06T04:11:07.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-06T04:11:07.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-06T04:11:07.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-06T04:11:07.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-06T04:11:07.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-06T04:11:07.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-06T04:11:07.391 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-06T04:11:07.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-06T04:11:07.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-06T04:11:07.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-06T04:11:07.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-06T04:11:07.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-06T04:11:07.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-06T04:11:07.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-06T04:11:07.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-06T04:11:07.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-06T04:11:07.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-06T04:11:07.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-06T04:11:07.392 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-06T04:11:07.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-06T04:11:07.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-06T04:11:07.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-06T04:11:07.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-06T04:11:07.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-06T04:11:07.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-06T04:11:07.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-06T04:11:07.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-06T04:11:07.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-06T04:11:07.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-06T04:11:07.393 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-06T04:11:07.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-06T04:11:07.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-06T04:11:07.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-06T04:11:07.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-06T04:11:07.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-06T04:11:07.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-06T04:11:07.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-06T04:11:07.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-06T04:11:07.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-06T04:11:07.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-06T04:11:07.394 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-06T04:11:07.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-06T04:11:07.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-06T04:11:07.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-06T04:11:07.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-06T04:11:07.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-06T04:11:07.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-06T04:11:07.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-06T04:11:07.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-06T04:11:07.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-06T04:11:07.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-06T04:11:07.395 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-06T04:11:07.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-06T04:11:07.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-06T04:11:07.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-06T04:11:07.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-06T04:11:07.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-06T04:11:07.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-06T04:11:07.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-06T04:11:07.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-06T04:11:07.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-06T04:11:07.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-06T04:11:07.396 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-06T04:11:07.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-06T04:11:07.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-06T04:11:07.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-06T04:11:07.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-06T04:11:07.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-06T04:11:07.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-06T04:11:07.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-06T04:11:07.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-06T04:11:07.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-06T04:11:07.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-06T04:11:07.397 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-06T04:11:07.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-06T04:11:07.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-06T04:11:07.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-06T04:11:07.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-06T04:11:07.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-06T04:11:07.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-06T04:11:07.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-06T04:11:07.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-06T04:11:07.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-06T04:11:07.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-06T04:11:07.398 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-06T04:11:07.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-06T04:11:07.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-06T04:11:07.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-06T04:11:07.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-06T04:11:07.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-06T04:11:07.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-06T04:11:07.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-06T04:11:07.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-06T04:11:07.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-06T04:11:07.399 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-06T04:11:07.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-06T04:11:07.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-06T04:11:07.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-06T04:11:07.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-06T04:11:07.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-06T04:11:07.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-06T04:11:07.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-06T04:11:07.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-06T04:11:07.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-06T04:11:07.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-06T04:11:07.400 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-06T04:11:07.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-06T04:11:07.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-06T04:11:07.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-06T04:11:07.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-06T04:11:07.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-06T04:11:07.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-06T04:11:07.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-06T04:11:07.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-06T04:11:07.401 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-06T04:11:07.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-06T04:11:07.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-06T04:11:07.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-06T04:11:07.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-06T04:11:07.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-06T04:11:07.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-06T04:11:07.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-06T04:11:07.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-06T04:11:07.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-06T04:11:07.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-06T04:11:07.402 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-06T04:11:07.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-06T04:11:07.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-06T04:11:07.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-06T04:11:07.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-06T04:11:07.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-06T04:11:07.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-06T04:11:07.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-06T04:11:07.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-06T04:11:07.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-06T04:11:07.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-06T04:11:07.403 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-06T04:11:07.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-06T04:11:07.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-06T04:11:07.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-06T04:11:07.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-06T04:11:07.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-06T04:11:07.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-06T04:11:07.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-06T04:11:07.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-06T04:11:07.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-06T04:11:07.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-06T04:11:07.404 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-06T04:11:07.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-06T04:11:07.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-06T04:11:07.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-06T04:11:07.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-06T04:11:07.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-06T04:11:07.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-06T04:11:07.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-06T04:11:07.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-06T04:11:07.405 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-06T04:11:07.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-06T04:11:07.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-06T04:11:07.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-06T04:11:07.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-06T04:11:07.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-06T04:11:07.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-06T04:11:07.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-06T04:11:07.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-06T04:11:07.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-06T04:11:07.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-06T04:11:07.406 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-06T04:11:07.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-06T04:11:07.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-06T04:11:07.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-06T04:11:07.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-06T04:11:07.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-06T04:11:07.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-06T04:11:07.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-06T04:11:07.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-06T04:11:07.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-06T04:11:07.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-06T04:11:07.407 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-06T04:11:07.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-06T04:11:07.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-06T04:11:07.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-06T04:11:07.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-06T04:11:07.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-06T04:11:07.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-06T04:11:07.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-06T04:11:07.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-06T04:11:07.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-06T04:11:07.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-06T04:11:07.408 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-06T04:11:07.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-06T04:11:07.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-06T04:11:07.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-06T04:11:07.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-06T04:11:07.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-06T04:11:07.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-06T04:11:07.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-06T04:11:07.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-06T04:11:07.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-06T04:11:07.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-06T04:11:07.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-06T04:11:07.409 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-06T04:11:07.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-06T04:11:07.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-06T04:11:07.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-06T04:11:07.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-06T04:11:07.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-06T04:11:07.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-06T04:11:07.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-06T04:11:07.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-06T04:11:07.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-06T04:11:07.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-06T04:11:07.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-06T04:11:07.410 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-06T04:11:07.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-06T04:11:07.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-06T04:11:07.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-06T04:11:07.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-06T04:11:07.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-06T04:11:07.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-06T04:11:07.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-06T04:11:07.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-06T04:11:07.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-06T04:11:07.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-06T04:11:07.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-06T04:11:07.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-06T04:11:07.411 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-06T04:11:07.412 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-06T04:11:07.412 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-06T04:11:07.412 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-06T04:11:07.412 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-06T04:11:07.413 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-06T04:11:07.413 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-06T04:11:07.413 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-06T04:11:07.414 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-06T04:11:07.414 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-06T04:11:07.414 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-06T04:11:07.414 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-06T04:11:07.414 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-06T04:11:07.414 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-06T04:11:07.414 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-06T04:11:07.414 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-06T04:11:07.414 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-06T04:11:07.414 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-06T04:11:07.414 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-06T04:11:07.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-06T04:11:07.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-06T04:11:07.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-06T04:11:07.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-06T04:11:07.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-06T04:11:07.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-06T04:11:07.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-06T04:11:07.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-06T04:11:07.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-06T04:11:07.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-06T04:11:07.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-06T04:11:07.415 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-06T04:11:07.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-06T04:11:07.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-06T04:11:07.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-06T04:11:07.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-06T04:11:07.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-06T04:11:07.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-06T04:11:07.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-06T04:11:07.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-06T04:11:07.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-06T04:11:07.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-06T04:11:07.416 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-06T04:11:07.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-06T04:11:07.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-06T04:11:07.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-06T04:11:07.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-06T04:11:07.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-06T04:11:07.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-06T04:11:07.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-06T04:11:07.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-06T04:11:07.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-06T04:11:07.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-06T04:11:07.417 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-06T04:11:07.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-06T04:11:07.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-06T04:11:07.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-06T04:11:07.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-06T04:11:07.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-06T04:11:07.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-06T04:11:07.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-06T04:11:07.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-06T04:11:07.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-06T04:11:07.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-06T04:11:07.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-06T04:11:07.418 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-06T04:11:07.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-06T04:11:07.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-06T04:11:07.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-06T04:11:07.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-06T04:11:07.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-06T04:11:07.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-06T04:11:07.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-06T04:11:07.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-06T04:11:07.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-06T04:11:07.419 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-06T04:11:07.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-06T04:11:07.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-06T04:11:07.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-06T04:11:07.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-06T04:11:07.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-06T04:11:07.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-06T04:11:07.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-06T04:11:07.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-06T04:11:07.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-06T04:11:07.420 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-06T04:11:07.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-06T04:11:07.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-06T04:11:07.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-06T04:11:07.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-06T04:11:07.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-06T04:11:07.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-06T04:11:07.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-06T04:11:07.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-06T04:11:07.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-06T04:11:07.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-06T04:11:07.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-06T04:11:07.421 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-06T04:11:07.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-06T04:11:07.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-06T04:11:07.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-06T04:11:07.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-06T04:11:07.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-06T04:11:07.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-06T04:11:07.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-06T04:11:07.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-06T04:11:07.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-06T04:11:07.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-06T04:11:07.422 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-06T04:11:07.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-06T04:11:07.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-06T04:11:07.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-06T04:11:07.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-06T04:11:07.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-06T04:11:07.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-06T04:11:07.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-06T04:11:07.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-06T04:11:07.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-06T04:11:07.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-06T04:11:07.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-06T04:11:07.423 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-06T04:11:07.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-06T04:11:07.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-06T04:11:07.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-06T04:11:07.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-06T04:11:07.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-06T04:11:07.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-06T04:11:07.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-06T04:11:07.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-06T04:11:07.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-06T04:11:07.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-06T04:11:07.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-06T04:11:07.424 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-06T04:11:07.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-06T04:11:07.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-06T04:11:07.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-06T04:11:07.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-06T04:11:07.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-06T04:11:07.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-06T04:11:07.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-06T04:11:07.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-06T04:11:07.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-06T04:11:07.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-06T04:11:07.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-06T04:11:07.425 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-06T04:11:07.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-06T04:11:07.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-06T04:11:07.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-06T04:11:07.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-06T04:11:07.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-06T04:11:07.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-06T04:11:07.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-06T04:11:07.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-06T04:11:07.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-06T04:11:07.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-06T04:11:07.426 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-06T04:11:07.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-06T04:11:07.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-06T04:11:07.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-06T04:11:07.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-06T04:11:07.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-06T04:11:07.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-06T04:11:07.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-06T04:11:07.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-06T04:11:07.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-06T04:11:07.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-06T04:11:07.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-06T04:11:07.427 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-06T04:11:07.428 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-06T04:11:07.428 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-06T04:11:07.428 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-06T04:11:07.428 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-06T04:11:07.428 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-06T04:11:07.428 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-06T04:11:07.428 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-06T04:11:07.428 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-06T04:11:07.428 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-06T04:11:07.428 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-06T04:11:07.428 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-06T04:11:07.429 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-06T04:11:07.429 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-06T04:11:07.429 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-06T04:11:07.429 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-06T04:11:07.429 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-06T04:11:07.429 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-06T04:11:07.429 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-06T04:11:07.429 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-06T04:11:07.429 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-06T04:11:07.429 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-06T04:11:07.429 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-06T04:11:07.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-06T04:11:07.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-06T04:11:07.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-06T04:11:07.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-06T04:11:07.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-06T04:11:07.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-06T04:11:07.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-06T04:11:07.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-06T04:11:07.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-06T04:11:07.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-06T04:11:07.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-06T04:11:07.430 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-06T04:11:07.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-06T04:11:07.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-06T04:11:07.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-06T04:11:07.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-06T04:11:07.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-06T04:11:07.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-06T04:11:07.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-06T04:11:07.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-06T04:11:07.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-06T04:11:07.431 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-06T04:11:07.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-06T04:11:07.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-06T04:11:07.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-06T04:11:07.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-06T04:11:07.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-06T04:11:07.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-06T04:11:07.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-06T04:11:07.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-06T04:11:07.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-06T04:11:07.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-06T04:11:07.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-06T04:11:07.432 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-06T04:11:07.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-06T04:11:07.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-06T04:11:07.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-06T04:11:07.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-06T04:11:07.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-06T04:11:07.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-06T04:11:07.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-06T04:11:07.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-06T04:11:07.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-06T04:11:07.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-06T04:11:07.433 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-06T04:11:07.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-06T04:11:07.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-06T04:11:07.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-06T04:11:07.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-06T04:11:07.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-06T04:11:07.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-06T04:11:07.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-06T04:11:07.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-06T04:11:07.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-06T04:11:07.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-06T04:11:07.434 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-06T04:11:07.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-06T04:11:07.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-06T04:11:07.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-06T04:11:07.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-06T04:11:07.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-06T04:11:07.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-06T04:11:07.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-06T04:11:07.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-06T04:11:07.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-06T04:11:07.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-06T04:11:07.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-06T04:11:07.435 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-06T04:11:07.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-06T04:11:07.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-06T04:11:07.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-06T04:11:07.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-06T04:11:07.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-06T04:11:07.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-06T04:11:07.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-06T04:11:07.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-06T04:11:07.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-06T04:11:07.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-06T04:11:07.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-06T04:11:07.436 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-06T04:11:07.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-06T04:11:07.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-06T04:11:07.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-06T04:11:07.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-06T04:11:07.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-06T04:11:07.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-06T04:11:07.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-06T04:11:07.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-06T04:11:07.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-06T04:11:07.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-06T04:11:07.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-06T04:11:07.437 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-06T04:11:07.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-06T04:11:07.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-06T04:11:07.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-06T04:11:07.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-06T04:11:07.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-06T04:11:07.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-06T04:11:07.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-06T04:11:07.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-06T04:11:07.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-06T04:11:07.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-06T04:11:07.438 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-06T04:11:07.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-06T04:11:07.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-06T04:11:07.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-06T04:11:07.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-06T04:11:07.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-06T04:11:07.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-06T04:11:07.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-06T04:11:07.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-06T04:11:07.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-06T04:11:07.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-06T04:11:07.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-06T04:11:07.439 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-06T04:11:07.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-06T04:11:07.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-06T04:11:07.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-06T04:11:07.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-06T04:11:07.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-06T04:11:07.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-06T04:11:07.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-06T04:11:07.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-06T04:11:07.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-06T04:11:07.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-06T04:11:07.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-06T04:11:07.440 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-06T04:11:07.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-06T04:11:07.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-06T04:11:07.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-06T04:11:07.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-06T04:11:07.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-06T04:11:07.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-06T04:11:07.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-06T04:11:07.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-06T04:11:07.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-06T04:11:07.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-06T04:11:07.441 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-06T04:11:07.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-06T04:11:07.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-06T04:11:07.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-06T04:11:07.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-06T04:11:07.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-06T04:11:07.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-06T04:11:07.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-06T04:11:07.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-06T04:11:07.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-06T04:11:07.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-06T04:11:07.442 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-06T04:11:07.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-06T04:11:07.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-06T04:11:07.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-06T04:11:07.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-06T04:11:07.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-06T04:11:07.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-06T04:11:07.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-06T04:11:07.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-06T04:11:07.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-06T04:11:07.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-06T04:11:07.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-06T04:11:07.443 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-06T04:11:07.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-06T04:11:07.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-06T04:11:07.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-06T04:11:07.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-06T04:11:07.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-06T04:11:07.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-06T04:11:07.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-06T04:11:07.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-06T04:11:07.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-06T04:11:07.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-06T04:11:07.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-06T04:11:07.444 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-06T04:11:07.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-06T04:11:07.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-06T04:11:07.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-06T04:11:07.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-06T04:11:07.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-06T04:11:07.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-06T04:11:07.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-06T04:11:07.445 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-06T04:11:07.446 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-06T04:11:07.446 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-06T04:11:07.446 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-06T04:11:07.446 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-06T04:11:07.446 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-06T04:11:07.446 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-06T04:11:07.446 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-06T04:11:07.446 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-06T04:11:07.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-06T04:11:07.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-06T04:11:07.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-06T04:11:07.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-06T04:11:07.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-06T04:11:07.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-06T04:11:07.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-06T04:11:07.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-06T04:11:07.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-06T04:11:07.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-06T04:11:07.447 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-06T04:11:07.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-06T04:11:07.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-06T04:11:07.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-06T04:11:07.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-06T04:11:07.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-06T04:11:07.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-06T04:11:07.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-06T04:11:07.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-06T04:11:07.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-06T04:11:07.448 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-06T04:11:07.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-06T04:11:07.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-06T04:11:07.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-06T04:11:07.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-06T04:11:07.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-06T04:11:07.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-06T04:11:07.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-06T04:11:07.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-06T04:11:07.449 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-06T04:11:07.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-06T04:11:07.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-06T04:11:07.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-06T04:11:07.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-06T04:11:07.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-06T04:11:07.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-06T04:11:07.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-06T04:11:07.450 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-06T04:11:07.451 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-06T04:11:07.451 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-06T04:11:07.451 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-06T04:11:07.451 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-06T04:11:07.451 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-06T04:11:07.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-06T04:11:07.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-06T04:11:07.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-06T04:11:07.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-06T04:11:07.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-06T04:11:07.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-06T04:11:07.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-06T04:11:07.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-06T04:11:07.452 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-06T04:11:07.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-06T04:11:07.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-06T04:11:07.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-06T04:11:07.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-06T04:11:07.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-06T04:11:07.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-06T04:11:07.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-06T04:11:07.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-06T04:11:07.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-06T04:11:07.453 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-06T04:11:07.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-06T04:11:07.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-06T04:11:07.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-06T04:11:07.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-06T04:11:07.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-06T04:11:07.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-06T04:11:07.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-06T04:11:07.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-06T04:11:07.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-06T04:11:07.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-06T04:11:07.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-06T04:11:07.454 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-06T04:11:07.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-06T04:11:07.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-06T04:11:07.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-06T04:11:07.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-06T04:11:07.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-06T04:11:07.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-06T04:11:07.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-06T04:11:07.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-06T04:11:07.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-06T04:11:07.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-06T04:11:07.455 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-06T04:11:07.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-06T04:11:07.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-06T04:11:07.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-06T04:11:07.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-06T04:11:07.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-06T04:11:07.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-06T04:11:07.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-06T04:11:07.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-06T04:11:07.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-06T04:11:07.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-06T04:11:07.456 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-06T04:11:07.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-06T04:11:07.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-06T04:11:07.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-06T04:11:07.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-06T04:11:07.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-06T04:11:07.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-06T04:11:07.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-06T04:11:07.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-06T04:11:07.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-06T04:11:07.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-06T04:11:07.457 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-06T04:11:07.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-06T04:11:07.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-06T04:11:07.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-06T04:11:07.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-06T04:11:07.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-06T04:11:07.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-06T04:11:07.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-06T04:11:07.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-06T04:11:07.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-06T04:11:07.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-06T04:11:07.458 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-06T04:11:07.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-06T04:11:07.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-06T04:11:07.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-06T04:11:07.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-06T04:11:07.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-06T04:11:07.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-06T04:11:07.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-06T04:11:07.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-06T04:11:07.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-06T04:11:07.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-06T04:11:07.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-06T04:11:07.459 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-06T04:11:07.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-06T04:11:07.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-06T04:11:07.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-06T04:11:07.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-06T04:11:07.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-06T04:11:07.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-06T04:11:07.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-06T04:11:07.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-06T04:11:07.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-06T04:11:07.460 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-06T04:11:07.461 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-06T04:11:07.461 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-06T04:11:07.461 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-06T04:11:07.461 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-06T04:11:07.461 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-06T04:11:07.461 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-06T04:11:07.461 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-06T04:11:07.461 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-06T04:11:07.461 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-06T04:11:07.461 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-06T04:11:07.461 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-06T04:11:07.462 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-06T04:11:07.462 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-06T04:11:07.462 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-06T04:11:07.462 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-06T04:11:07.462 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-06T04:11:07.462 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-06T04:11:07.462 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-06T04:11:07.462 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-06T04:11:07.462 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-06T04:11:07.462 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-06T04:11:07.462 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-06T04:11:07.463 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-06T04:11:07.463 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-06T04:11:07.463 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-06T04:11:07.463 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-06T04:11:07.463 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-06T04:11:07.463 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-06T04:11:07.463 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-06T04:11:07.463 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-06T04:11:07.463 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-06T04:11:07.463 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-06T04:11:07.463 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-06T04:11:07.463 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-06T04:11:07.464 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-06T04:11:07.464 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-06T04:11:07.464 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-06T04:11:07.464 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-06T04:11:07.464 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-06T04:11:07.464 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-06T04:11:07.464 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-06T04:11:07.464 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-06T04:11:07.464 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-06T04:11:07.465 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-06T04:11:07.465 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-06T04:11:07.465 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-06T04:11:07.465 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-06T04:11:07.465 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-06T04:11:07.465 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-06T04:11:07.465 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-06T04:11:07.465 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-06T04:11:07.465 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-06T04:11:07.465 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-06T04:11:07.466 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-06T04:11:07.466 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-06T04:11:07.466 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-06T04:11:07.466 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-06T04:11:07.466 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-06T04:11:07.466 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-06T04:11:07.466 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-06T04:11:07.466 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-06T04:11:07.466 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-06T04:11:07.466 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-06T04:11:07.466 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-06T04:11:07.467 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-06T04:11:07.467 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-06T04:11:07.467 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-06T04:11:07.467 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-06T04:11:07.467 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-06T04:11:07.467 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-06T04:11:07.467 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-06T04:11:07.467 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-06T04:11:07.467 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-06T04:11:07.467 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-06T04:11:07.467 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-06T04:11:07.468 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-06T04:11:07.468 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-06T04:11:07.468 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-06T04:11:07.468 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-06T04:11:07.468 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-06T04:11:07.468 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-06T04:11:07.468 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-06T04:11:07.468 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-06T04:11:07.468 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-06T04:11:07.468 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-06T04:11:07.468 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-06T04:11:07.468 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-06T04:11:07.469 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-06T04:11:07.469 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-06T04:11:07.469 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-06T04:11:07.469 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-06T04:11:07.469 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-06T04:11:07.469 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-06T04:11:07.469 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-06T04:11:07.469 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-06T04:11:07.469 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-06T04:11:07.469 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-06T04:11:07.469 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-06T04:11:07.469 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-06T04:11:07.470 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-06T04:11:07.470 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-06T04:11:07.470 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-06T04:11:07.470 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-06T04:11:07.470 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-06T04:11:07.470 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-06T04:11:07.470 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-06T04:11:07.470 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-06T04:11:07.470 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-06T04:11:07.470 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-06T04:11:07.470 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-06T04:11:07.471 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-06T04:11:07.471 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-06T04:11:07.471 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-06T04:11:07.471 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-06T04:11:07.471 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-06T04:11:07.471 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-06T04:11:07.471 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-06T04:11:07.471 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-06T04:11:07.471 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-06T04:11:07.471 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-06T04:11:07.471 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-06T04:11:07.471 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-06T04:11:07.472 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-06T04:11:07.472 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-06T04:11:07.472 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-06T04:11:07.472 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-06T04:11:07.472 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-06T04:11:07.472 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-06T04:11:07.472 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-06T04:11:07.472 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-06T04:11:07.472 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-06T04:11:07.472 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-06T04:11:07.472 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-06T04:11:07.472 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-06T04:11:07.472 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-06T04:11:07.473 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-06T04:11:07.473 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-06T04:11:07.473 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-06T04:11:07.473 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-06T04:11:07.473 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-06T04:11:07.473 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-06T04:11:07.473 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-06T04:11:07.473 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-06T04:11:07.473 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-06T04:11:07.473 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-06T04:11:07.473 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-06T04:11:07.474 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-06T04:11:07.474 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-06T04:11:07.474 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-06T04:11:07.474 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-06T04:11:07.474 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-06T04:11:07.474 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-06T04:11:07.474 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-06T04:11:07.474 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-06T04:11:07.474 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-06T04:11:07.474 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-06T04:11:07.474 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-06T04:11:07.475 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-06T04:11:07.475 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-06T04:11:07.475 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-06T04:11:07.475 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-06T04:11:07.475 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-06T04:11:07.475 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-06T04:11:07.475 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-06T04:11:07.475 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-06T04:11:07.475 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-06T04:11:07.475 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-06T04:11:07.475 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-06T04:11:07.475 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-06T04:11:07.476 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-06T04:11:07.476 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-06T04:11:07.476 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-06T04:11:07.476 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-06T04:11:07.476 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-06T04:11:07.476 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-06T04:11:07.476 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-06T04:11:07.476 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-06T04:11:07.477 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-06T04:11:07.477 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-06T04:11:07.477 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-06T04:11:07.477 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-06T04:11:07.477 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-06T04:11:07.477 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-06T04:11:07.478 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-06T04:11:07.478 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-06T04:11:07.478 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-06T04:11:07.478 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-06T04:11:07.478 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-06T04:11:07.478 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-06T04:11:07.478 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-06T04:11:07.478 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-06T04:11:07.478 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-06T04:11:07.478 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-06T04:11:07.478 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-06T04:11:07.479 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-06T04:11:07.479 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-06T04:11:07.479 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-06T04:11:07.479 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-06T04:11:07.479 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-06T04:11:07.479 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-06T04:11:07.479 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-06T04:11:07.479 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-06T04:11:07.479 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-06T04:11:07.479 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-06T04:11:07.479 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-06T04:11:07.479 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-06T04:11:07.480 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-06T04:11:07.480 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-06T04:11:07.480 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-06T04:11:07.480 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-06T04:11:07.480 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-06T04:11:07.480 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-06T04:11:07.480 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-06T04:11:07.480 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-06T04:11:07.480 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-06T04:11:07.480 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-06T04:11:07.481 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-06T04:11:07.481 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-06T04:11:07.481 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-06T04:11:07.481 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-06T04:11:07.481 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-06T04:11:07.481 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-06T04:11:07.481 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-06T04:11:07.481 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-06T04:11:07.481 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-06T04:11:07.481 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-06T04:11:07.481 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-06T04:11:07.482 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-06T04:11:07.482 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-06T04:11:07.482 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-06T04:11:07.482 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-06T04:11:07.482 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-06T04:11:07.482 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-06T04:11:07.482 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-06T04:11:07.482 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-06T04:11:07.482 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-06T04:11:07.482 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-06T04:11:07.482 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-06T04:11:07.482 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-06T04:11:07.483 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-06T04:11:07.483 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-06T04:11:07.483 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-06T04:11:07.483 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-06T04:11:07.483 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-06T04:11:07.483 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-06T04:11:07.483 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-06T04:11:07.483 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-06T04:11:07.483 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-06T04:11:07.483 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-06T04:11:07.483 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-06T04:11:07.483 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-06T04:11:07.484 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-06T04:11:07.484 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-06T04:11:07.484 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-06T04:11:07.484 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-06T04:11:07.484 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-06T04:11:07.484 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-06T04:11:07.484 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-06T04:11:07.484 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-06T04:11:07.484 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-06T04:11:07.484 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-06T04:11:07.484 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-06T04:11:07.484 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-06T04:11:07.484 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-06T04:11:07.485 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-06T04:11:07.485 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-06T04:11:07.485 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-06T04:11:07.485 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-06T04:11:07.485 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-06T04:11:07.485 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-06T04:11:07.485 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-06T04:11:07.485 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-06T04:11:07.485 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-06T04:11:07.485 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-06T04:11:07.485 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-06T04:11:07.485 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-06T04:11:07.486 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-06T04:11:07.486 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-06T04:11:07.486 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-06T04:11:07.486 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-06T04:11:07.486 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-06T04:11:07.486 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-06T04:11:07.486 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-06T04:11:07.486 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-06T04:11:07.486 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-06T04:11:07.486 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-06T04:11:07.486 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-06T04:11:07.486 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-06T04:11:07.487 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-06T04:11:07.487 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-06T04:11:07.487 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-06T04:11:07.487 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-06T04:11:07.487 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-06T04:11:07.487 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-06T04:11:07.487 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-06T04:11:07.487 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-06T04:11:07.487 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-06T04:11:07.487 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-06T04:11:07.488 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-06T04:11:07.488 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-06T04:11:07.488 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-06T04:11:07.488 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-06T04:11:07.488 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-06T04:11:07.488 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-06T04:11:07.488 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-06T04:11:07.488 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-06T04:11:07.488 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-06T04:11:07.488 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-06T04:11:07.488 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-06T04:11:07.488 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-06T04:11:07.489 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-06T04:11:07.489 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-06T04:11:07.489 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-06T04:11:07.489 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-06T04:11:07.489 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-06T04:11:07.489 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-06T04:11:07.489 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-06T04:11:07.489 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-06T04:11:07.489 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-06T04:11:07.489 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-06T04:11:07.489 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-06T04:11:07.490 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-06T04:11:07.490 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-06T04:11:07.490 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-06T04:11:07.490 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-06T04:11:07.490 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-06T04:11:07.490 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-06T04:11:07.490 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-06T04:11:07.490 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-06T04:11:07.490 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-06T04:11:07.490 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-06T04:11:07.490 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-06T04:11:07.490 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-06T04:11:07.491 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-06T04:11:07.491 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-06T04:11:07.491 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-06T04:11:07.491 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-06T04:11:07.491 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-06T04:11:07.491 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-06T04:11:07.491 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-06T04:11:07.491 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-06T04:11:07.491 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-06T04:11:07.491 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-06T04:11:07.491 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-06T04:11:07.491 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-06T04:11:07.492 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-06T04:11:07.492 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-06T04:11:07.492 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-06T04:11:07.492 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-06T04:11:07.492 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-06T04:11:07.492 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-06T04:11:07.492 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-06T04:11:07.492 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-06T04:11:07.492 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-06T04:11:07.492 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-06T04:11:07.492 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-06T04:11:07.492 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-06T04:11:07.493 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-06T04:11:07.493 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-06T04:11:07.493 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-06T04:11:07.493 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-06T04:11:07.493 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-06T04:11:07.493 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-06T04:11:07.493 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-06T04:11:07.493 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-06T04:11:07.493 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-06T04:11:07.493 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-06T04:11:07.493 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-06T04:11:07.493 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-06T04:11:07.494 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-06T04:11:07.494 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-06T04:11:07.494 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-06T04:11:07.494 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-06T04:11:07.494 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-06T04:11:07.494 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-06T04:11:07.494 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-06T04:11:07.494 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-06T04:11:07.494 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-06T04:11:07.494 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-06T04:11:07.494 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-06T04:11:07.495 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-06T04:11:07.495 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-06T04:11:07.495 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-06T04:11:07.495 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-06T04:11:07.495 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-06T04:11:07.495 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-06T04:11:07.495 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-06T04:11:07.495 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-06T04:11:07.495 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-06T04:11:07.495 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-06T04:11:07.495 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-06T04:11:07.495 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-06T04:11:07.496 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-06T04:11:07.496 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-06T04:11:07.496 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-06T04:11:07.496 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-06T04:11:07.496 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-06T04:11:07.496 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-06T04:11:07.496 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-06T04:11:07.496 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-06T04:11:07.496 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-06T04:11:07.496 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-06T04:11:07.496 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-06T04:11:07.496 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-06T04:11:07.496 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-06T04:11:07.497 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-06T04:11:07.497 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-06T04:11:07.497 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-06T04:11:07.497 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-06T04:11:07.497 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-06T04:11:07.497 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-06T04:11:07.497 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-06T04:11:07.497 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-06T04:11:07.497 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-06T04:11:07.497 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-06T04:11:07.498 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-06T04:11:07.498 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-06T04:11:07.498 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-06T04:11:07.498 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-06T04:11:07.498 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-06T04:11:07.498 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-06T04:11:07.498 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-06T04:11:07.498 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-06T04:11:07.498 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-06T04:11:07.498 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-06T04:11:07.498 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-06T04:11:07.499 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-06T04:11:07.499 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-06T04:11:07.499 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-06T04:11:07.499 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-06T04:11:07.499 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-06T04:11:07.499 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-06T04:11:07.499 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-06T04:11:07.499 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-06T04:11:07.499 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-06T04:11:07.499 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-06T04:11:07.499 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-06T04:11:07.499 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-06T04:11:07.500 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-06T04:11:07.500 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-06T04:11:07.500 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-06T04:11:07.500 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-06T04:11:07.500 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-06T04:11:07.500 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-06T04:11:07.500 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-06T04:11:07.500 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-06T04:11:07.500 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-06T04:11:07.500 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-06T04:11:07.500 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-06T04:11:07.500 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-06T04:11:07.501 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-06T04:11:07.501 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-06T04:11:07.501 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-06T04:11:07.501 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-06T04:11:07.501 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-06T04:11:07.501 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-06T04:11:07.501 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-06T04:11:07.501 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-06T04:11:07.501 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-06T04:11:07.501 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-06T04:11:07.501 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-06T04:11:07.502 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-06T04:11:07.502 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-06T04:11:07.502 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-06T04:11:07.502 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-06T04:11:07.502 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-06T04:11:07.502 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-06T04:11:07.502 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-06T04:11:07.502 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-06T04:11:07.502 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-06T04:11:07.502 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-06T04:11:07.502 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-06T04:11:07.503 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-06T04:11:07.503 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-06T04:11:07.503 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-06T04:11:07.503 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-06T04:11:07.503 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-06T04:11:07.503 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-06T04:11:07.503 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-06T04:11:07.503 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-06T04:11:07.503 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-06T04:11:07.503 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-06T04:11:07.503 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-06T04:11:07.503 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-06T04:11:07.504 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-06T04:11:07.504 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-06T04:11:07.504 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-06T04:11:07.504 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-06T04:11:07.504 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-06T04:11:07.504 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-06T04:11:07.504 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-06T04:11:07.504 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-06T04:11:07.504 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-06T04:11:07.504 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-06T04:11:07.504 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-06T04:11:07.504 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-06T04:11:07.505 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-06T04:11:07.505 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-06T04:11:07.505 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-06T04:11:07.505 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-06T04:11:07.505 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-06T04:11:07.505 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-06T04:11:07.505 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-06T04:11:07.505 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-06T04:11:07.505 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-06T04:11:07.505 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-06T04:11:07.505 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-06T04:11:07.506 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-06T04:11:07.506 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-06T04:11:07.506 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-06T04:11:07.506 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-06T04:11:07.506 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-06T04:11:07.506 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-06T04:11:07.506 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-06T04:11:07.506 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-06T04:11:07.506 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-06T04:11:07.506 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-06T04:11:07.506 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-06T04:11:07.507 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-06T04:11:07.507 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-06T04:11:07.507 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-06T04:11:07.507 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-06T04:11:07.507 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-06T04:11:07.507 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-06T04:11:07.507 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-06T04:11:07.507 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-06T04:11:07.507 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-06T04:11:07.507 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-06T04:11:07.507 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-06T04:11:07.508 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-06T04:11:07.508 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-06T04:11:07.508 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-06T04:11:07.508 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-06T04:11:07.508 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-06T04:11:07.508 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-06T04:11:07.508 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-06T04:11:07.508 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-06T04:11:07.508 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-06T04:11:07.508 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-06T04:11:07.508 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-06T04:11:07.509 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-06T04:11:07.509 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-06T04:11:07.509 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-06T04:11:07.509 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-06T04:11:07.509 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-06T04:11:07.509 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-06T04:11:07.509 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-06T04:11:07.509 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-06T04:11:07.509 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-06T04:11:07.509 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-06T04:11:07.509 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-06T04:11:07.510 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-06T04:11:07.510 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-06T04:11:07.510 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-06T04:11:07.510 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-06T04:11:07.510 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-06T04:11:07.510 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-06T04:11:07.510 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-06T04:11:07.510 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-06T04:11:07.510 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-06T04:11:07.510 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-06T04:11:07.511 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-06T04:11:07.511 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-06T04:11:07.511 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-06T04:11:07.511 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-06T04:11:07.511 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-06T04:11:07.511 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-06T04:11:07.511 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-06T04:11:07.511 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-06T04:11:07.511 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-06T04:11:07.511 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-06T04:11:07.511 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-06T04:11:07.512 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-06T04:11:07.512 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-06T04:11:07.512 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-06T04:11:07.512 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-06T04:11:07.512 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-06T04:11:07.512 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-06T04:11:07.512 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-06T04:11:07.512 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-06T04:11:07.512 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-06T04:11:07.513 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-06T04:11:07.513 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-06T04:11:07.513 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-06T04:11:07.513 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-06T04:11:07.513 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-06T04:11:07.513 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-06T04:11:07.513 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-06T04:11:07.513 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-06T04:11:07.514 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-06T04:11:07.514 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-06T04:11:07.514 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-06T04:11:07.514 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-06T04:11:07.514 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-06T04:11:07.514 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-06T04:11:07.514 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-06T04:11:07.514 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-06T04:11:07.514 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-06T04:11:07.514 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-06T04:11:07.515 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-06T04:11:07.515 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-06T04:11:07.515 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-06T04:11:07.515 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-06T04:11:07.515 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-06T04:11:07.515 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-06T04:11:07.515 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-06T04:11:07.515 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-06T04:11:07.515 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-06T04:11:07.515 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-06T04:11:07.516 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-06T04:11:07.516 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-06T04:11:07.516 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-06T04:11:07.516 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-06T04:11:07.516 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-06T04:11:07.516 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-06T04:11:07.516 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-06T04:11:07.516 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-06T04:11:07.516 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-06T04:11:07.516 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-06T04:11:07.517 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-06T04:11:07.517 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-06T04:11:07.517 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-06T04:11:07.517 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-06T04:11:07.517 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-06T04:11:07.517 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-06T04:11:07.517 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-06T04:11:07.517 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-06T04:11:07.517 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-06T04:11:07.517 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-06T04:11:07.518 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-06T04:11:07.518 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-06T04:11:07.518 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-06T04:11:07.518 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-06T04:11:07.518 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-06T04:11:07.518 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-06T04:11:07.518 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-06T04:11:07.518 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-06T04:11:07.519 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-06T04:11:07.519 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-06T04:11:07.519 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-06T04:11:07.519 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-06T04:11:07.519 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-06T04:11:07.519 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-06T04:11:07.519 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-06T04:11:07.519 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-06T04:11:07.519 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-06T04:11:07.519 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-06T04:11:07.520 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-06T04:11:07.520 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-06T04:11:07.520 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-06T04:11:07.520 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-06T04:11:07.520 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-06T04:11:07.520 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-06T04:11:07.520 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-06T04:11:07.520 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-06T04:11:07.520 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-06T04:11:07.520 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-06T04:11:07.521 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-06T04:11:07.521 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-06T04:11:07.521 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-06T04:11:07.521 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-06T04:11:07.521 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-06T04:11:07.521 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-06T04:11:07.521 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-06T04:11:07.521 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-06T04:11:07.522 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-06T04:11:07.522 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-06T04:11:07.522 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-06T04:11:07.522 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-06T04:11:07.522 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-06T04:11:07.522 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-06T04:11:07.522 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-06T04:11:07.522 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-06T04:11:07.522 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-06T04:11:07.523 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-06T04:11:07.523 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-06T04:11:07.523 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-06T04:11:07.523 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-06T04:11:07.523 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-06T04:11:07.523 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-06T04:11:07.523 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-06T04:11:07.523 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-06T04:11:07.523 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-06T04:11:07.523 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-06T04:11:07.524 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-06T04:11:07.524 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-06T04:11:07.524 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-06T04:11:07.524 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-06T04:11:07.524 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-06T04:11:07.524 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-06T04:11:07.524 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-06T04:11:07.524 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-06T04:11:07.524 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-06T04:11:07.524 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-06T04:11:07.525 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-06T04:11:07.525 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-06T04:11:07.525 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-06T04:11:07.525 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-06T04:11:07.525 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-06T04:11:07.525 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-06T04:11:07.525 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-06T04:11:07.525 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-06T04:11:07.525 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-06T04:11:07.525 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-06T04:11:07.526 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-06T04:11:07.526 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-06T04:11:07.526 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-06T04:11:07.526 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-06T04:11:07.526 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-06T04:11:07.526 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-06T04:11:07.526 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-06T04:11:07.526 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-06T04:11:07.526 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-06T04:11:07.526 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-06T04:11:07.526 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-06T04:11:07.527 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-06T04:11:07.527 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-06T04:11:07.527 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-06T04:11:07.527 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-06T04:11:07.527 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-06T04:11:07.527 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-06T04:11:07.527 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-06T04:11:07.527 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-06T04:11:07.527 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-06T04:11:07.527 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-06T04:11:07.527 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-06T04:11:07.528 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-06T04:11:07.528 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-06T04:11:07.528 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-06T04:11:07.528 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-06T04:11:07.528 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-06T04:11:07.528 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-06T04:11:07.528 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-06T04:11:07.528 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-06T04:11:07.528 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-06T04:11:07.528 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-06T04:11:07.528 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-06T04:11:07.529 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-06T04:11:07.529 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-06T04:11:07.529 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-06T04:11:07.529 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-06T04:11:07.529 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-06T04:11:07.529 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-06T04:11:07.529 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-06T04:11:07.529 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-06T04:11:07.529 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-06T04:11:07.529 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-06T04:11:07.529 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-06T04:11:07.529 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-06T04:11:07.529 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-06T04:11:07.530 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-06T04:11:07.530 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-06T04:11:07.530 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-06T04:11:07.530 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-06T04:11:07.530 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-06T04:11:07.530 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-06T04:11:07.530 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-06T04:11:07.530 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-06T04:11:07.530 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-06T04:11:07.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-06T04:11:07.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-06T04:11:07.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-06T04:11:07.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-06T04:11:07.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-06T04:11:07.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-06T04:11:07.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-06T04:11:07.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-06T04:11:07.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-06T04:11:07.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-06T04:11:07.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-06T04:11:07.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-06T04:11:07.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-06T04:11:07.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-06T04:11:07.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-06T04:11:07.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-06T04:11:07.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-06T04:11:07.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-06T04:11:07.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-06T04:11:07.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-06T04:11:07.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-06T04:11:07.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-06T04:11:07.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-06T04:11:07.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-06T04:11:07.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-06T04:11:07.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-06T04:11:07.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-06T04:11:07.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-06T04:11:07.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-06T04:11:07.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-06T04:11:07.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-06T04:11:07.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-06T04:11:07.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-06T04:11:07.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-06T04:11:07.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-06T04:11:07.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-06T04:11:07.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-06T04:11:07.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-06T04:11:07.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-06T04:11:07.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-06T04:11:07.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-06T04:11:07.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-06T04:11:07.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-06T04:11:07.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-06T04:11:07.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-06T04:11:07.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-06T04:11:07.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-06T04:11:07.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-06T04:11:07.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-06T04:11:07.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-06T04:11:07.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-06T04:11:07.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-06T04:11:07.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-06T04:11:07.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-06T04:11:07.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-06T04:11:07.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-06T04:11:07.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-06T04:11:07.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-06T04:11:07.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-06T04:11:07.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-06T04:11:07.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-06T04:11:07.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-06T04:11:07.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-06T04:11:07.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-06T04:11:07.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-06T04:11:07.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-06T04:11:07.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-06T04:11:07.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-06T04:11:07.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-06T04:11:07.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-06T04:11:07.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-06T04:11:07.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-06T04:11:07.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-06T04:11:07.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-06T04:11:07.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-06T04:11:07.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-06T04:11:07.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-06T04:11:07.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-06T04:11:07.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-06T04:11:07.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-06T04:11:07.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-06T04:11:07.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-06T04:11:07.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-06T04:11:07.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-06T04:11:07.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-06T04:11:07.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-06T04:11:07.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-06T04:11:07.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-06T04:11:07.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-06T04:11:07.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-06T04:11:07.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-06T04:11:07.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-06T04:11:07.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-06T04:11:07.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-06T04:11:07.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-06T04:11:07.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-06T04:11:07.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-06T04:11:07.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-06T04:11:07.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-06T04:11:07.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-06T04:11:07.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-06T04:11:07.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-06T04:11:07.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-06T04:11:07.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-06T04:11:07.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-06T04:11:07.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-06T04:11:07.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-06T04:11:07.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-06T04:11:07.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-06T04:11:07.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-06T04:11:07.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-06T04:11:07.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-06T04:11:07.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-06T04:11:07.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-06T04:11:07.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-06T04:11:07.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-06T04:11:07.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-06T04:11:07.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-06T04:11:07.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-06T04:11:07.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-06T04:11:07.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-06T04:11:07.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-06T04:11:07.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-06T04:11:07.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-06T04:11:07.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-06T04:11:07.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-06T04:11:07.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-06T04:11:07.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-06T04:11:07.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-06T04:11:07.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-06T04:11:07.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-06T04:11:07.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-06T04:11:07.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-06T04:11:07.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-06T04:11:07.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-06T04:11:07.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-06T04:11:07.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-06T04:11:07.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-06T04:11:07.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-06T04:11:07.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-06T04:11:07.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-06T04:11:07.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-06T04:11:07.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-06T04:11:07.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-06T04:11:07.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-06T04:11:07.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-06T04:11:07.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-06T04:11:07.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-06T04:11:07.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-06T04:11:07.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-06T04:11:07.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-06T04:11:07.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-06T04:11:07.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-06T04:11:07.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-06T04:11:07.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-06T04:11:07.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-06T04:11:07.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-06T04:11:07.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-06T04:11:07.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-06T04:11:07.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-06T04:11:07.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-06T04:11:07.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-06T04:11:07.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-06T04:11:07.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-06T04:11:07.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-06T04:11:07.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-06T04:11:07.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-06T04:11:07.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-06T04:11:07.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-06T04:11:07.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-06T04:11:07.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-06T04:11:07.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-06T04:11:07.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-06T04:11:07.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-06T04:11:07.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-06T04:11:07.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-06T04:11:07.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-06T04:11:07.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-06T04:11:07.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-06T04:11:07.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-06T04:11:07.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-06T04:11:07.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-06T04:11:07.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-06T04:11:07.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-06T04:11:07.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-06T04:11:07.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-06T04:11:07.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-06T04:11:07.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-06T04:11:07.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-06T04:11:07.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-06T04:11:07.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-06T04:11:07.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-06T04:11:07.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-06T04:11:07.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-06T04:11:07.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-06T04:11:07.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-06T04:11:07.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-06T04:11:07.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-06T04:11:07.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-06T04:11:07.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-06T04:11:07.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-06T04:11:07.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-06T04:11:07.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-06T04:11:07.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-06T04:11:07.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-06T04:11:07.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-06T04:11:07.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-06T04:11:07.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-06T04:11:07.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-06T04:11:07.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-06T04:11:07.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-06T04:11:07.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-06T04:11:07.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-06T04:11:07.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-06T04:11:07.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-06T04:11:07.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-06T04:11:07.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-06T04:11:07.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-06T04:11:07.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-06T04:11:07.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-06T04:11:07.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-06T04:11:07.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-06T04:11:07.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-06T04:11:07.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-06T04:11:07.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-06T04:11:07.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-06T04:11:07.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-06T04:11:07.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-06T04:11:07.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-06T04:11:07.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-06T04:11:07.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-06T04:11:07.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-06T04:11:07.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-06T04:11:07.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-06T04:11:07.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-06T04:11:07.552 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-06T04:11:07.552 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-06T04:11:07.552 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-06T04:11:07.552 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-06T04:11:07.552 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-06T04:11:07.552 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-06T04:11:07.553 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-06T04:11:07.553 DEBUG:teuthology.orchestra.run.smithi060:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-06T04:11:07.577 INFO:teuthology.orchestra.run.smithi060.stdout:postinstall scriptlet (using /bin/sh): 2023-10-06T04:11:07.578 INFO:teuthology.orchestra.run.smithi060.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-06T04:11:07.578 INFO:teuthology.orchestra.run.smithi060.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T04:11:07.578 INFO:teuthology.orchestra.run.smithi060.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T04:11:07.578 INFO:teuthology.orchestra.run.smithi060.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T04:11:07.578 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T04:11:07.578 INFO:teuthology.orchestra.run.smithi060.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T04:11:07.578 INFO:teuthology.orchestra.run.smithi060.stdout:fi 2023-10-06T04:11:07.578 INFO:teuthology.orchestra.run.smithi060.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-06T04:11:07.578 INFO:teuthology.orchestra.run.smithi060.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-06T04:11:07.578 INFO:teuthology.orchestra.run.smithi060.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-06T04:11:07.579 INFO:teuthology.orchestra.run.smithi060.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-06T04:11:07.579 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T04:11:07.579 INFO:teuthology.orchestra.run.smithi060.stdout:fi 2023-10-06T04:11:07.579 INFO:teuthology.orchestra.run.smithi060.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-06T04:11:07.579 INFO:teuthology.orchestra.run.smithi060.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-06T04:11:07.579 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T04:11:07.579 INFO:teuthology.orchestra.run.smithi060.stdout:fi 2023-10-06T04:11:07.580 DEBUG:teuthology.orchestra.run.smithi060:> sudo rpm -qi grub2-tools 2023-10-06T04:11:07.656 INFO:teuthology.orchestra.run.smithi060.stdout:Name : grub2-tools 2023-10-06T04:11:07.657 INFO:teuthology.orchestra.run.smithi060.stdout:Epoch : 1 2023-10-06T04:11:07.657 INFO:teuthology.orchestra.run.smithi060.stdout:Version : 2.02 2023-10-06T04:11:07.657 INFO:teuthology.orchestra.run.smithi060.stdout:Release : 99.el8_4.1 2023-10-06T04:11:07.657 INFO:teuthology.orchestra.run.smithi060.stdout:Architecture: x86_64 2023-10-06T04:11:07.657 INFO:teuthology.orchestra.run.smithi060.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T04:11:07.657 INFO:teuthology.orchestra.run.smithi060.stdout:Group : System Environment/Base 2023-10-06T04:11:07.658 INFO:teuthology.orchestra.run.smithi060.stdout:Size : 9264631 2023-10-06T04:11:07.658 INFO:teuthology.orchestra.run.smithi060.stdout:License : GPLv3+ 2023-10-06T04:11:07.658 INFO:teuthology.orchestra.run.smithi060.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T04:11:07.658 INFO:teuthology.orchestra.run.smithi060.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T04:11:07.658 INFO:teuthology.orchestra.run.smithi060.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T04:11:07.659 INFO:teuthology.orchestra.run.smithi060.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T04:11:07.659 INFO:teuthology.orchestra.run.smithi060.stdout:Relocations : (not relocatable) 2023-10-06T04:11:07.659 INFO:teuthology.orchestra.run.smithi060.stdout:Packager : Red Hat, Inc. 2023-10-06T04:11:07.659 INFO:teuthology.orchestra.run.smithi060.stdout:Vendor : Red Hat, Inc. 2023-10-06T04:11:07.659 INFO:teuthology.orchestra.run.smithi060.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T04:11:07.660 INFO:teuthology.orchestra.run.smithi060.stdout:Summary : Support tools for GRUB. 2023-10-06T04:11:07.660 INFO:teuthology.orchestra.run.smithi060.stdout:Description : 2023-10-06T04:11:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:11:07.660 INFO:teuthology.orchestra.run.smithi060.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T04:11:07.660 INFO:teuthology.orchestra.run.smithi060.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T04:11:07.661 INFO:teuthology.orchestra.run.smithi060.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T04:11:07.661 INFO:teuthology.orchestra.run.smithi060.stdout:hardware devices. 2023-10-06T04:11:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:11:07.661 INFO:teuthology.orchestra.run.smithi060.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T04:11:07.662 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T04:11:07.662 INFO:teuthology.task.kernel:Updating grub on smithi060 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-06T04:11:07.663 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T04:11:08.236 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi135.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-06T04:11:08.236 DEBUG:teuthology.orchestra.run.smithi135:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-06T04:11:08.292 INFO:teuthology.orchestra.run.smithi135.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T04:11:08.292 INFO:teuthology.orchestra.run.smithi135.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-06T04:11:08.292 INFO:teuthology.orchestra.run.smithi135.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-06T04:11:08.292 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-06T04:11:08.292 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-06T04:11:08.292 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-06T04:11:08.292 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-06T04:11:08.292 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-06T04:11:08.292 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-06T04:11:08.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-06T04:11:08.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-06T04:11:08.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-06T04:11:08.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-06T04:11:08.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-06T04:11:08.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-06T04:11:08.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-06T04:11:08.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-06T04:11:08.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-06T04:11:08.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-06T04:11:08.293 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-06T04:11:08.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-06T04:11:08.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-06T04:11:08.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-06T04:11:08.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-06T04:11:08.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-06T04:11:08.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-06T04:11:08.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-06T04:11:08.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-06T04:11:08.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-06T04:11:08.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-06T04:11:08.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-06T04:11:08.294 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-06T04:11:08.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-06T04:11:08.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-06T04:11:08.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-06T04:11:08.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-06T04:11:08.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-06T04:11:08.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-06T04:11:08.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-06T04:11:08.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-06T04:11:08.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-06T04:11:08.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-06T04:11:08.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-06T04:11:08.295 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-06T04:11:08.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-06T04:11:08.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-06T04:11:08.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-06T04:11:08.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-06T04:11:08.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-06T04:11:08.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-06T04:11:08.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-06T04:11:08.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-06T04:11:08.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-06T04:11:08.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-06T04:11:08.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-06T04:11:08.296 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-06T04:11:08.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-06T04:11:08.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-06T04:11:08.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-06T04:11:08.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-06T04:11:08.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-06T04:11:08.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-06T04:11:08.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-06T04:11:08.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-06T04:11:08.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-06T04:11:08.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-06T04:11:08.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-06T04:11:08.297 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-06T04:11:08.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-06T04:11:08.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-06T04:11:08.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-06T04:11:08.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-06T04:11:08.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-06T04:11:08.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-06T04:11:08.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-06T04:11:08.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-06T04:11:08.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-06T04:11:08.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-06T04:11:08.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-06T04:11:08.298 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-06T04:11:08.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-06T04:11:08.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-06T04:11:08.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-06T04:11:08.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-06T04:11:08.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-06T04:11:08.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-06T04:11:08.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-06T04:11:08.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-06T04:11:08.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-06T04:11:08.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-06T04:11:08.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-06T04:11:08.299 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-06T04:11:08.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-06T04:11:08.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-06T04:11:08.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-06T04:11:08.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-06T04:11:08.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-06T04:11:08.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-06T04:11:08.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-06T04:11:08.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-06T04:11:08.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-06T04:11:08.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-06T04:11:08.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-06T04:11:08.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-06T04:11:08.300 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-06T04:11:08.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-06T04:11:08.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-06T04:11:08.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-06T04:11:08.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-06T04:11:08.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-06T04:11:08.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-06T04:11:08.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-06T04:11:08.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-06T04:11:08.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-06T04:11:08.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-06T04:11:08.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-06T04:11:08.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-06T04:11:08.301 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-06T04:11:08.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-06T04:11:08.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-06T04:11:08.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-06T04:11:08.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-06T04:11:08.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-06T04:11:08.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-06T04:11:08.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-06T04:11:08.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-06T04:11:08.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-06T04:11:08.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-06T04:11:08.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-06T04:11:08.302 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-06T04:11:08.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-06T04:11:08.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-06T04:11:08.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-06T04:11:08.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-06T04:11:08.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-06T04:11:08.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-06T04:11:08.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-06T04:11:08.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-06T04:11:08.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-06T04:11:08.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-06T04:11:08.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-06T04:11:08.303 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-06T04:11:08.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-06T04:11:08.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-06T04:11:08.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-06T04:11:08.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-06T04:11:08.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-06T04:11:08.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-06T04:11:08.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-06T04:11:08.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-06T04:11:08.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-06T04:11:08.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-06T04:11:08.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-06T04:11:08.304 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-06T04:11:08.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-06T04:11:08.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-06T04:11:08.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-06T04:11:08.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-06T04:11:08.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-06T04:11:08.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-06T04:11:08.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-06T04:11:08.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-06T04:11:08.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-06T04:11:08.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-06T04:11:08.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-06T04:11:08.305 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-06T04:11:08.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-06T04:11:08.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-06T04:11:08.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-06T04:11:08.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-06T04:11:08.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-06T04:11:08.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-06T04:11:08.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-06T04:11:08.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-06T04:11:08.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-06T04:11:08.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-06T04:11:08.306 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-06T04:11:08.307 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-06T04:11:08.307 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-06T04:11:08.307 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-06T04:11:08.307 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-06T04:11:08.307 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-06T04:11:08.307 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-06T04:11:08.309 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-06T04:11:08.309 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-06T04:11:08.309 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-06T04:11:08.309 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-06T04:11:08.309 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-06T04:11:08.309 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-06T04:11:08.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-06T04:11:08.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-06T04:11:08.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-06T04:11:08.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-06T04:11:08.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-06T04:11:08.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-06T04:11:08.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-06T04:11:08.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-06T04:11:08.310 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-06T04:11:08.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-06T04:11:08.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-06T04:11:08.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-06T04:11:08.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-06T04:11:08.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-06T04:11:08.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-06T04:11:08.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-06T04:11:08.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-06T04:11:08.311 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-06T04:11:08.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-06T04:11:08.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-06T04:11:08.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-06T04:11:08.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-06T04:11:08.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-06T04:11:08.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-06T04:11:08.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-06T04:11:08.312 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-06T04:11:08.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-06T04:11:08.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-06T04:11:08.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-06T04:11:08.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-06T04:11:08.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-06T04:11:08.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-06T04:11:08.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-06T04:11:08.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-06T04:11:08.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-06T04:11:08.313 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-06T04:11:08.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-06T04:11:08.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-06T04:11:08.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-06T04:11:08.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-06T04:11:08.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-06T04:11:08.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-06T04:11:08.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-06T04:11:08.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-06T04:11:08.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-06T04:11:08.314 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-06T04:11:08.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-06T04:11:08.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-06T04:11:08.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-06T04:11:08.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-06T04:11:08.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-06T04:11:08.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-06T04:11:08.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-06T04:11:08.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-06T04:11:08.315 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-06T04:11:08.316 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-06T04:11:08.316 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-06T04:11:08.316 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-06T04:11:08.316 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-06T04:11:08.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-06T04:11:08.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-06T04:11:08.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-06T04:11:08.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-06T04:11:08.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-06T04:11:08.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-06T04:11:08.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-06T04:11:08.317 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-06T04:11:08.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-06T04:11:08.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-06T04:11:08.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-06T04:11:08.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-06T04:11:08.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-06T04:11:08.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-06T04:11:08.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-06T04:11:08.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-06T04:11:08.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-06T04:11:08.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-06T04:11:08.318 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-06T04:11:08.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-06T04:11:08.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-06T04:11:08.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-06T04:11:08.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-06T04:11:08.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-06T04:11:08.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-06T04:11:08.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-06T04:11:08.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-06T04:11:08.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-06T04:11:08.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-06T04:11:08.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-06T04:11:08.319 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-06T04:11:08.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-06T04:11:08.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-06T04:11:08.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-06T04:11:08.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-06T04:11:08.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-06T04:11:08.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-06T04:11:08.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-06T04:11:08.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-06T04:11:08.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-06T04:11:08.320 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-06T04:11:08.321 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-06T04:11:08.321 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-06T04:11:08.321 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-06T04:11:08.321 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-06T04:11:08.321 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-06T04:11:08.321 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-06T04:11:08.321 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-06T04:11:08.322 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-06T04:11:08.322 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-06T04:11:08.322 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-06T04:11:08.322 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-06T04:11:08.322 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-06T04:11:08.323 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-06T04:11:08.323 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-06T04:11:08.323 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-06T04:11:08.323 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-06T04:11:08.323 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-06T04:11:08.323 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-06T04:11:08.323 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-06T04:11:08.324 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-06T04:11:08.324 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-06T04:11:08.324 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-06T04:11:08.324 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-06T04:11:08.324 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-06T04:11:08.324 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-06T04:11:08.324 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-06T04:11:08.324 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-06T04:11:08.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-06T04:11:08.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-06T04:11:08.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-06T04:11:08.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-06T04:11:08.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-06T04:11:08.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-06T04:11:08.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-06T04:11:08.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-06T04:11:08.325 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-06T04:11:08.326 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-06T04:11:08.326 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-06T04:11:08.326 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-06T04:11:08.326 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-06T04:11:08.326 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-06T04:11:08.326 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-06T04:11:08.326 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-06T04:11:08.327 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-06T04:11:08.327 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-06T04:11:08.327 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-06T04:11:08.327 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-06T04:11:08.327 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-06T04:11:08.327 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-06T04:11:08.327 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-06T04:11:08.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-06T04:11:08.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-06T04:11:08.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-06T04:11:08.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-06T04:11:08.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-06T04:11:08.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-06T04:11:08.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-06T04:11:08.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-06T04:11:08.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-06T04:11:08.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-06T04:11:08.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-06T04:11:08.328 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-06T04:11:08.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-06T04:11:08.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-06T04:11:08.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-06T04:11:08.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-06T04:11:08.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-06T04:11:08.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-06T04:11:08.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-06T04:11:08.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-06T04:11:08.329 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-06T04:11:08.330 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-06T04:11:08.330 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-06T04:11:08.330 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-06T04:11:08.330 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-06T04:11:08.330 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-06T04:11:08.330 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-06T04:11:08.330 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-06T04:11:08.330 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-06T04:11:08.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-06T04:11:08.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-06T04:11:08.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-06T04:11:08.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-06T04:11:08.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-06T04:11:08.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-06T04:11:08.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-06T04:11:08.331 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-06T04:11:08.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-06T04:11:08.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-06T04:11:08.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-06T04:11:08.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-06T04:11:08.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-06T04:11:08.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-06T04:11:08.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-06T04:11:08.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-06T04:11:08.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-06T04:11:08.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-06T04:11:08.332 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-06T04:11:08.333 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-06T04:11:08.333 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-06T04:11:08.333 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-06T04:11:08.333 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-06T04:11:08.333 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-06T04:11:08.333 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-06T04:11:08.333 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-06T04:11:08.334 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-06T04:11:08.334 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-06T04:11:08.334 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-06T04:11:08.334 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-06T04:11:08.334 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-06T04:11:08.335 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-06T04:11:08.335 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-06T04:11:08.335 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-06T04:11:08.335 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-06T04:11:08.335 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-06T04:11:08.335 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-06T04:11:08.336 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-06T04:11:08.336 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-06T04:11:08.336 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-06T04:11:08.336 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-06T04:11:08.336 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-06T04:11:08.336 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-06T04:11:08.336 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-06T04:11:08.337 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-06T04:11:08.337 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-06T04:11:08.337 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-06T04:11:08.337 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-06T04:11:08.337 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-06T04:11:08.337 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-06T04:11:08.337 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-06T04:11:08.337 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-06T04:11:08.338 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-06T04:11:08.338 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-06T04:11:08.338 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-06T04:11:08.338 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-06T04:11:08.338 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-06T04:11:08.338 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-06T04:11:08.339 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-06T04:11:08.339 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-06T04:11:08.339 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-06T04:11:08.339 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-06T04:11:08.339 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-06T04:11:08.339 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-06T04:11:08.339 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-06T04:11:08.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-06T04:11:08.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-06T04:11:08.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-06T04:11:08.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-06T04:11:08.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-06T04:11:08.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-06T04:11:08.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-06T04:11:08.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-06T04:11:08.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-06T04:11:08.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-06T04:11:08.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-06T04:11:08.340 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-06T04:11:08.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-06T04:11:08.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-06T04:11:08.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-06T04:11:08.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-06T04:11:08.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-06T04:11:08.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-06T04:11:08.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-06T04:11:08.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-06T04:11:08.341 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-06T04:11:08.342 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-06T04:11:08.342 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-06T04:11:08.342 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-06T04:11:08.342 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-06T04:11:08.342 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-06T04:11:08.342 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-06T04:11:08.342 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-06T04:11:08.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-06T04:11:08.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-06T04:11:08.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-06T04:11:08.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-06T04:11:08.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-06T04:11:08.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-06T04:11:08.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-06T04:11:08.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-06T04:11:08.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-06T04:11:08.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-06T04:11:08.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-06T04:11:08.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-06T04:11:08.343 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-06T04:11:08.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-06T04:11:08.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-06T04:11:08.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-06T04:11:08.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-06T04:11:08.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-06T04:11:08.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-06T04:11:08.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-06T04:11:08.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-06T04:11:08.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-06T04:11:08.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-06T04:11:08.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-06T04:11:08.344 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-06T04:11:08.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-06T04:11:08.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-06T04:11:08.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-06T04:11:08.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-06T04:11:08.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-06T04:11:08.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-06T04:11:08.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-06T04:11:08.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-06T04:11:08.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-06T04:11:08.345 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-06T04:11:08.346 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-06T04:11:08.346 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-06T04:11:08.346 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-06T04:11:08.346 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-06T04:11:08.346 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-06T04:11:08.346 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-06T04:11:08.346 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-06T04:11:08.346 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-06T04:11:08.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-06T04:11:08.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-06T04:11:08.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-06T04:11:08.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-06T04:11:08.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-06T04:11:08.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-06T04:11:08.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-06T04:11:08.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-06T04:11:08.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-06T04:11:08.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-06T04:11:08.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-06T04:11:08.347 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-06T04:11:08.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-06T04:11:08.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-06T04:11:08.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-06T04:11:08.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-06T04:11:08.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-06T04:11:08.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-06T04:11:08.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-06T04:11:08.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-06T04:11:08.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-06T04:11:08.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-06T04:11:08.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-06T04:11:08.348 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-06T04:11:08.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-06T04:11:08.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-06T04:11:08.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-06T04:11:08.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-06T04:11:08.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-06T04:11:08.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-06T04:11:08.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-06T04:11:08.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-06T04:11:08.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-06T04:11:08.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-06T04:11:08.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-06T04:11:08.349 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-06T04:11:08.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-06T04:11:08.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-06T04:11:08.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-06T04:11:08.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-06T04:11:08.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-06T04:11:08.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-06T04:11:08.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-06T04:11:08.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-06T04:11:08.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-06T04:11:08.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-06T04:11:08.350 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-06T04:11:08.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-06T04:11:08.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-06T04:11:08.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-06T04:11:08.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-06T04:11:08.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-06T04:11:08.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-06T04:11:08.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-06T04:11:08.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-06T04:11:08.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-06T04:11:08.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-06T04:11:08.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-06T04:11:08.351 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-06T04:11:08.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-06T04:11:08.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-06T04:11:08.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-06T04:11:08.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-06T04:11:08.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-06T04:11:08.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-06T04:11:08.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-06T04:11:08.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-06T04:11:08.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-06T04:11:08.352 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-06T04:11:08.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-06T04:11:08.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-06T04:11:08.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-06T04:11:08.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-06T04:11:08.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-06T04:11:08.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-06T04:11:08.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-06T04:11:08.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-06T04:11:08.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-06T04:11:08.353 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-06T04:11:08.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-06T04:11:08.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-06T04:11:08.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-06T04:11:08.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-06T04:11:08.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-06T04:11:08.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-06T04:11:08.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-06T04:11:08.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-06T04:11:08.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-06T04:11:08.354 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-06T04:11:08.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-06T04:11:08.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-06T04:11:08.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-06T04:11:08.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-06T04:11:08.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-06T04:11:08.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-06T04:11:08.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-06T04:11:08.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-06T04:11:08.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-06T04:11:08.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-06T04:11:08.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-06T04:11:08.355 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-06T04:11:08.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-06T04:11:08.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-06T04:11:08.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-06T04:11:08.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-06T04:11:08.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-06T04:11:08.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-06T04:11:08.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-06T04:11:08.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-06T04:11:08.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-06T04:11:08.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-06T04:11:08.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-06T04:11:08.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-06T04:11:08.356 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-06T04:11:08.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-06T04:11:08.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-06T04:11:08.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-06T04:11:08.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-06T04:11:08.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-06T04:11:08.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-06T04:11:08.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-06T04:11:08.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-06T04:11:08.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-06T04:11:08.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-06T04:11:08.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-06T04:11:08.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-06T04:11:08.357 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-06T04:11:08.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-06T04:11:08.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-06T04:11:08.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-06T04:11:08.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-06T04:11:08.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-06T04:11:08.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-06T04:11:08.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-06T04:11:08.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-06T04:11:08.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-06T04:11:08.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-06T04:11:08.358 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-06T04:11:08.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-06T04:11:08.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-06T04:11:08.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-06T04:11:08.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-06T04:11:08.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-06T04:11:08.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-06T04:11:08.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-06T04:11:08.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-06T04:11:08.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-06T04:11:08.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-06T04:11:08.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-06T04:11:08.359 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-06T04:11:08.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-06T04:11:08.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-06T04:11:08.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-06T04:11:08.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-06T04:11:08.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-06T04:11:08.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-06T04:11:08.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-06T04:11:08.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-06T04:11:08.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-06T04:11:08.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-06T04:11:08.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-06T04:11:08.360 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-06T04:11:08.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-06T04:11:08.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-06T04:11:08.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-06T04:11:08.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-06T04:11:08.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-06T04:11:08.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-06T04:11:08.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-06T04:11:08.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-06T04:11:08.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-06T04:11:08.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-06T04:11:08.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-06T04:11:08.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-06T04:11:08.361 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-06T04:11:08.362 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-06T04:11:08.362 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-06T04:11:08.362 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-06T04:11:08.362 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-06T04:11:08.362 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-06T04:11:08.362 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-06T04:11:08.362 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-06T04:11:08.362 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-06T04:11:08.363 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-06T04:11:08.363 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-06T04:11:08.363 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-06T04:11:08.363 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-06T04:11:08.363 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-06T04:11:08.363 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-06T04:11:08.363 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-06T04:11:08.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-06T04:11:08.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-06T04:11:08.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-06T04:11:08.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-06T04:11:08.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-06T04:11:08.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-06T04:11:08.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-06T04:11:08.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-06T04:11:08.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-06T04:11:08.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-06T04:11:08.364 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-06T04:11:08.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-06T04:11:08.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-06T04:11:08.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-06T04:11:08.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-06T04:11:08.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-06T04:11:08.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-06T04:11:08.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-06T04:11:08.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-06T04:11:08.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-06T04:11:08.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-06T04:11:08.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-06T04:11:08.365 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-06T04:11:08.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-06T04:11:08.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-06T04:11:08.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-06T04:11:08.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-06T04:11:08.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-06T04:11:08.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-06T04:11:08.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-06T04:11:08.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-06T04:11:08.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-06T04:11:08.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-06T04:11:08.366 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-06T04:11:08.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-06T04:11:08.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-06T04:11:08.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-06T04:11:08.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-06T04:11:08.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-06T04:11:08.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-06T04:11:08.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-06T04:11:08.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-06T04:11:08.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-06T04:11:08.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-06T04:11:08.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-06T04:11:08.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-06T04:11:08.367 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-06T04:11:08.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-06T04:11:08.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-06T04:11:08.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-06T04:11:08.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-06T04:11:08.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-06T04:11:08.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-06T04:11:08.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-06T04:11:08.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-06T04:11:08.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-06T04:11:08.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-06T04:11:08.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-06T04:11:08.368 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-06T04:11:08.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-06T04:11:08.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-06T04:11:08.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-06T04:11:08.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-06T04:11:08.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-06T04:11:08.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-06T04:11:08.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-06T04:11:08.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-06T04:11:08.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-06T04:11:08.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-06T04:11:08.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-06T04:11:08.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-06T04:11:08.369 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-06T04:11:08.370 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-06T04:11:08.370 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-06T04:11:08.370 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-06T04:11:08.370 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-06T04:11:08.370 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-06T04:11:08.370 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-06T04:11:08.370 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-06T04:11:08.370 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-06T04:11:08.370 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-06T04:11:08.370 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-06T04:11:08.370 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-06T04:11:08.371 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-06T04:11:08.371 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-06T04:11:08.371 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-06T04:11:08.371 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-06T04:11:08.371 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-06T04:11:08.371 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-06T04:11:08.371 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-06T04:11:08.371 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-06T04:11:08.371 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-06T04:11:08.371 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-06T04:11:08.371 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-06T04:11:08.372 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-06T04:11:08.372 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-06T04:11:08.372 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-06T04:11:08.372 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-06T04:11:08.372 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-06T04:11:08.372 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-06T04:11:08.372 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-06T04:11:08.372 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-06T04:11:08.372 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-06T04:11:08.372 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-06T04:11:08.373 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-06T04:11:08.373 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-06T04:11:08.373 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-06T04:11:08.373 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-06T04:11:08.373 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-06T04:11:08.373 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-06T04:11:08.373 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-06T04:11:08.373 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-06T04:11:08.373 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-06T04:11:08.373 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-06T04:11:08.373 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-06T04:11:08.374 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-06T04:11:08.374 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-06T04:11:08.374 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-06T04:11:08.374 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-06T04:11:08.374 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-06T04:11:08.374 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-06T04:11:08.374 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-06T04:11:08.375 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-06T04:11:08.375 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-06T04:11:08.375 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-06T04:11:08.375 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-06T04:11:08.375 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-06T04:11:08.375 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-06T04:11:08.375 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-06T04:11:08.375 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-06T04:11:08.375 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-06T04:11:08.375 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-06T04:11:08.375 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-06T04:11:08.375 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-06T04:11:08.375 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-06T04:11:08.376 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-06T04:11:08.376 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-06T04:11:08.376 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-06T04:11:08.376 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-06T04:11:08.376 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-06T04:11:08.376 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-06T04:11:08.376 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-06T04:11:08.376 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-06T04:11:08.376 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-06T04:11:08.376 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-06T04:11:08.376 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-06T04:11:08.376 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-06T04:11:08.377 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-06T04:11:08.377 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-06T04:11:08.377 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-06T04:11:08.377 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-06T04:11:08.377 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-06T04:11:08.377 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-06T04:11:08.377 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-06T04:11:08.377 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-06T04:11:08.377 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-06T04:11:08.377 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-06T04:11:08.377 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-06T04:11:08.377 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-06T04:11:08.378 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-06T04:11:08.378 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-06T04:11:08.378 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-06T04:11:08.378 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-06T04:11:08.378 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-06T04:11:08.378 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-06T04:11:08.378 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-06T04:11:08.378 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-06T04:11:08.378 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-06T04:11:08.378 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-06T04:11:08.378 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-06T04:11:08.379 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-06T04:11:08.379 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-06T04:11:08.379 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-06T04:11:08.379 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-06T04:11:08.379 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-06T04:11:08.379 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-06T04:11:08.379 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-06T04:11:08.379 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-06T04:11:08.379 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-06T04:11:08.379 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-06T04:11:08.379 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-06T04:11:08.379 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-06T04:11:08.379 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-06T04:11:08.380 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-06T04:11:08.380 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-06T04:11:08.380 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-06T04:11:08.380 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-06T04:11:08.380 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-06T04:11:08.380 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-06T04:11:08.380 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-06T04:11:08.380 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-06T04:11:08.380 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-06T04:11:08.380 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-06T04:11:08.380 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-06T04:11:08.380 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-06T04:11:08.381 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-06T04:11:08.381 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-06T04:11:08.381 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-06T04:11:08.381 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-06T04:11:08.381 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-06T04:11:08.381 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-06T04:11:08.381 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-06T04:11:08.381 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-06T04:11:08.381 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-06T04:11:08.381 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-06T04:11:08.381 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-06T04:11:08.382 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-06T04:11:08.382 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-06T04:11:08.382 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-06T04:11:08.382 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-06T04:11:08.382 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-06T04:11:08.382 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-06T04:11:08.382 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-06T04:11:08.382 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-06T04:11:08.382 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-06T04:11:08.382 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-06T04:11:08.382 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-06T04:11:08.383 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-06T04:11:08.383 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-06T04:11:08.383 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-06T04:11:08.383 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-06T04:11:08.383 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-06T04:11:08.383 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-06T04:11:08.383 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-06T04:11:08.383 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-06T04:11:08.383 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-06T04:11:08.383 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-06T04:11:08.383 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-06T04:11:08.383 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-06T04:11:08.384 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-06T04:11:08.384 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-06T04:11:08.384 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-06T04:11:08.384 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-06T04:11:08.384 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-06T04:11:08.384 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-06T04:11:08.384 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-06T04:11:08.384 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-06T04:11:08.384 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-06T04:11:08.384 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-06T04:11:08.385 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-06T04:11:08.385 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-06T04:11:08.385 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-06T04:11:08.385 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-06T04:11:08.385 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-06T04:11:08.385 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-06T04:11:08.385 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-06T04:11:08.385 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-06T04:11:08.385 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-06T04:11:08.385 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-06T04:11:08.386 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-06T04:11:08.386 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-06T04:11:08.386 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-06T04:11:08.386 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-06T04:11:08.386 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-06T04:11:08.386 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-06T04:11:08.386 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-06T04:11:08.386 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-06T04:11:08.386 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-06T04:11:08.386 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-06T04:11:08.386 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-06T04:11:08.387 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-06T04:11:08.387 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-06T04:11:08.387 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-06T04:11:08.387 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-06T04:11:08.387 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-06T04:11:08.387 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-06T04:11:08.387 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-06T04:11:08.387 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-06T04:11:08.387 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-06T04:11:08.387 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-06T04:11:08.387 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-06T04:11:08.387 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-06T04:11:08.388 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-06T04:11:08.388 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-06T04:11:08.388 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-06T04:11:08.388 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-06T04:11:08.388 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-06T04:11:08.388 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-06T04:11:08.388 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-06T04:11:08.389 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-06T04:11:08.389 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-06T04:11:08.389 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-06T04:11:08.389 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-06T04:11:08.389 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-06T04:11:08.389 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-06T04:11:08.389 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-06T04:11:08.390 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-06T04:11:08.390 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-06T04:11:08.390 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-06T04:11:08.390 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-06T04:11:08.390 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-06T04:11:08.390 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-06T04:11:08.391 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-06T04:11:08.391 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-06T04:11:08.391 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-06T04:11:08.391 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-06T04:11:08.391 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-06T04:11:08.391 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-06T04:11:08.392 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-06T04:11:08.392 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-06T04:11:08.392 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-06T04:11:08.392 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-06T04:11:08.392 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-06T04:11:08.392 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-06T04:11:08.393 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-06T04:11:08.393 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-06T04:11:08.393 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-06T04:11:08.393 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-06T04:11:08.393 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-06T04:11:08.393 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-06T04:11:08.393 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-06T04:11:08.394 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-06T04:11:08.394 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-06T04:11:08.394 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-06T04:11:08.394 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-06T04:11:08.394 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-06T04:11:08.394 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-06T04:11:08.394 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-06T04:11:08.395 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-06T04:11:08.395 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-06T04:11:08.395 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-06T04:11:08.395 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-06T04:11:08.395 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-06T04:11:08.395 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-06T04:11:08.396 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-06T04:11:08.396 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-06T04:11:08.396 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-06T04:11:08.396 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-06T04:11:08.396 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-06T04:11:08.396 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-06T04:11:08.397 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-06T04:11:08.397 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-06T04:11:08.397 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-06T04:11:08.397 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-06T04:11:08.397 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-06T04:11:08.397 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-06T04:11:08.398 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-06T04:11:08.398 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-06T04:11:08.398 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-06T04:11:08.398 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-06T04:11:08.398 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-06T04:11:08.398 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-06T04:11:08.398 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-06T04:11:08.398 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-06T04:11:08.398 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-06T04:11:08.399 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-06T04:11:08.399 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-06T04:11:08.399 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-06T04:11:08.399 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-06T04:11:08.399 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-06T04:11:08.399 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-06T04:11:08.399 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-06T04:11:08.399 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-06T04:11:08.399 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-06T04:11:08.399 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-06T04:11:08.399 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-06T04:11:08.399 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-06T04:11:08.400 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-06T04:11:08.400 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-06T04:11:08.400 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-06T04:11:08.400 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-06T04:11:08.400 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-06T04:11:08.400 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-06T04:11:08.400 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-06T04:11:08.400 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-06T04:11:08.400 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-06T04:11:08.400 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-06T04:11:08.400 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-06T04:11:08.400 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-06T04:11:08.401 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-06T04:11:08.401 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-06T04:11:08.401 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-06T04:11:08.401 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-06T04:11:08.401 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-06T04:11:08.401 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-06T04:11:08.401 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-06T04:11:08.401 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-06T04:11:08.401 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-06T04:11:08.401 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-06T04:11:08.401 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-06T04:11:08.401 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-06T04:11:08.402 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-06T04:11:08.402 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-06T04:11:08.402 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-06T04:11:08.402 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-06T04:11:08.402 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-06T04:11:08.402 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-06T04:11:08.402 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-06T04:11:08.402 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-06T04:11:08.402 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-06T04:11:08.402 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-06T04:11:08.402 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-06T04:11:08.403 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-06T04:11:08.403 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-06T04:11:08.403 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-06T04:11:08.403 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-06T04:11:08.403 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-06T04:11:08.403 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-06T04:11:08.403 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-06T04:11:08.403 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-06T04:11:08.403 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-06T04:11:08.403 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-06T04:11:08.403 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-06T04:11:08.403 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-06T04:11:08.403 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-06T04:11:08.404 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-06T04:11:08.404 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-06T04:11:08.404 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-06T04:11:08.404 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-06T04:11:08.404 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-06T04:11:08.404 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-06T04:11:08.404 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-06T04:11:08.404 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-06T04:11:08.404 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-06T04:11:08.404 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-06T04:11:08.404 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-06T04:11:08.404 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-06T04:11:08.405 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-06T04:11:08.405 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-06T04:11:08.405 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-06T04:11:08.405 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-06T04:11:08.405 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-06T04:11:08.405 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-06T04:11:08.405 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-06T04:11:08.405 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-06T04:11:08.405 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-06T04:11:08.405 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-06T04:11:08.405 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-06T04:11:08.406 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-06T04:11:08.406 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-06T04:11:08.406 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-06T04:11:08.406 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-06T04:11:08.406 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-06T04:11:08.406 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-06T04:11:08.406 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-06T04:11:08.406 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-06T04:11:08.406 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-06T04:11:08.407 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-06T04:11:08.407 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-06T04:11:08.407 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-06T04:11:08.407 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-06T04:11:08.407 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-06T04:11:08.407 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-06T04:11:08.407 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-06T04:11:08.407 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-06T04:11:08.407 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-06T04:11:08.407 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-06T04:11:08.407 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-06T04:11:08.407 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-06T04:11:08.408 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-06T04:11:08.408 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-06T04:11:08.408 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-06T04:11:08.408 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-06T04:11:08.408 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-06T04:11:08.408 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-06T04:11:08.408 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-06T04:11:08.408 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-06T04:11:08.408 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-06T04:11:08.408 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-06T04:11:08.408 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-06T04:11:08.408 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-06T04:11:08.409 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-06T04:11:08.409 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-06T04:11:08.409 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-06T04:11:08.409 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-06T04:11:08.409 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-06T04:11:08.409 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-06T04:11:08.409 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-06T04:11:08.409 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-06T04:11:08.410 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-06T04:11:08.410 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-06T04:11:08.410 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-06T04:11:08.410 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-06T04:11:08.410 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-06T04:11:08.410 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-06T04:11:08.410 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-06T04:11:08.410 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-06T04:11:08.411 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-06T04:11:08.411 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-06T04:11:08.411 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-06T04:11:08.411 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-06T04:11:08.411 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-06T04:11:08.411 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-06T04:11:08.411 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-06T04:11:08.412 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-06T04:11:08.412 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-06T04:11:08.412 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-06T04:11:08.412 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-06T04:11:08.412 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-06T04:11:08.412 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-06T04:11:08.413 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-06T04:11:08.413 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-06T04:11:08.413 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-06T04:11:08.413 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-06T04:11:08.413 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-06T04:11:08.414 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-06T04:11:08.414 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-06T04:11:08.414 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-06T04:11:08.414 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-06T04:11:08.414 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-06T04:11:08.414 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-06T04:11:08.415 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-06T04:11:08.415 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-06T04:11:08.415 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-06T04:11:08.415 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-06T04:11:08.415 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-06T04:11:08.415 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-06T04:11:08.415 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-06T04:11:08.416 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-06T04:11:08.416 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-06T04:11:08.416 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-06T04:11:08.416 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-06T04:11:08.416 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-06T04:11:08.416 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-06T04:11:08.416 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-06T04:11:08.417 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-06T04:11:08.417 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-06T04:11:08.417 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-06T04:11:08.417 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-06T04:11:08.417 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-06T04:11:08.417 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-06T04:11:08.418 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-06T04:11:08.418 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-06T04:11:08.418 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-06T04:11:08.418 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-06T04:11:08.418 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-06T04:11:08.418 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-06T04:11:08.419 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-06T04:11:08.419 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-06T04:11:08.419 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-06T04:11:08.419 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-06T04:11:08.419 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-06T04:11:08.420 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-06T04:11:08.420 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-06T04:11:08.420 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-06T04:11:08.420 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-06T04:11:08.420 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-06T04:11:08.420 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-06T04:11:08.420 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-06T04:11:08.420 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-06T04:11:08.421 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-06T04:11:08.421 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-06T04:11:08.421 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-06T04:11:08.421 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-06T04:11:08.421 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-06T04:11:08.421 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-06T04:11:08.421 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-06T04:11:08.421 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-06T04:11:08.421 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-06T04:11:08.421 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-06T04:11:08.421 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-06T04:11:08.422 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-06T04:11:08.422 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-06T04:11:08.422 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-06T04:11:08.422 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-06T04:11:08.422 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-06T04:11:08.422 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-06T04:11:08.422 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-06T04:11:08.422 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-06T04:11:08.422 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-06T04:11:08.422 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-06T04:11:08.422 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-06T04:11:08.422 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-06T04:11:08.423 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-06T04:11:08.423 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-06T04:11:08.423 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-06T04:11:08.423 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-06T04:11:08.423 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-06T04:11:08.423 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-06T04:11:08.423 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-06T04:11:08.423 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-06T04:11:08.424 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-06T04:11:08.424 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-06T04:11:08.424 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-06T04:11:08.424 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-06T04:11:08.424 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-06T04:11:08.424 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-06T04:11:08.424 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-06T04:11:08.424 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-06T04:11:08.425 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-06T04:11:08.425 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-06T04:11:08.425 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-06T04:11:08.425 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-06T04:11:08.425 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-06T04:11:08.425 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-06T04:11:08.425 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-06T04:11:08.426 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-06T04:11:08.426 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-06T04:11:08.426 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-06T04:11:08.426 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-06T04:11:08.426 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-06T04:11:08.426 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-06T04:11:08.426 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-06T04:11:08.427 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-06T04:11:08.427 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-06T04:11:08.427 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-06T04:11:08.427 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-06T04:11:08.427 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-06T04:11:08.427 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-06T04:11:08.428 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-06T04:11:08.428 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-06T04:11:08.428 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-06T04:11:08.428 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-06T04:11:08.428 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-06T04:11:08.428 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-06T04:11:08.429 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-06T04:11:08.429 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-06T04:11:08.429 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-06T04:11:08.429 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-06T04:11:08.429 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-06T04:11:08.429 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-06T04:11:08.429 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-06T04:11:08.430 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-06T04:11:08.430 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-06T04:11:08.430 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-06T04:11:08.430 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-06T04:11:08.430 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-06T04:11:08.430 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-06T04:11:08.430 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-06T04:11:08.431 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-06T04:11:08.431 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-06T04:11:08.431 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-06T04:11:08.431 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-06T04:11:08.431 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-06T04:11:08.431 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-06T04:11:08.432 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-06T04:11:08.432 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-06T04:11:08.432 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-06T04:11:08.432 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-06T04:11:08.432 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-06T04:11:08.432 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-06T04:11:08.433 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-06T04:11:08.433 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-06T04:11:08.433 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-06T04:11:08.433 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-06T04:11:08.433 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-06T04:11:08.433 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-06T04:11:08.433 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-06T04:11:08.434 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-06T04:11:08.434 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-06T04:11:08.434 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-06T04:11:08.434 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-06T04:11:08.434 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-06T04:11:08.434 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-06T04:11:08.434 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-06T04:11:08.434 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-06T04:11:08.434 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-06T04:11:08.435 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-06T04:11:08.435 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-06T04:11:08.435 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-06T04:11:08.435 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-06T04:11:08.435 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-06T04:11:08.435 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-06T04:11:08.435 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-06T04:11:08.435 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-06T04:11:08.435 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-06T04:11:08.435 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-06T04:11:08.435 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-06T04:11:08.435 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-06T04:11:08.435 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-06T04:11:08.436 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-06T04:11:08.436 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-06T04:11:08.436 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-06T04:11:08.436 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-06T04:11:08.436 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-06T04:11:08.436 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-06T04:11:08.436 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-06T04:11:08.436 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-06T04:11:08.436 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-06T04:11:08.436 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-06T04:11:08.436 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-06T04:11:08.437 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-06T04:11:08.437 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-06T04:11:08.437 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-06T04:11:08.437 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-06T04:11:08.437 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-06T04:11:08.437 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-06T04:11:08.437 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-06T04:11:08.437 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-06T04:11:08.437 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-06T04:11:08.437 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-06T04:11:08.437 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-06T04:11:08.437 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-06T04:11:08.437 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-06T04:11:08.438 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-06T04:11:08.438 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-06T04:11:08.438 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-06T04:11:08.438 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-06T04:11:08.438 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-06T04:11:08.438 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-06T04:11:08.438 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-06T04:11:08.438 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-06T04:11:08.438 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-06T04:11:08.438 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-06T04:11:08.438 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-06T04:11:08.439 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-06T04:11:08.439 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-06T04:11:08.439 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-06T04:11:08.439 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-06T04:11:08.439 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-06T04:11:08.439 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-06T04:11:08.439 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-06T04:11:08.439 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-06T04:11:08.439 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-06T04:11:08.439 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-06T04:11:08.439 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-06T04:11:08.440 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-06T04:11:08.440 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-06T04:11:08.440 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-06T04:11:08.440 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-06T04:11:08.440 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-06T04:11:08.440 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-06T04:11:08.440 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-06T04:11:08.441 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-06T04:11:08.441 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-06T04:11:08.441 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-06T04:11:08.441 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-06T04:11:08.441 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-06T04:11:08.442 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-06T04:11:08.442 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-06T04:11:08.442 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-06T04:11:08.442 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-06T04:11:08.442 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-06T04:11:08.442 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-06T04:11:08.442 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-06T04:11:08.442 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-06T04:11:08.443 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-06T04:11:08.443 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-06T04:11:08.443 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-06T04:11:08.443 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-06T04:11:08.443 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-06T04:11:08.443 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-06T04:11:08.443 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-06T04:11:08.443 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-06T04:11:08.445 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-06T04:11:08.445 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-06T04:11:08.446 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-06T04:11:08.446 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-06T04:11:08.446 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-06T04:11:08.446 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-06T04:11:08.446 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-06T04:11:08.446 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-06T04:11:08.446 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-06T04:11:08.446 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-06T04:11:08.446 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-06T04:11:08.447 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-06T04:11:08.447 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-06T04:11:08.447 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-06T04:11:08.447 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-06T04:11:08.447 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-06T04:11:08.447 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-06T04:11:08.447 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-06T04:11:08.447 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-06T04:11:08.447 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-06T04:11:08.447 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-06T04:11:08.448 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-06T04:11:08.448 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-06T04:11:08.448 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-06T04:11:08.448 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-06T04:11:08.448 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-06T04:11:08.448 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-06T04:11:08.448 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-06T04:11:08.448 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-06T04:11:08.448 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-06T04:11:08.448 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-06T04:11:08.448 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-06T04:11:08.449 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-06T04:11:08.449 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-06T04:11:08.449 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-06T04:11:08.449 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-06T04:11:08.449 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-06T04:11:08.449 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-06T04:11:08.449 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-06T04:11:08.449 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-06T04:11:08.449 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-06T04:11:08.449 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-06T04:11:08.449 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-06T04:11:08.450 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-06T04:11:08.450 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-06T04:11:08.450 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-06T04:11:08.450 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-06T04:11:08.450 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-06T04:11:08.450 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-06T04:11:08.450 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-06T04:11:08.450 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-06T04:11:08.450 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-06T04:11:08.450 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-06T04:11:08.451 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-06T04:11:08.451 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-06T04:11:08.451 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-06T04:11:08.451 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-06T04:11:08.451 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-06T04:11:08.451 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-06T04:11:08.451 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-06T04:11:08.451 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-06T04:11:08.451 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-06T04:11:08.451 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-06T04:11:08.452 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-06T04:11:08.452 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-06T04:11:08.452 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-06T04:11:08.452 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-06T04:11:08.452 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-06T04:11:08.452 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-06T04:11:08.452 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-06T04:11:08.452 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-06T04:11:08.452 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-06T04:11:08.452 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-06T04:11:08.452 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-06T04:11:08.453 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-06T04:11:08.453 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-06T04:11:08.453 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-06T04:11:08.453 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-06T04:11:08.453 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-06T04:11:08.453 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-06T04:11:08.453 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-06T04:11:08.453 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-06T04:11:08.453 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-06T04:11:08.453 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-06T04:11:08.453 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-06T04:11:08.454 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-06T04:11:08.454 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-06T04:11:08.454 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-06T04:11:08.454 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-06T04:11:08.454 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-06T04:11:08.454 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-06T04:11:08.454 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-06T04:11:08.454 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-06T04:11:08.454 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-06T04:11:08.454 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-06T04:11:08.454 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-06T04:11:08.454 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-06T04:11:08.455 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-06T04:11:08.455 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-06T04:11:08.455 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-06T04:11:08.455 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-06T04:11:08.455 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-06T04:11:08.455 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-06T04:11:08.455 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-06T04:11:08.455 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-06T04:11:08.455 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-06T04:11:08.456 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-06T04:11:08.456 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-06T04:11:08.456 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-06T04:11:08.456 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-06T04:11:08.456 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-06T04:11:08.456 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-06T04:11:08.456 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-06T04:11:08.456 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-06T04:11:08.456 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-06T04:11:08.456 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-06T04:11:08.456 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-06T04:11:08.456 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-06T04:11:08.457 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-06T04:11:08.457 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-06T04:11:08.457 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-06T04:11:08.457 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-06T04:11:08.457 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-06T04:11:08.457 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-06T04:11:08.457 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-06T04:11:08.457 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-06T04:11:08.457 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-06T04:11:08.457 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-06T04:11:08.457 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-06T04:11:08.458 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-06T04:11:08.458 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-06T04:11:08.458 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-06T04:11:08.458 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-06T04:11:08.458 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-06T04:11:08.458 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-06T04:11:08.458 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-06T04:11:08.458 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-06T04:11:08.458 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-06T04:11:08.459 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-06T04:11:08.459 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-06T04:11:08.459 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-06T04:11:08.459 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-06T04:11:08.459 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-06T04:11:08.459 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-06T04:11:08.459 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-06T04:11:08.459 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-06T04:11:08.459 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-06T04:11:08.459 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-06T04:11:08.459 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-06T04:11:08.459 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-06T04:11:08.460 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-06T04:11:08.460 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-06T04:11:08.460 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-06T04:11:08.460 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-06T04:11:08.460 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-06T04:11:08.460 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-06T04:11:08.460 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-06T04:11:08.460 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-06T04:11:08.460 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-06T04:11:08.460 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-06T04:11:08.460 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-06T04:11:08.461 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-06T04:11:08.461 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-06T04:11:08.461 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-06T04:11:08.461 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-06T04:11:08.461 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-06T04:11:08.461 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-06T04:11:08.461 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-06T04:11:08.461 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-06T04:11:08.461 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-06T04:11:08.461 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-06T04:11:08.461 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-06T04:11:08.462 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-06T04:11:08.462 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-06T04:11:08.462 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-06T04:11:08.462 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-06T04:11:08.462 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-06T04:11:08.462 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-06T04:11:08.462 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-06T04:11:08.462 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-06T04:11:08.462 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-06T04:11:08.462 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-06T04:11:08.462 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-06T04:11:08.462 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-06T04:11:08.463 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-06T04:11:08.463 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-06T04:11:08.463 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-06T04:11:08.463 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-06T04:11:08.463 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-06T04:11:08.463 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-06T04:11:08.463 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-06T04:11:08.463 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-06T04:11:08.463 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-06T04:11:08.463 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-06T04:11:08.464 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-06T04:11:08.464 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-06T04:11:08.464 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-06T04:11:08.464 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-06T04:11:08.464 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-06T04:11:08.464 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-06T04:11:08.464 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-06T04:11:08.464 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-06T04:11:08.464 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-06T04:11:08.464 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-06T04:11:08.464 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-06T04:11:08.465 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-06T04:11:08.465 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-06T04:11:08.465 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-06T04:11:08.465 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-06T04:11:08.465 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-06T04:11:08.465 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-06T04:11:08.465 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-06T04:11:08.465 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-06T04:11:08.465 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-06T04:11:08.465 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-06T04:11:08.465 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-06T04:11:08.465 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-06T04:11:08.466 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-06T04:11:08.466 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-06T04:11:08.466 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-06T04:11:08.466 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-06T04:11:08.466 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-06T04:11:08.466 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-06T04:11:08.466 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-06T04:11:08.466 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-06T04:11:08.466 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-06T04:11:08.466 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-06T04:11:08.466 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-06T04:11:08.467 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-06T04:11:08.467 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-06T04:11:08.467 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-06T04:11:08.467 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-06T04:11:08.467 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-06T04:11:08.467 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-06T04:11:08.467 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-06T04:11:08.467 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-06T04:11:08.467 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-06T04:11:08.467 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-06T04:11:08.467 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-06T04:11:08.468 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-06T04:11:08.468 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-06T04:11:08.468 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-06T04:11:08.468 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-06T04:11:08.468 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-06T04:11:08.468 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-06T04:11:08.468 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-06T04:11:08.468 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-06T04:11:08.468 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-06T04:11:08.469 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-06T04:11:08.469 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-06T04:11:08.469 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-06T04:11:08.469 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-06T04:11:08.469 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-06T04:11:08.469 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-06T04:11:08.469 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-06T04:11:08.469 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-06T04:11:08.469 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-06T04:11:08.470 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-06T04:11:08.470 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-06T04:11:08.470 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-06T04:11:08.470 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-06T04:11:08.470 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-06T04:11:08.470 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-06T04:11:08.470 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-06T04:11:08.470 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-06T04:11:08.471 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-06T04:11:08.471 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-06T04:11:08.471 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-06T04:11:08.471 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-06T04:11:08.471 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-06T04:11:08.471 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-06T04:11:08.471 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-06T04:11:08.471 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-06T04:11:08.471 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-06T04:11:08.471 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-06T04:11:08.471 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-06T04:11:08.471 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-06T04:11:08.472 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-06T04:11:08.472 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-06T04:11:08.472 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-06T04:11:08.472 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-06T04:11:08.472 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-06T04:11:08.472 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-06T04:11:08.472 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-06T04:11:08.472 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-06T04:11:08.472 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-06T04:11:08.472 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-06T04:11:08.472 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-06T04:11:08.472 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-06T04:11:08.473 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-06T04:11:08.473 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-06T04:11:08.473 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-06T04:11:08.473 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-06T04:11:08.473 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-06T04:11:08.473 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-06T04:11:08.473 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-06T04:11:08.473 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-06T04:11:08.473 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-06T04:11:08.473 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-06T04:11:08.473 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-06T04:11:08.474 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-06T04:11:08.474 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-06T04:11:08.474 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-06T04:11:08.474 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-06T04:11:08.474 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-06T04:11:08.474 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-06T04:11:08.474 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-06T04:11:08.474 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-06T04:11:08.474 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-06T04:11:08.474 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-06T04:11:08.474 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-06T04:11:08.474 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-06T04:11:08.475 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-06T04:11:08.475 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-06T04:11:08.475 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-06T04:11:08.475 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-06T04:11:08.475 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-06T04:11:08.475 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-06T04:11:08.475 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-06T04:11:08.475 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-06T04:11:08.475 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-06T04:11:08.475 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-06T04:11:08.476 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-06T04:11:08.476 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-06T04:11:08.476 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-06T04:11:08.476 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-06T04:11:08.476 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-06T04:11:08.476 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-06T04:11:08.476 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-06T04:11:08.476 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-06T04:11:08.476 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-06T04:11:08.476 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-06T04:11:08.476 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-06T04:11:08.477 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-06T04:11:08.477 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-06T04:11:08.477 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-06T04:11:08.477 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-06T04:11:08.477 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-06T04:11:08.477 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-06T04:11:08.477 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-06T04:11:08.477 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-06T04:11:08.477 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-06T04:11:08.477 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-06T04:11:08.477 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-06T04:11:08.477 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-06T04:11:08.478 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-06T04:11:08.478 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-06T04:11:08.478 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-06T04:11:08.478 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-06T04:11:08.478 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-06T04:11:08.478 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-06T04:11:08.478 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-06T04:11:08.478 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-06T04:11:08.478 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-06T04:11:08.478 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-06T04:11:08.478 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-06T04:11:08.478 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-06T04:11:08.479 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-06T04:11:08.479 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-06T04:11:08.479 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-06T04:11:08.479 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-06T04:11:08.479 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-06T04:11:08.479 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-06T04:11:08.479 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-06T04:11:08.479 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-06T04:11:08.479 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-06T04:11:08.479 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-06T04:11:08.479 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-06T04:11:08.480 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-06T04:11:08.480 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-06T04:11:08.480 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-06T04:11:08.480 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-06T04:11:08.480 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-06T04:11:08.480 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-06T04:11:08.480 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-06T04:11:08.480 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-06T04:11:08.480 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-06T04:11:08.481 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-06T04:11:08.481 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-06T04:11:08.481 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-06T04:11:08.481 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-06T04:11:08.481 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-06T04:11:08.481 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-06T04:11:08.481 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-06T04:11:08.481 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-06T04:11:08.481 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-06T04:11:08.481 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-06T04:11:08.481 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-06T04:11:08.482 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-06T04:11:08.482 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-06T04:11:08.482 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-06T04:11:08.482 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-06T04:11:08.482 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-06T04:11:08.482 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-06T04:11:08.482 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-06T04:11:08.482 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-06T04:11:08.482 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-06T04:11:08.482 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-06T04:11:08.482 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-06T04:11:08.483 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-06T04:11:08.483 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-06T04:11:08.483 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-06T04:11:08.483 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-06T04:11:08.483 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-06T04:11:08.483 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-06T04:11:08.483 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-06T04:11:08.483 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-06T04:11:08.483 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-06T04:11:08.483 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-06T04:11:08.483 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-06T04:11:08.483 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-06T04:11:08.484 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-06T04:11:08.484 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-06T04:11:08.484 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-06T04:11:08.484 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-06T04:11:08.484 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-06T04:11:08.484 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-06T04:11:08.484 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-06T04:11:08.484 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-06T04:11:08.484 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-06T04:11:08.484 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-06T04:11:08.484 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-06T04:11:08.485 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-06T04:11:08.485 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-06T04:11:08.485 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-06T04:11:08.485 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-06T04:11:08.485 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-06T04:11:08.485 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-06T04:11:08.485 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-06T04:11:08.485 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-06T04:11:08.485 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-06T04:11:08.485 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-06T04:11:08.485 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-06T04:11:08.486 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-06T04:11:08.486 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-06T04:11:08.486 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-06T04:11:08.486 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-06T04:11:08.486 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-06T04:11:08.486 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-06T04:11:08.486 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-06T04:11:08.486 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-06T04:11:08.486 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-06T04:11:08.486 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-06T04:11:08.486 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-06T04:11:08.486 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-06T04:11:08.487 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-06T04:11:08.487 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-06T04:11:08.487 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-06T04:11:08.487 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-06T04:11:08.487 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-06T04:11:08.487 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-06T04:11:08.487 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-06T04:11:08.487 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-06T04:11:08.487 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-06T04:11:08.487 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-06T04:11:08.487 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-06T04:11:08.488 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-06T04:11:08.488 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-06T04:11:08.488 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-06T04:11:08.488 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-06T04:11:08.488 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-06T04:11:08.488 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-06T04:11:08.488 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-06T04:11:08.488 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-06T04:11:08.488 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-06T04:11:08.488 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-06T04:11:08.488 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-06T04:11:08.488 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-06T04:11:08.489 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-06T04:11:08.489 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-06T04:11:08.489 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-06T04:11:08.489 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-06T04:11:08.489 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-06T04:11:08.489 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-06T04:11:08.489 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-06T04:11:08.489 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-06T04:11:08.489 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-06T04:11:08.489 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-06T04:11:08.489 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-06T04:11:08.490 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-06T04:11:08.490 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-06T04:11:08.490 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-06T04:11:08.490 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-06T04:11:08.490 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-06T04:11:08.490 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-06T04:11:08.490 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-06T04:11:08.490 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-06T04:11:08.490 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-06T04:11:08.490 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-06T04:11:08.490 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-06T04:11:08.491 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-06T04:11:08.491 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-06T04:11:08.491 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-06T04:11:08.491 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-06T04:11:08.491 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-06T04:11:08.491 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-06T04:11:08.491 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-06T04:11:08.491 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-06T04:11:08.491 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-06T04:11:08.491 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-06T04:11:08.491 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-06T04:11:08.491 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-06T04:11:08.492 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-06T04:11:08.492 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-06T04:11:08.492 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-06T04:11:08.492 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-06T04:11:08.492 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-06T04:11:08.492 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-06T04:11:08.492 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-06T04:11:08.492 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-06T04:11:08.492 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-06T04:11:08.492 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-06T04:11:08.492 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-06T04:11:08.492 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-06T04:11:08.493 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-06T04:11:08.493 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-06T04:11:08.493 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-06T04:11:08.493 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-06T04:11:08.493 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-06T04:11:08.493 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-06T04:11:08.493 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-06T04:11:08.493 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-06T04:11:08.493 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-06T04:11:08.493 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-06T04:11:08.494 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-06T04:11:08.494 DEBUG:teuthology.orchestra.run.smithi135:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-06T04:11:08.518 INFO:teuthology.orchestra.run.smithi135.stdout:postinstall scriptlet (using /bin/sh): 2023-10-06T04:11:08.518 INFO:teuthology.orchestra.run.smithi135.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-06T04:11:08.518 INFO:teuthology.orchestra.run.smithi135.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T04:11:08.518 INFO:teuthology.orchestra.run.smithi135.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T04:11:08.518 INFO:teuthology.orchestra.run.smithi135.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T04:11:08.519 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T04:11:08.519 INFO:teuthology.orchestra.run.smithi135.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-06T04:11:08.519 INFO:teuthology.orchestra.run.smithi135.stdout:fi 2023-10-06T04:11:08.519 INFO:teuthology.orchestra.run.smithi135.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-06T04:11:08.519 INFO:teuthology.orchestra.run.smithi135.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-06T04:11:08.519 INFO:teuthology.orchestra.run.smithi135.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-06T04:11:08.519 INFO:teuthology.orchestra.run.smithi135.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-06T04:11:08.519 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T04:11:08.519 INFO:teuthology.orchestra.run.smithi135.stdout:fi 2023-10-06T04:11:08.519 INFO:teuthology.orchestra.run.smithi135.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-06T04:11:08.520 INFO:teuthology.orchestra.run.smithi135.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-06T04:11:08.520 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-06T04:11:08.520 INFO:teuthology.orchestra.run.smithi135.stdout:fi 2023-10-06T04:11:08.521 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -qi grub2-tools 2023-10-06T04:11:08.597 INFO:teuthology.orchestra.run.smithi135.stdout:Name : grub2-tools 2023-10-06T04:11:08.597 INFO:teuthology.orchestra.run.smithi135.stdout:Epoch : 1 2023-10-06T04:11:08.597 INFO:teuthology.orchestra.run.smithi135.stdout:Version : 2.02 2023-10-06T04:11:08.597 INFO:teuthology.orchestra.run.smithi135.stdout:Release : 99.el8_4.1 2023-10-06T04:11:08.597 INFO:teuthology.orchestra.run.smithi135.stdout:Architecture: x86_64 2023-10-06T04:11:08.597 INFO:teuthology.orchestra.run.smithi135.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T04:11:08.597 INFO:teuthology.orchestra.run.smithi135.stdout:Group : System Environment/Base 2023-10-06T04:11:08.597 INFO:teuthology.orchestra.run.smithi135.stdout:Size : 9264631 2023-10-06T04:11:08.597 INFO:teuthology.orchestra.run.smithi135.stdout:License : GPLv3+ 2023-10-06T04:11:08.598 INFO:teuthology.orchestra.run.smithi135.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T04:11:08.598 INFO:teuthology.orchestra.run.smithi135.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T04:11:08.598 INFO:teuthology.orchestra.run.smithi135.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T04:11:08.598 INFO:teuthology.orchestra.run.smithi135.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T04:11:08.598 INFO:teuthology.orchestra.run.smithi135.stdout:Relocations : (not relocatable) 2023-10-06T04:11:08.598 INFO:teuthology.orchestra.run.smithi135.stdout:Packager : Red Hat, Inc. 2023-10-06T04:11:08.598 INFO:teuthology.orchestra.run.smithi135.stdout:Vendor : Red Hat, Inc. 2023-10-06T04:11:08.599 INFO:teuthology.orchestra.run.smithi135.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T04:11:08.599 INFO:teuthology.orchestra.run.smithi135.stdout:Summary : Support tools for GRUB. 2023-10-06T04:11:08.599 INFO:teuthology.orchestra.run.smithi135.stdout:Description : 2023-10-06T04:11:08.599 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:11:08.599 INFO:teuthology.orchestra.run.smithi135.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T04:11:08.599 INFO:teuthology.orchestra.run.smithi135.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T04:11:08.599 INFO:teuthology.orchestra.run.smithi135.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T04:11:08.599 INFO:teuthology.orchestra.run.smithi135.stdout:hardware devices. 2023-10-06T04:11:08.599 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:11:08.599 INFO:teuthology.orchestra.run.smithi135.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T04:11:08.600 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T04:11:08.600 INFO:teuthology.task.kernel:Updating grub on smithi135 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-06T04:11:08.601 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T04:11:10.682 INFO:teuthology.orchestra.run.smithi060.stderr:Generating grub configuration file ... 2023-10-06T04:11:11.883 INFO:teuthology.orchestra.run.smithi135.stderr:Generating grub configuration file ... 2023-10-06T04:11:12.835 INFO:teuthology.orchestra.run.smithi060.stderr:done 2023-10-06T04:11:12.837 DEBUG:teuthology.orchestra.run.smithi060:> mktemp 2023-10-06T04:11:12.851 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.H3xhXIz2BW 2023-10-06T04:11:12.851 DEBUG:teuthology.orchestra.run.smithi060:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.H3xhXIz2BW 2023-10-06T04:11:12.920 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.H3xhXIz2BW 2023-10-06T04:11:13.076 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.H3xhXIz2BW is 6KB 2023-10-06T04:11:13.125 DEBUG:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.H3xhXIz2BW 2023-10-06T04:11:13.139 DEBUG:teuthology.orchestra.run.smithi060:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T04:11:13.207 INFO:teuthology.orchestra.run.smithi060.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T04:11:13.207 INFO:teuthology.orchestra.run.smithi060.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T04:11:13.208 INFO:teuthology.orchestra.run.smithi060.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T04:11:13.208 INFO:teuthology.orchestra.run.smithi060.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T04:11:13.208 INFO:teuthology.orchestra.run.smithi060.stdout:298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b.conf 2023-10-06T04:11:13.209 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b 2023-10-06T04:11:13.355 DEBUG:teuthology.orchestra.run.smithi060:> sudo shutdown -r now 2023-10-06T04:11:14.123 INFO:teuthology.orchestra.run.smithi135.stderr:done 2023-10-06T04:11:14.125 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2023-10-06T04:11:14.151 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.d3U6sQvzJq 2023-10-06T04:11:14.152 DEBUG:teuthology.orchestra.run.smithi135:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.d3U6sQvzJq 2023-10-06T04:11:14.234 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.d3U6sQvzJq 2023-10-06T04:11:14.387 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.d3U6sQvzJq is 6KB 2023-10-06T04:11:14.434 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.d3U6sQvzJq 2023-10-06T04:11:14.448 DEBUG:teuthology.orchestra.run.smithi135:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T04:11:14.517 INFO:teuthology.orchestra.run.smithi135.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T04:11:14.518 INFO:teuthology.orchestra.run.smithi135.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T04:11:14.518 INFO:teuthology.orchestra.run.smithi135.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T04:11:14.518 INFO:teuthology.orchestra.run.smithi135.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T04:11:14.518 INFO:teuthology.orchestra.run.smithi135.stdout:298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b.conf 2023-10-06T04:11:14.519 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b 2023-10-06T04:11:14.673 DEBUG:teuthology.orchestra.run.smithi135:> sudo shutdown -r now 2023-10-06T04:11:43.386 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-06T04:11:43.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-06T04:11:43.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:11:44.677 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-06T04:11:44.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-10-06T04:11:44.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:12:01.790 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-10-06T04:12:03.070 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-10-06T04:12:10.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-06T04:12:10.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:12:12.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-10-06T04:12:12.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:13:10.860 DEBUG:teuthology.orchestra.remote:timed out 2023-10-06T04:13:12.076 DEBUG:teuthology.orchestra.remote:timed out 2023-10-06T04:13:22.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-06T04:13:22.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:13:23.297 DEBUG:teuthology.orchestra.run.smithi060:> true 2023-10-06T04:13:23.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-06T04:13:23.679 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-06T04:13:23.679 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2023-10-06T04:13:23.714 INFO:teuthology.orchestra.run.smithi060.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-06T04:13:23.714 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-06T04:13:23.714 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T04:13:23.715 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T04:13:24.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-10-06T04:13:24.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:13:24.452 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-10-06T04:13:24.715 DEBUG:teuthology.parallel:result is None 2023-10-06T04:13:24.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-10-06T04:13:24.858 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-06T04:13:24.858 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2023-10-06T04:13:24.893 INFO:teuthology.orchestra.run.smithi135.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-06T04:13:24.893 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-06T04:13:24.893 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T04:13:24.893 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T04:13:25.895 DEBUG:teuthology.parallel:result is None 2023-10-06T04:13:25.895 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T04:13:25.904 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T04:13:25.905 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T04:13:25.909 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T04:13:25.948 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T04:13:25.956 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T04:13:25.966 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T04:13:25.966 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T04:13:25.989 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T04:13:26.055 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T04:13:26.062 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T04:13:26.063 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T04:13:26.067 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T04:13:26.189 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:13:26.197 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:13:26.222 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:13:26.236 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T04:13:26.240 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T04:13:26.248 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T04:13:26.248 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T04:13:26.253 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T04:13:26.315 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T04:13:26.324 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T04:13:26.324 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T04:13:26.328 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T04:13:26.363 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:13:26.465 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:13:26.558 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:13:26.621 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:13:26.699 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:13:26.699 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T04:13:26.762 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:13:26.826 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T04:13:26.929 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:13:26.994 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T04:13:27.067 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:13:27.068 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T04:13:27.140 DEBUG:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2023-10-06T04:13:27.144 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2023-10-06T04:13:27.249 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:13:27.297 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:13:27.708 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T04:13:27.719 INFO:teuthology.task.internal:Starting timer... 2023-10-06T04:13:27.719 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T04:13:27.732 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T04:13:27.742 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T04:13:27.742 DEBUG:teuthology.orchestra.run.smithi060:> sudo service auditd rotate 2023-10-06T04:13:27.866 INFO:teuthology.orchestra.run.smithi060.stdout:Rotating logs: [ OK ] 2023-10-06T04:13:27.869 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2023-10-06T04:13:27.971 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: [ OK ] 2023-10-06T04:13:27.975 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T04:13:27.975 DEBUG:teuthology.orchestra.run.smithi060:> /usr/sbin/getenforce 2023-10-06T04:13:28.018 INFO:teuthology.orchestra.run.smithi060.stdout:Permissive 2023-10-06T04:13:28.019 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2023-10-06T04:13:28.059 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2023-10-06T04:13:28.059 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi060.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi135.front.sepia.ceph.com': 'permissive'} 2023-10-06T04:13:28.059 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:13:28.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:13:28.128 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:13:28.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:13:28.190 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T04:13:28.190 DEBUG:teuthology.orchestra.run.smithi060:> sudo /usr/sbin/setenforce permissive 2023-10-06T04:13:28.255 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2023-10-06T04:13:28.318 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T04:13:28.328 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-06T04:13:28.333 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-06T04:13:28.473 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T04:13:28.488 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T04:13:28.489 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi060.front.sepia.ceph.com,smithi135.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T04:24:49.467 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi060.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com')] 2023-10-06T04:24:49.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-06T04:24:49.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:24:49.555 DEBUG:teuthology.orchestra.run.smithi060:> true 2023-10-06T04:24:49.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-10-06T04:24:49.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-10-06T04:24:49.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T04:24:49.751 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-10-06T04:24:49.857 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-10-06T04:24:49.858 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T04:24:49.868 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T04:24:49.868 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T04:24:49.869 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:24:49.873 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T04:24:49.873 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:24:49.937 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T04:24:49.963 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T04:24:49.972 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T04:24:49.997 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T04:24:50.034 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: ntpd: command not found 2023-10-06T04:24:50.056 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2023-10-06T04:24:50.061 INFO:teuthology.orchestra.run.smithi060.stdout:506 Cannot talk to daemon 2023-10-06T04:24:50.083 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2023-10-06T04:24:50.095 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T04:24:50.116 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T04:24:50.130 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T04:24:50.149 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T04:24:50.216 INFO:teuthology.orchestra.run.smithi060.stderr:bash: ntpq: command not found 2023-10-06T04:24:50.220 INFO:teuthology.orchestra.run.smithi060.stdout:210 Number of sources = 4 2023-10-06T04:24:50.220 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:24:50.220 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2023-10-06T04:24:50.220 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:24:50.220 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:24:50.220 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:24:50.220 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:24:50.235 INFO:teuthology.orchestra.run.smithi135.stderr:bash: ntpq: command not found 2023-10-06T04:24:50.241 INFO:teuthology.orchestra.run.smithi135.stdout:210 Number of sources = 4 2023-10-06T04:24:50.241 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:24:50.241 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2023-10-06T04:24:50.241 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:24:50.241 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:24:50.241 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:24:50.241 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:24:50.242 INFO:teuthology.run_tasks:Running task install... 2023-10-06T04:24:50.250 DEBUG:teuthology.task.install:project ceph 2023-10-06T04:24:50.251 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}} 2023-10-06T04:24:50.251 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'} 2023-10-06T04:24:50.251 INFO:teuthology.task.install:Using flavor: default 2023-10-06T04:24:50.257 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T04:24:50.257 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T04:24:50.257 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'tag': None, 'wait_for_package': False} 2023-10-06T04:24:50.258 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:24:50.260 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'tag': None, 'wait_for_package': False} 2023-10-06T04:24:50.260 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:24:50.400 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/ 2023-10-06T04:24:50.401 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1274.g68e53a4a 2023-10-06T04:24:50.476 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/ 2023-10-06T04:24:50.476 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1274.g68e53a4a 2023-10-06T04:24:50.573 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T04:24:50.573 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:24:50.574 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T04:24:50.636 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T04:24:50.637 DEBUG:teuthology.orchestra.run.smithi060:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T04:24:50.643 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T04:24:50.643 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:24:50.643 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T04:24:50.705 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T04:24:50.705 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T04:24:50.740 DEBUG:teuthology.orchestra.run.smithi060:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T04:24:50.807 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T04:24:50.830 DEBUG:teuthology.orchestra.run.smithi060:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T04:24:50.892 INFO:teuthology.orchestra.run.smithi060.stdout:check_obsoletes = 1 2023-10-06T04:24:50.894 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T04:24:50.896 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum clean all 2023-10-06T04:24:50.957 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2023-10-06T04:24:50.960 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2023-10-06T04:24:51.389 INFO:teuthology.orchestra.run.smithi060.stdout:Updating Subscription Management repositories. 2023-10-06T04:24:51.416 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-10-06T04:24:51.763 INFO:teuthology.orchestra.run.smithi060.stdout:44 files removed 2023-10-06T04:24:51.765 INFO:teuthology.orchestra.run.smithi135.stdout:44 files removed 2023-10-06T04:24:51.821 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T04:24:51.825 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T04:24:52.281 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-10-06T04:24:52.318 INFO:teuthology.orchestra.run.smithi060.stdout:Updating Subscription Management repositories. 2023-10-06T04:24:53.169 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 247 kB/s | 78 kB 00:00 2023-10-06T04:24:53.270 INFO:teuthology.orchestra.run.smithi060.stdout:ceph packages for x86_64 208 kB/s | 78 kB 00:00 2023-10-06T04:24:53.514 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 30 kB/s | 9.2 kB 00:00 2023-10-06T04:24:53.560 INFO:teuthology.orchestra.run.smithi060.stdout:ceph noarch packages 38 kB/s | 9.2 kB 00:00 2023-10-06T04:24:53.841 INFO:teuthology.orchestra.run.smithi060.stdout:ceph source packages 5.8 kB/s | 1.4 kB 00:00 2023-10-06T04:24:53.854 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 4.7 kB/s | 1.4 kB 00:00 2023-10-06T04:24:53.958 INFO:teuthology.orchestra.run.smithi060.stdout:Copr repo for python3-asyncssh owned by ceph 41 kB/s | 3.5 kB 00:00 2023-10-06T04:24:53.977 INFO:teuthology.orchestra.run.smithi135.stdout:Copr repo for python3-asyncssh owned by ceph 37 kB/s | 3.5 kB 00:00 2023-10-06T04:24:55.061 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-10-06T04:24:55.564 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-10-06T04:24:58.538 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 1.6 MB/s | 24 kB 00:00 2023-10-06T04:24:59.008 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 85 MB/s | 33 MB 00:00 2023-10-06T04:24:59.379 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-10-06T04:24:59.900 INFO:teuthology.orchestra.run.smithi060.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 76 MB/s | 33 MB 00:00 2023-10-06T04:25:04.610 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 77 MB/s | 38 MB 00:00 2023-10-06T04:25:05.972 INFO:teuthology.orchestra.run.smithi060.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 74 MB/s | 38 MB 00:00 2023-10-06T04:25:13.205 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:25:13.206 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:25:13.217 INFO:teuthology.orchestra.run.smithi135.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T04:25:13.218 INFO:teuthology.orchestra.run.smithi135.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T04:25:13.219 INFO:teuthology.orchestra.run.smithi135.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T04:25:13.220 INFO:teuthology.orchestra.run.smithi135.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T04:25:13.222 INFO:teuthology.orchestra.run.smithi135.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T04:25:13.224 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T04:25:13.225 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T04:25:13.722 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-10-06T04:25:13.733 INFO:teuthology.orchestra.run.smithi135.stdout:====================================================================================================================== 2023-10-06T04:25:13.733 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2023-10-06T04:25:13.733 INFO:teuthology.orchestra.run.smithi135.stdout:====================================================================================================================== 2023-10-06T04:25:13.734 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2023-10-06T04:25:13.734 INFO:teuthology.orchestra.run.smithi135.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T04:25:13.734 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 6.4 k 2023-10-06T04:25:13.734 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.2 M 2023-10-06T04:25:13.734 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 877 k 2023-10-06T04:25:13.734 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 162 k 2023-10-06T04:25:13.734 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 1.6 M 2023-10-06T04:25:13.734 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 121 k 2023-10-06T04:25:13.734 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 1.7 M 2023-10-06T04:25:13.734 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 7.4 M 2023-10-06T04:25:13.735 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 47 k 2023-10-06T04:25:13.735 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T04:25:13.735 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 52 M 2023-10-06T04:25:13.735 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 267 k 2023-10-06T04:25:13.735 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 80 k 2023-10-06T04:25:13.735 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 255 k 2023-10-06T04:25:13.735 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 18 k 2023-10-06T04:25:13.735 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T04:25:13.735 INFO:teuthology.orchestra.run.smithi135.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T04:25:13.735 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T04:25:13.735 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 25 k 2023-10-06T04:25:13.735 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 797 k 2023-10-06T04:25:13.736 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 130 k 2023-10-06T04:25:13.736 INFO:teuthology.orchestra.run.smithi135.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T04:25:13.736 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T04:25:13.736 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T04:25:13.736 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 190 k 2023-10-06T04:25:13.736 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 371 k 2023-10-06T04:25:13.736 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 358 k 2023-10-06T04:25:13.736 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 107 k 2023-10-06T04:25:13.736 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 91 k 2023-10-06T04:25:13.736 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T04:25:13.736 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 173 k 2023-10-06T04:25:13.736 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T04:25:13.737 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2023-10-06T04:25:13.737 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.4 M 2023-10-06T04:25:13.737 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T04:25:13.737 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2023-10-06T04:25:13.737 INFO:teuthology.orchestra.run.smithi135.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T04:25:13.737 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 23 M 2023-10-06T04:25:13.737 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 23 k 2023-10-06T04:25:13.737 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 2.3 M 2023-10-06T04:25:13.737 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 238 k 2023-10-06T04:25:13.737 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.9 M 2023-10-06T04:25:13.737 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T04:25:13.738 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 14 k 2023-10-06T04:25:13.738 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 24 k 2023-10-06T04:25:13.738 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T04:25:13.738 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T04:25:13.738 INFO:teuthology.orchestra.run.smithi135.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T04:25:13.738 INFO:teuthology.orchestra.run.smithi135.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T04:25:13.738 INFO:teuthology.orchestra.run.smithi135.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T04:25:13.739 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 175 k 2023-10-06T04:25:13.739 INFO:teuthology.orchestra.run.smithi135.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T04:25:13.739 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T04:25:13.739 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T04:25:13.739 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T04:25:13.739 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T04:25:13.739 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 506 k 2023-10-06T04:25:13.739 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T04:25:13.739 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.6 M 2023-10-06T04:25:13.739 INFO:teuthology.orchestra.run.smithi135.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T04:25:13.740 INFO:teuthology.orchestra.run.smithi135.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T04:25:13.740 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T04:25:13.740 INFO:teuthology.orchestra.run.smithi135.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T04:25:13.740 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T04:25:13.740 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T04:25:13.740 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T04:25:13.740 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T04:25:13.740 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T04:25:13.740 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T04:25:13.740 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T04:25:13.740 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T04:25:13.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T04:25:13.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T04:25:13.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T04:25:13.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T04:25:13.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 45 k 2023-10-06T04:25:13.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 115 k 2023-10-06T04:25:13.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T04:25:13.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T04:25:13.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T04:25:13.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T04:25:13.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T04:25:13.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T04:25:13.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T04:25:13.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T04:25:13.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T04:25:13.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T04:25:13.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T04:25:13.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T04:25:13.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T04:25:13.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T04:25:13.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T04:25:13.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T04:25:13.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T04:25:13.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T04:25:13.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T04:25:13.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T04:25:13.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T04:25:13.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T04:25:13.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T04:25:13.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T04:25:13.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T04:25:13.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T04:25:13.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T04:25:13.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T04:25:13.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T04:25:13.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T04:25:13.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T04:25:13.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T04:25:13.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T04:25:13.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T04:25:13.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T04:25:13.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T04:25:13.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T04:25:13.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T04:25:13.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T04:25:13.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T04:25:13.744 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T04:25:13.745 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T04:25:13.745 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T04:25:13.745 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T04:25:13.745 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:25:13.745 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2023-10-06T04:25:13.745 INFO:teuthology.orchestra.run.smithi135.stdout:====================================================================================================================== 2023-10-06T04:25:13.745 INFO:teuthology.orchestra.run.smithi135.stdout:Install 118 Packages 2023-10-06T04:25:13.745 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 2 Packages 2023-10-06T04:25:13.745 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:25:13.746 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 201 M 2023-10-06T04:25:13.746 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2023-10-06T04:25:14.027 INFO:teuthology.orchestra.run.smithi135.stdout:(1/120): ceph-17.2.6-1274.g68e53a4a.el8.x86_64. 27 kB/s | 6.4 kB 00:00 2023-10-06T04:25:14.727 INFO:teuthology.orchestra.run.smithi135.stdout:(2/120): ceph-fuse-17.2.6-1274.g68e53a4a.el8.x8 1.2 MB/s | 877 kB 00:00 2023-10-06T04:25:14.779 INFO:teuthology.orchestra.run.smithi135.stdout:(3/120): ceph-immutable-object-cache-17.2.6-127 3.1 MB/s | 162 kB 00:00 2023-10-06T04:25:15.364 INFO:teuthology.orchestra.run.smithi135.stdout:(4/120): ceph-base-17.2.6-1274.g68e53a4a.el8.x8 3.3 MB/s | 5.2 MB 00:01 2023-10-06T04:25:15.647 INFO:teuthology.orchestra.run.smithi060.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:25:15.648 INFO:teuthology.orchestra.run.smithi060.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T04:25:15.659 INFO:teuthology.orchestra.run.smithi060.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T04:25:15.660 INFO:teuthology.orchestra.run.smithi060.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T04:25:15.661 INFO:teuthology.orchestra.run.smithi060.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T04:25:15.662 INFO:teuthology.orchestra.run.smithi060.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T04:25:15.664 INFO:teuthology.orchestra.run.smithi060.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T04:25:15.666 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T04:25:15.668 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T04:25:15.880 INFO:teuthology.orchestra.run.smithi135.stdout:(5/120): ceph-mgr-17.2.6-1274.g68e53a4a.el8.x86 3.0 MB/s | 1.6 MB 00:00 2023-10-06T04:25:15.941 INFO:teuthology.orchestra.run.smithi135.stdout:(6/120): ceph-mds-17.2.6-1274.g68e53a4a.el8.x86 2.0 MB/s | 2.3 MB 00:01 2023-10-06T04:25:16.197 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-06T04:25:16.210 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================================================== 2023-10-06T04:25:16.210 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2023-10-06T04:25:16.210 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================================================== 2023-10-06T04:25:16.210 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-10-06T04:25:16.210 INFO:teuthology.orchestra.run.smithi060.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T04:25:16.210 INFO:teuthology.orchestra.run.smithi060.stdout: ceph x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 6.4 k 2023-10-06T04:25:16.210 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.2 M 2023-10-06T04:25:16.210 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 877 k 2023-10-06T04:25:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 162 k 2023-10-06T04:25:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 1.6 M 2023-10-06T04:25:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 121 k 2023-10-06T04:25:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 1.7 M 2023-10-06T04:25:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 7.4 M 2023-10-06T04:25:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 47 k 2023-10-06T04:25:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T04:25:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 52 M 2023-10-06T04:25:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 267 k 2023-10-06T04:25:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 80 k 2023-10-06T04:25:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 255 k 2023-10-06T04:25:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 18 k 2023-10-06T04:25:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T04:25:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T04:25:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T04:25:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 25 k 2023-10-06T04:25:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 797 k 2023-10-06T04:25:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 130 k 2023-10-06T04:25:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T04:25:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T04:25:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T04:25:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 190 k 2023-10-06T04:25:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 371 k 2023-10-06T04:25:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 358 k 2023-10-06T04:25:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 107 k 2023-10-06T04:25:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 91 k 2023-10-06T04:25:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T04:25:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 173 k 2023-10-06T04:25:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T04:25:16.213 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2023-10-06T04:25:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: librados2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.4 M 2023-10-06T04:25:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T04:25:16.213 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2023-10-06T04:25:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T04:25:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 23 M 2023-10-06T04:25:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 23 k 2023-10-06T04:25:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 2.3 M 2023-10-06T04:25:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 238 k 2023-10-06T04:25:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.9 M 2023-10-06T04:25:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T04:25:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 14 k 2023-10-06T04:25:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 24 k 2023-10-06T04:25:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T04:25:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T04:25:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T04:25:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T04:25:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T04:25:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 175 k 2023-10-06T04:25:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T04:25:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T04:25:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T04:25:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T04:25:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T04:25:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 506 k 2023-10-06T04:25:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T04:25:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.6 M 2023-10-06T04:25:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T04:25:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T04:25:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T04:25:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T04:25:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T04:25:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T04:25:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T04:25:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T04:25:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T04:25:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T04:25:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T04:25:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T04:25:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T04:25:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T04:25:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T04:25:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T04:25:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 45 k 2023-10-06T04:25:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 115 k 2023-10-06T04:25:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T04:25:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T04:25:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T04:25:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T04:25:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T04:25:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T04:25:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T04:25:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T04:25:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T04:25:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T04:25:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T04:25:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T04:25:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T04:25:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T04:25:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T04:25:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T04:25:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T04:25:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T04:25:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T04:25:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T04:25:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T04:25:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T04:25:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T04:25:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T04:25:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T04:25:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T04:25:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T04:25:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T04:25:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T04:25:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T04:25:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T04:25:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T04:25:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T04:25:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T04:25:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T04:25:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T04:25:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T04:25:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T04:25:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T04:25:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T04:25:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T04:25:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T04:25:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T04:25:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T04:25:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:25:16.221 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-06T04:25:16.221 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================================================== 2023-10-06T04:25:16.221 INFO:teuthology.orchestra.run.smithi060.stdout:Install 118 Packages 2023-10-06T04:25:16.221 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 2 Packages 2023-10-06T04:25:16.222 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:25:16.222 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 201 M 2023-10-06T04:25:16.222 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-06T04:25:16.672 INFO:teuthology.orchestra.run.smithi060.stdout:(1/120): ceph-17.2.6-1274.g68e53a4a.el8.x86_64. 25 kB/s | 6.4 kB 00:00 2023-10-06T04:25:16.717 INFO:teuthology.orchestra.run.smithi135.stdout:(7/120): ceph-mon-17.2.6-1274.g68e53a4a.el8.x86 4.7 MB/s | 3.9 MB 00:00 2023-10-06T04:25:17.485 INFO:teuthology.orchestra.run.smithi060.stdout:(2/120): ceph-fuse-17.2.6-1274.g68e53a4a.el8.x8 1.1 MB/s | 877 kB 00:00 2023-10-06T04:25:17.634 INFO:teuthology.orchestra.run.smithi060.stdout:(3/120): ceph-immutable-object-cache-17.2.6-127 1.1 MB/s | 162 kB 00:00 2023-10-06T04:25:18.170 INFO:teuthology.orchestra.run.smithi060.stdout:(4/120): ceph-base-17.2.6-1274.g68e53a4a.el8.x8 2.9 MB/s | 5.2 MB 00:01 2023-10-06T04:25:18.605 INFO:teuthology.orchestra.run.smithi060.stdout:(5/120): ceph-common-17.2.6-1274.g68e53a4a.el8. 11 MB/s | 23 MB 00:02 2023-10-06T04:25:18.647 INFO:teuthology.orchestra.run.smithi060.stdout:(6/120): ceph-mgr-17.2.6-1274.g68e53a4a.el8.x86 3.3 MB/s | 1.6 MB 00:00 2023-10-06T04:25:18.857 INFO:teuthology.orchestra.run.smithi060.stdout:(7/120): ceph-mds-17.2.6-1274.g68e53a4a.el8.x86 1.9 MB/s | 2.3 MB 00:01 2023-10-06T04:25:18.906 INFO:teuthology.orchestra.run.smithi060.stdout:(8/120): ceph-mon-17.2.6-1274.g68e53a4a.el8.x86 13 MB/s | 3.9 MB 00:00 2023-10-06T04:25:18.936 INFO:teuthology.orchestra.run.smithi060.stdout:(9/120): ceph-selinux-17.2.6-1274.g68e53a4a.el8 801 kB/s | 24 kB 00:00 2023-10-06T04:25:20.900 INFO:teuthology.orchestra.run.smithi135.stdout:(8/120): ceph-radosgw-17.2.6-1274.g68e53a4a.el8 4.0 MB/s | 17 MB 00:04 2023-10-06T04:25:20.963 INFO:teuthology.orchestra.run.smithi135.stdout:(9/120): ceph-selinux-17.2.6-1274.g68e53a4a.el8 390 kB/s | 24 kB 00:00 2023-10-06T04:25:22.287 INFO:teuthology.orchestra.run.smithi060.stdout:(10/120): ceph-osd-17.2.6-1274.g68e53a4a.el8.x8 4.6 MB/s | 17 MB 00:03 2023-10-06T04:25:22.345 INFO:teuthology.orchestra.run.smithi135.stdout:(10/120): ceph-osd-17.2.6-1274.g68e53a4a.el8.x8 2.6 MB/s | 17 MB 00:06 2023-10-06T04:25:22.370 INFO:teuthology.orchestra.run.smithi060.stdout:(11/120): cephfs-mirror-17.2.6-1274.g68e53a4a.e 3.0 MB/s | 255 kB 00:00 2023-10-06T04:25:22.449 INFO:teuthology.orchestra.run.smithi060.stdout:(12/120): libcephfs-devel-17.2.6-1274.g68e53a4a 318 kB/s | 25 kB 00:00 2023-10-06T04:25:22.477 INFO:teuthology.orchestra.run.smithi135.stdout:(11/120): cephfs-mirror-17.2.6-1274.g68e53a4a.e 1.9 MB/s | 255 kB 00:00 2023-10-06T04:25:22.545 INFO:teuthology.orchestra.run.smithi135.stdout:(12/120): libcephfs-devel-17.2.6-1274.g68e53a4a 369 kB/s | 25 kB 00:00 2023-10-06T04:25:22.624 INFO:teuthology.orchestra.run.smithi060.stdout:(13/120): libcephfs2-17.2.6-1274.g68e53a4a.el8. 4.5 MB/s | 797 kB 00:00 2023-10-06T04:25:22.711 INFO:teuthology.orchestra.run.smithi060.stdout:(14/120): libcephsqlite-17.2.6-1274.g68e53a4a.e 2.0 MB/s | 175 kB 00:00 2023-10-06T04:25:22.796 INFO:teuthology.orchestra.run.smithi060.stdout:(15/120): librados-devel-17.2.6-1274.g68e53a4a. 1.5 MB/s | 130 kB 00:00 2023-10-06T04:25:22.861 INFO:teuthology.orchestra.run.smithi135.stdout:(13/120): libcephfs2-17.2.6-1274.g68e53a4a.el8. 2.5 MB/s | 797 kB 00:00 2023-10-06T04:25:22.941 INFO:teuthology.orchestra.run.smithi135.stdout:(14/120): libcephsqlite-17.2.6-1274.g68e53a4a.e 2.1 MB/s | 175 kB 00:00 2023-10-06T04:25:22.962 INFO:teuthology.orchestra.run.smithi060.stdout:(16/120): libradosstriper1-17.2.6-1274.g68e53a4 3.0 MB/s | 506 kB 00:00 2023-10-06T04:25:23.007 INFO:teuthology.orchestra.run.smithi135.stdout:(15/120): librados-devel-17.2.6-1274.g68e53a4a. 1.9 MB/s | 130 kB 00:00 2023-10-06T04:25:23.189 INFO:teuthology.orchestra.run.smithi135.stdout:(16/120): libradosstriper1-17.2.6-1274.g68e53a4 2.7 MB/s | 506 kB 00:00 2023-10-06T04:25:23.329 INFO:teuthology.orchestra.run.smithi060.stdout:(17/120): ceph-test-17.2.6-1274.g68e53a4a.el8.x 12 MB/s | 52 MB 00:04 2023-10-06T04:25:23.389 INFO:teuthology.orchestra.run.smithi060.stdout:(18/120): ceph-radosgw-17.2.6-1274.g68e53a4a.el 3.7 MB/s | 17 MB 00:04 2023-10-06T04:25:23.390 INFO:teuthology.orchestra.run.smithi060.stdout:(19/120): python3-ceph-argparse-17.2.6-1274.g68 732 kB/s | 45 kB 00:00 2023-10-06T04:25:23.436 INFO:teuthology.orchestra.run.smithi060.stdout:(20/120): python3-cephfs-17.2.6-1274.g68e53a4a. 4.1 MB/s | 190 kB 00:00 2023-10-06T04:25:23.444 INFO:teuthology.orchestra.run.smithi060.stdout:(21/120): python3-ceph-common-17.2.6-1274.g68e5 2.1 MB/s | 115 kB 00:00 2023-10-06T04:25:23.489 INFO:teuthology.orchestra.run.smithi060.stdout:(22/120): python3-rados-17.2.6-1274.g68e53a4a.e 6.9 MB/s | 371 kB 00:00 2023-10-06T04:25:23.541 INFO:teuthology.orchestra.run.smithi060.stdout:(23/120): python3-rgw-17.2.6-1274.g68e53a4a.el8 2.0 MB/s | 107 kB 00:00 2023-10-06T04:25:23.574 INFO:teuthology.orchestra.run.smithi060.stdout:(24/120): python3-rbd-17.2.6-1274.g68e53a4a.el8 2.7 MB/s | 358 kB 00:00 2023-10-06T04:25:23.580 INFO:teuthology.orchestra.run.smithi060.stdout:(25/120): rbd-fuse-17.2.6-1274.g68e53a4a.el8.x8 2.3 MB/s | 91 kB 00:00 2023-10-06T04:25:23.632 INFO:teuthology.orchestra.run.smithi060.stdout:(26/120): rbd-nbd-17.2.6-1274.g68e53a4a.el8.x86 3.2 MB/s | 173 kB 00:00 2023-10-06T04:25:23.679 INFO:teuthology.orchestra.run.smithi060.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1274.g 486 kB/s | 23 kB 00:00 2023-10-06T04:25:23.727 INFO:teuthology.orchestra.run.smithi060.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1274.g68e53a4 2.5 MB/s | 121 kB 00:00 2023-10-06T04:25:23.842 INFO:teuthology.orchestra.run.smithi060.stdout:(29/120): librgw2-17.2.6-1274.g68e53a4a.el8.x86 6.3 MB/s | 5.6 MB 00:00 2023-10-06T04:25:23.937 INFO:teuthology.orchestra.run.smithi060.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1274.g68e53 8.1 MB/s | 1.7 MB 00:00 2023-10-06T04:25:23.996 INFO:teuthology.orchestra.run.smithi060.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1274.g68 3.9 MB/s | 238 kB 00:00 2023-10-06T04:25:24.051 INFO:teuthology.orchestra.run.smithi060.stdout:(32/120): ceph-mgr-rook-17.2.6-1274.g68e53a4a.e 874 kB/s | 47 kB 00:00 2023-10-06T04:25:24.097 INFO:teuthology.orchestra.run.smithi060.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1274.g6 317 kB/s | 14 kB 00:00 2023-10-06T04:25:24.153 INFO:teuthology.orchestra.run.smithi060.stdout:(34/120): ceph-volume-17.2.6-1274.g68e53a4a.el8 4.7 MB/s | 267 kB 00:00 2023-10-06T04:25:24.207 INFO:teuthology.orchestra.run.smithi060.stdout:(35/120): cephadm-17.2.6-1274.g68e53a4a.el8.noa 1.4 MB/s | 80 kB 00:00 2023-10-06T04:25:24.231 INFO:teuthology.orchestra.run.smithi060.stdout:(36/120): rbd-mirror-17.2.6-1274.g68e53a4a.el8. 5.3 MB/s | 3.5 MB 00:00 2023-10-06T04:25:24.244 INFO:teuthology.orchestra.run.smithi060.stdout:(37/120): cephfs-top-17.2.6-1274.g68e53a4a.el8. 494 kB/s | 18 kB 00:00 2023-10-06T04:25:24.369 INFO:teuthology.orchestra.run.smithi135.stdout:(17/120): librgw2-17.2.6-1274.g68e53a4a.el8.x86 4.7 MB/s | 5.6 MB 00:01 2023-10-06T04:25:24.382 INFO:teuthology.orchestra.run.smithi060.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 431 kB/s | 59 kB 00:00 2023-10-06T04:25:24.401 INFO:teuthology.orchestra.run.smithi135.stdout:(18/120): python3-ceph-argparse-17.2.6-1274.g68 1.4 MB/s | 45 kB 00:00 2023-10-06T04:25:24.434 INFO:teuthology.orchestra.run.smithi135.stdout:(19/120): python3-ceph-common-17.2.6-1274.g68e5 3.4 MB/s | 115 kB 00:00 2023-10-06T04:25:24.442 INFO:teuthology.orchestra.run.smithi060.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 1.2 MB/s | 75 kB 00:00 2023-10-06T04:25:24.443 INFO:teuthology.orchestra.run.smithi060.stdout:(40/120): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2023-10-06T04:25:24.472 INFO:teuthology.orchestra.run.smithi135.stdout:(20/120): python3-cephfs-17.2.6-1274.g68e53a4a. 5.0 MB/s | 190 kB 00:00 2023-10-06T04:25:24.490 INFO:teuthology.orchestra.run.smithi060.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 946 kB/s | 44 kB 00:00 2023-10-06T04:25:24.524 INFO:teuthology.orchestra.run.smithi060.stdout:(42/120): python3-asyncssh-2.7.0-2.el8.noarch.r 5.7 MB/s | 476 kB 00:00 2023-10-06T04:25:24.544 INFO:teuthology.orchestra.run.smithi135.stdout:(21/120): python3-rados-17.2.6-1274.g68e53a4a.e 5.1 MB/s | 371 kB 00:00 2023-10-06T04:25:24.557 INFO:teuthology.orchestra.run.smithi060.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 1.0 MB/s | 33 kB 00:00 2023-10-06T04:25:24.569 INFO:teuthology.orchestra.run.smithi060.stdout:(44/120): python3-beautifulsoup4-4.6.3-2.el8.1. 2.3 MB/s | 185 kB 00:00 2023-10-06T04:25:24.588 INFO:teuthology.orchestra.run.smithi060.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 522 kB/s | 16 kB 00:00 2023-10-06T04:25:24.611 INFO:teuthology.orchestra.run.smithi135.stdout:(22/120): python3-rbd-17.2.6-1274.g68e53a4a.el8 5.2 MB/s | 358 kB 00:00 2023-10-06T04:25:24.618 INFO:teuthology.orchestra.run.smithi060.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2023-10-06T04:25:24.632 INFO:teuthology.orchestra.run.smithi060.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 8.6 MB/s | 384 kB 00:00 2023-10-06T04:25:24.644 INFO:teuthology.orchestra.run.smithi135.stdout:(23/120): python3-rgw-17.2.6-1274.g68e53a4a.el8 3.3 MB/s | 107 kB 00:00 2023-10-06T04:25:24.657 INFO:teuthology.orchestra.run.smithi060.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 2.1 MB/s | 81 kB 00:00 2023-10-06T04:25:24.664 INFO:teuthology.orchestra.run.smithi060.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 356 kB/s | 11 kB 00:00 2023-10-06T04:25:24.675 INFO:teuthology.orchestra.run.smithi135.stdout:(24/120): rbd-fuse-17.2.6-1274.g68e53a4a.el8.x8 2.9 MB/s | 91 kB 00:00 2023-10-06T04:25:24.688 INFO:teuthology.orchestra.run.smithi060.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 563 kB/s | 18 kB 00:00 2023-10-06T04:25:24.724 INFO:teuthology.orchestra.run.smithi060.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 1.4 MB/s | 49 kB 00:00 2023-10-06T04:25:24.737 INFO:teuthology.orchestra.run.smithi060.stdout:(52/120): python3-kubernetes-11.0.0-6.el8.noarc 16 MB/s | 1.2 MB 00:00 2023-10-06T04:25:24.760 INFO:teuthology.orchestra.run.smithi060.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 1.6 MB/s | 59 kB 00:00 2023-10-06T04:25:24.794 INFO:teuthology.orchestra.run.smithi060.stdout:(54/120): ceph-mgr-diskprediction-local-17.2.6- 7.8 MB/s | 7.4 MB 00:00 2023-10-06T04:25:24.795 INFO:teuthology.orchestra.run.smithi060.stdout:(55/120): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2023-10-06T04:25:24.820 INFO:teuthology.orchestra.run.smithi060.stdout:(56/120): python3-pecan-1.3.2-9.el8.noarch.rpm 4.6 MB/s | 283 kB 00:00 2023-10-06T04:25:24.827 INFO:teuthology.orchestra.run.smithi060.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.0 MB/s | 34 kB 00:00 2023-10-06T04:25:24.859 INFO:teuthology.orchestra.run.smithi060.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 2.0 MB/s | 64 kB 00:00 2023-10-06T04:25:24.865 INFO:teuthology.orchestra.run.smithi060.stdout:(59/120): python3-routes-2.4.1-12.el8.noarch.rp 4.3 MB/s | 196 kB 00:00 2023-10-06T04:25:24.886 INFO:teuthology.orchestra.run.smithi060.stdout:(60/120): python3-portend-2.6-1.el8.noarch.rpm 170 kB/s | 16 kB 00:00 2023-10-06T04:25:24.890 INFO:teuthology.orchestra.run.smithi060.stdout:(61/120): python3-simplegeneric-0.8.1-17.el8.no 607 kB/s | 19 kB 00:00 2023-10-06T04:25:24.896 INFO:teuthology.orchestra.run.smithi060.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 766 kB/s | 24 kB 00:00 2023-10-06T04:25:24.921 INFO:teuthology.orchestra.run.smithi060.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 890 kB/s | 27 kB 00:00 2023-10-06T04:25:24.937 INFO:teuthology.orchestra.run.smithi060.stdout:(64/120): python3-tempora-1.14.1-5.el8.noarch.r 583 kB/s | 29 kB 00:00 2023-10-06T04:25:24.946 INFO:teuthology.orchestra.run.smithi060.stdout:(65/120): python3-waitress-1.4.3-1.el8.noarch.r 5.1 MB/s | 255 kB 00:00 2023-10-06T04:25:24.956 INFO:teuthology.orchestra.run.smithi060.stdout:(66/120): python3-webob-1.8.5-1.el8.1.noarch.rp 7.0 MB/s | 251 kB 00:00 2023-10-06T04:25:24.982 INFO:teuthology.orchestra.run.smithi060.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 2.3 MB/s | 85 kB 00:00 2023-10-06T04:25:24.988 INFO:teuthology.orchestra.run.smithi060.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 738 kB/s | 23 kB 00:00 2023-10-06T04:25:24.993 INFO:teuthology.orchestra.run.smithi060.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 14 MB/s | 70 kB 00:00 2023-10-06T04:25:25.002 INFO:teuthology.orchestra.run.smithi060.stdout:(70/120): python3-websocket-client-0.56.0-5.el8 937 kB/s | 61 kB 00:00 2023-10-06T04:25:25.064 INFO:teuthology.orchestra.run.smithi060.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 712 kB/s | 44 kB 00:00 2023-10-06T04:25:25.085 INFO:teuthology.orchestra.run.smithi060.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.3 MB/s | 27 kB 00:00 2023-10-06T04:25:25.104 INFO:teuthology.orchestra.run.smithi135.stdout:(25/120): ceph-common-17.2.6-1274.g68e53a4a.el8 2.1 MB/s | 23 MB 00:11 2023-10-06T04:25:25.109 INFO:teuthology.orchestra.run.smithi060.stdout:(73/120): thrift-0.13.0-2.el8.x86_64.rpm 14 MB/s | 1.7 MB 00:00 2023-10-06T04:25:25.140 INFO:teuthology.orchestra.run.smithi060.stdout:(74/120): jq-1.5-12.el8.x86_64.rpm 2.9 MB/s | 161 kB 00:00 2023-10-06T04:25:25.141 INFO:teuthology.orchestra.run.smithi135.stdout:(26/120): rbd-mirror-17.2.6-1274.g68e53a4a.el8. 7.4 MB/s | 3.5 MB 00:00 2023-10-06T04:25:25.150 INFO:teuthology.orchestra.run.smithi135.stdout:(27/120): rbd-nbd-17.2.6-1274.g68e53a4a.el8.x86 3.8 MB/s | 173 kB 00:00 2023-10-06T04:25:25.163 INFO:teuthology.orchestra.run.smithi135.stdout:(28/120): ceph-grafana-dashboards-17.2.6-1274.g 1.1 MB/s | 23 kB 00:00 2023-10-06T04:25:25.172 INFO:teuthology.orchestra.run.smithi060.stdout:(75/120): flex-2.6.1-9.el8.x86_64.rpm 5.1 MB/s | 320 kB 00:00 2023-10-06T04:25:25.188 INFO:teuthology.orchestra.run.smithi135.stdout:(29/120): ceph-mgr-cephadm-17.2.6-1274.g68e53a4 3.1 MB/s | 121 kB 00:00 2023-10-06T04:25:25.189 INFO:teuthology.orchestra.run.smithi060.stdout:(76/120): python3-werkzeug-0.12.2-4.el8.noarch. 9.2 MB/s | 457 kB 00:00 2023-10-06T04:25:25.227 INFO:teuthology.orchestra.run.smithi060.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 1.0 MB/s | 39 kB 00:00 2023-10-06T04:25:25.275 INFO:teuthology.orchestra.run.smithi060.stdout:(78/120): bison-3.0.4-10.el8.x86_64.rpm 14 MB/s | 688 kB 00:00 2023-10-06T04:25:25.316 INFO:teuthology.orchestra.run.smithi060.stdout:(79/120): python3-babel-2.5.1-5.el8.noarch.rpm 33 MB/s | 4.8 MB 00:00 2023-10-06T04:25:25.323 INFO:teuthology.orchestra.run.smithi060.stdout:(80/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.3 MB/s | 259 kB 00:00 2023-10-06T04:25:25.346 INFO:teuthology.orchestra.run.smithi060.stdout:(81/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 7.6 MB/s | 225 kB 00:00 2023-10-06T04:25:25.349 INFO:teuthology.orchestra.run.smithi060.stdout:(82/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 4.8 MB/s | 126 kB 00:00 2023-10-06T04:25:25.356 INFO:teuthology.orchestra.run.smithi135.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1274.g68e53 8.8 MB/s | 1.7 MB 00:00 2023-10-06T04:25:25.388 INFO:teuthology.orchestra.run.smithi060.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 4.7 MB/s | 187 kB 00:00 2023-10-06T04:25:25.401 INFO:teuthology.orchestra.run.smithi135.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1274.g68 5.4 MB/s | 238 kB 00:00 2023-10-06T04:25:25.422 INFO:teuthology.orchestra.run.smithi135.stdout:(32/120): ceph-mgr-rook-17.2.6-1274.g68e53a4a.e 2.2 MB/s | 47 kB 00:00 2023-10-06T04:25:25.443 INFO:teuthology.orchestra.run.smithi060.stdout:(84/120): python3-scipy-1.0.0-20.module+el8.1.0 32 MB/s | 15 MB 00:00 2023-10-06T04:25:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1274.g6 691 kB/s | 14 kB 00:00 2023-10-06T04:25:25.456 INFO:teuthology.orchestra.run.smithi060.stdout:(85/120): python3-jinja2-2.10.1-2.el8_0.noarch. 7.8 MB/s | 538 kB 00:00 2023-10-06T04:25:25.471 INFO:teuthology.orchestra.run.smithi060.stdout:(86/120): socat-1.7.3.3-2.el8.x86_64.rpm 11 MB/s | 302 kB 00:00 2023-10-06T04:25:25.482 INFO:teuthology.orchestra.run.smithi060.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 6.0 MB/s | 157 kB 00:00 2023-10-06T04:25:25.489 INFO:teuthology.orchestra.run.smithi060.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 5.9 MB/s | 110 kB 00:00 2023-10-06T04:25:25.491 INFO:teuthology.orchestra.run.smithi135.stdout:(34/120): ceph-volume-17.2.6-1274.g68e53a4a.el8 6.2 MB/s | 267 kB 00:00 2023-10-06T04:25:25.508 INFO:teuthology.orchestra.run.smithi060.stdout:(89/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 23 MB/s | 3.7 MB 00:00 2023-10-06T04:25:25.509 INFO:teuthology.orchestra.run.smithi135.stdout:(35/120): cephadm-17.2.6-1274.g68e53a4a.el8.noa 3.6 MB/s | 80 kB 00:00 2023-10-06T04:25:25.511 INFO:teuthology.orchestra.run.smithi060.stdout:(90/120): python3-jsonpointer-1.10-11.el8.noarc 919 kB/s | 20 kB 00:00 2023-10-06T04:25:25.514 INFO:teuthology.orchestra.run.smithi060.stdout:(91/120): librdkafka-0.11.4-1.el8.x86_64.rpm 11 MB/s | 353 kB 00:00 2023-10-06T04:25:25.529 INFO:teuthology.orchestra.run.smithi135.stdout:(36/120): cephfs-top-17.2.6-1274.g68e53a4a.el8. 854 kB/s | 18 kB 00:00 2023-10-06T04:25:25.539 INFO:teuthology.orchestra.run.smithi060.stdout:(92/120): python3-pytz-2017.2-9.el8.noarch.rpm 1.9 MB/s | 54 kB 00:00 2023-10-06T04:25:25.544 INFO:teuthology.orchestra.run.smithi060.stdout:(93/120): libtool-2.4.6-25.el8.x86_64.rpm 19 MB/s | 709 kB 00:00 2023-10-06T04:25:25.586 INFO:teuthology.orchestra.run.smithi135.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 5.5 MB/s | 306 kB 00:00 2023-10-06T04:25:25.588 INFO:teuthology.orchestra.run.smithi060.stdout:(94/120): automake-1.16.1-7.el8.noarch.rpm 16 MB/s | 713 kB 00:00 2023-10-06T04:25:25.592 INFO:teuthology.orchestra.run.smithi135.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 6.7 MB/s | 59 kB 00:00 2023-10-06T04:25:25.606 INFO:teuthology.orchestra.run.smithi135.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 8.4 MB/s | 75 kB 00:00 2023-10-06T04:25:25.607 INFO:teuthology.orchestra.run.smithi060.stdout:(95/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 985 kB/s | 19 kB 00:00 2023-10-06T04:25:25.626 INFO:teuthology.orchestra.run.smithi060.stdout:(96/120): python3-jwt-1.6.1-2.el8.noarch.rpm 2.3 MB/s | 43 kB 00:00 2023-10-06T04:25:25.647 INFO:teuthology.orchestra.run.smithi135.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 10 MB/s | 476 kB 00:00 2023-10-06T04:25:25.648 INFO:teuthology.orchestra.run.smithi060.stdout:(97/120): openblas-threads-0.3.12-1.el8.x86_64. 35 MB/s | 4.7 MB 00:00 2023-10-06T04:25:25.652 INFO:teuthology.orchestra.run.smithi060.stdout:(98/120): python3-oauthlib-2.1.0-1.el8.noarch.r 5.9 MB/s | 155 kB 00:00 2023-10-06T04:25:25.656 INFO:teuthology.orchestra.run.smithi135.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 5.1 MB/s | 44 kB 00:00 2023-10-06T04:25:25.665 INFO:teuthology.orchestra.run.smithi135.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 19 MB/s | 185 kB 00:00 2023-10-06T04:25:25.681 INFO:teuthology.orchestra.run.smithi135.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 2.1 MB/s | 33 kB 00:00 2023-10-06T04:25:25.684 INFO:teuthology.orchestra.run.smithi060.stdout:(99/120): openblas-0.3.12-1.el8.x86_64.rpm 32 MB/s | 4.6 MB 00:00 2023-10-06T04:25:25.685 INFO:teuthology.orchestra.run.smithi060.stdout:(100/120): keyutils-libs-devel-1.5.10-6.el8.x86 1.4 MB/s | 48 kB 00:00 2023-10-06T04:25:25.687 INFO:teuthology.orchestra.run.smithi060.stdout:(101/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.6 MB/s | 220 kB 00:00 2023-10-06T04:25:25.694 INFO:teuthology.orchestra.run.smithi135.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 1.2 MB/s | 16 kB 00:00 2023-10-06T04:25:25.705 INFO:teuthology.orchestra.run.smithi135.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 17 MB/s | 173 kB 00:00 2023-10-06T04:25:25.717 INFO:teuthology.orchestra.run.smithi060.stdout:(102/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 6.9 MB/s | 229 kB 00:00 2023-10-06T04:25:25.717 INFO:teuthology.orchestra.run.smithi135.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 30 MB/s | 384 kB 00:00 2023-10-06T04:25:25.718 INFO:teuthology.orchestra.run.smithi060.stdout:(103/120): python3-requests-oauthlib-1.0.0-1.el 1.3 MB/s | 43 kB 00:00 2023-10-06T04:25:25.734 INFO:teuthology.orchestra.run.smithi135.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 5.4 MB/s | 81 kB 00:00 2023-10-06T04:25:25.734 INFO:teuthology.orchestra.run.smithi060.stdout:(104/120): libverto-devel-0.3.0-5.el8.x86_64.rp 1.0 MB/s | 18 kB 00:00 2023-10-06T04:25:25.745 INFO:teuthology.orchestra.run.smithi060.stdout:(105/120): pcre2-devel-10.32-2.el8.x86_64.rpm 22 MB/s | 605 kB 00:00 2023-10-06T04:25:25.747 INFO:teuthology.orchestra.run.smithi135.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 820 kB/s | 11 kB 00:00 2023-10-06T04:25:25.754 INFO:teuthology.orchestra.run.smithi060.stdout:(106/120): openssl-devel-1.1.1g-15.el8_3.x86_64 34 MB/s | 2.3 MB 00:00 2023-10-06T04:25:25.756 INFO:teuthology.orchestra.run.smithi060.stdout:(107/120): fuse-2.9.7-12.el8.x86_64.rpm 3.7 MB/s | 83 kB 00:00 2023-10-06T04:25:25.761 INFO:teuthology.orchestra.run.smithi135.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 1.2 MB/s | 18 kB 00:00 2023-10-06T04:25:25.769 INFO:teuthology.orchestra.run.smithi060.stdout:(108/120): elfutils-libelf-devel-0.182-3.el8.x8 2.4 MB/s | 59 kB 00:00 2023-10-06T04:25:25.773 INFO:teuthology.orchestra.run.smithi060.stdout:(109/120): libcom_err-devel-1.45.6-1.el8.x86_64 2.2 MB/s | 38 kB 00:00 2023-10-06T04:25:25.790 INFO:teuthology.orchestra.run.smithi060.stdout:(110/120): libquadmath-8.4.1-1.el8.x86_64.rpm 4.7 MB/s | 169 kB 00:00 2023-10-06T04:25:25.791 INFO:teuthology.orchestra.run.smithi135.stdout:(50/120): python3-kubernetes-11.0.0-6.el8.noarc 41 MB/s | 1.2 MB 00:00 2023-10-06T04:25:25.791 INFO:teuthology.orchestra.run.smithi060.stdout:(111/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.1 MB/s | 58 kB 00:00 2023-10-06T04:25:25.799 INFO:teuthology.orchestra.run.smithi135.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 5.4 MB/s | 49 kB 00:00 2023-10-06T04:25:25.802 INFO:teuthology.orchestra.run.smithi060.stdout:(112/120): libsepol-devel-2.9-2.el8.x86_64.rpm 2.6 MB/s | 86 kB 00:00 2023-10-06T04:25:25.812 INFO:teuthology.orchestra.run.smithi060.stdout:(113/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.1 MB/s | 47 kB 00:00 2023-10-06T04:25:25.819 INFO:teuthology.orchestra.run.smithi135.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 3.1 MB/s | 59 kB 00:00 2023-10-06T04:25:25.821 INFO:teuthology.orchestra.run.smithi060.stdout:(114/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 19 MB/s | 559 kB 00:00 2023-10-06T04:25:25.832 INFO:teuthology.orchestra.run.smithi060.stdout:(115/120): libgfortran-8.4.1-1.el8.x86_64.rpm 21 MB/s | 639 kB 00:00 2023-10-06T04:25:25.833 INFO:teuthology.orchestra.run.smithi060.stdout:(116/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 3.3 MB/s | 70 kB 00:00 2023-10-06T04:25:25.835 INFO:teuthology.orchestra.run.smithi135.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 3.7 MB/s | 60 kB 00:00 2023-10-06T04:25:25.838 INFO:teuthology.orchestra.run.smithi060.stdout:(117/120): libselinux-devel-2.9-5.el8.x86_64.rp 12 MB/s | 200 kB 00:00 2023-10-06T04:25:25.851 INFO:teuthology.orchestra.run.smithi060.stdout:(118/120): libuuid-devel-2.32.1-27.el8.x86_64.r 5.2 MB/s | 97 kB 00:00 2023-10-06T04:25:25.856 INFO:teuthology.orchestra.run.smithi135.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 14 MB/s | 283 kB 00:00 2023-10-06T04:25:25.875 INFO:teuthology.orchestra.run.smithi135.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 908 kB/s | 16 kB 00:00 2023-10-06T04:25:25.892 INFO:teuthology.orchestra.run.smithi135.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.9 MB/s | 34 kB 00:00 2023-10-06T04:25:25.909 INFO:teuthology.orchestra.run.smithi135.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 12 MB/s | 196 kB 00:00 2023-10-06T04:25:25.933 INFO:teuthology.orchestra.run.smithi135.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 2.9 MB/s | 64 kB 00:00 2023-10-06T04:25:25.958 INFO:teuthology.orchestra.run.smithi135.stdout:(59/120): python3-simplegeneric-0.8.1-17.el8.no 831 kB/s | 19 kB 00:00 2023-10-06T04:25:25.964 INFO:teuthology.orchestra.run.smithi135.stdout:(60/120): python3-singledispatch-3.4.0.3-18.el8 2.8 MB/s | 24 kB 00:00 2023-10-06T04:25:25.979 INFO:teuthology.orchestra.run.smithi135.stdout:(61/120): python3-tempora-1.14.1-5.el8.noarch.r 1.8 MB/s | 29 kB 00:00 2023-10-06T04:25:25.992 INFO:teuthology.orchestra.run.smithi135.stdout:(62/120): python3-trustme-0.6.0-4.el8.noarch.rp 2.0 MB/s | 27 kB 00:00 2023-10-06T04:25:26.015 INFO:teuthology.orchestra.run.smithi135.stdout:(63/120): python3-waitress-1.4.3-1.el8.noarch.r 12 MB/s | 255 kB 00:00 2023-10-06T04:25:26.047 INFO:teuthology.orchestra.run.smithi135.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 9.0 MB/s | 251 kB 00:00 2023-10-06T04:25:26.052 INFO:teuthology.orchestra.run.smithi135.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 6.9 MB/s | 61 kB 00:00 2023-10-06T04:25:26.076 INFO:teuthology.orchestra.run.smithi135.stdout:(66/120): python3-webtest-2.0.33-1.el8.noarch.r 8.9 MB/s | 85 kB 00:00 2023-10-06T04:25:26.082 INFO:teuthology.orchestra.run.smithi135.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 1.3 MB/s | 23 kB 00:00 2023-10-06T04:25:26.118 INFO:teuthology.orchestra.run.smithi135.stdout:(68/120): thrift-0.13.0-2.el8.x86_64.rpm 43 MB/s | 1.7 MB 00:00 2023-10-06T04:25:26.121 INFO:teuthology.orchestra.run.smithi135.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 19 MB/s | 70 kB 00:00 2023-10-06T04:25:26.284 INFO:teuthology.orchestra.run.smithi135.stdout:(70/120): ceph-mgr-diskprediction-local-17.2.6- 6.7 MB/s | 7.4 MB 00:01 2023-10-06T04:25:26.314 INFO:teuthology.orchestra.run.smithi135.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 1.5 MB/s | 44 kB 00:00 2023-10-06T04:25:26.328 INFO:teuthology.orchestra.run.smithi135.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.8 MB/s | 27 kB 00:00 2023-10-06T04:25:26.345 INFO:teuthology.orchestra.run.smithi135.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 9.4 MB/s | 161 kB 00:00 2023-10-06T04:25:26.366 INFO:teuthology.orchestra.run.smithi135.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 15 MB/s | 320 kB 00:00 2023-10-06T04:25:26.393 INFO:teuthology.orchestra.run.smithi135.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 18 MB/s | 457 kB 00:00 2023-10-06T04:25:26.418 INFO:teuthology.orchestra.run.smithi060.stdout:(119/120): librbd1-17.2.6-1274.g68e53a4a.el8.x8 6.1 MB/s | 3.5 MB 00:00 2023-10-06T04:25:26.448 INFO:teuthology.orchestra.run.smithi060.stdout:(120/120): librados2-17.2.6-1274.g68e53a4a.el8. 5.6 MB/s | 3.4 MB 00:00 2023-10-06T04:25:26.452 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-06T04:25:26.452 INFO:teuthology.orchestra.run.smithi060.stdout:Total 20 MB/s | 201 MB 00:10 2023-10-06T04:25:26.469 INFO:teuthology.orchestra.run.smithi135.stdout:(76/120): python3-scipy-1.0.0-20.module+el8.1.0 42 MB/s | 15 MB 00:00 2023-10-06T04:25:26.484 INFO:teuthology.orchestra.run.smithi135.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 2.7 MB/s | 39 kB 00:00 2023-10-06T04:25:26.514 INFO:teuthology.orchestra.run.smithi135.stdout:(78/120): bison-3.0.4-10.el8.x86_64.rpm 22 MB/s | 688 kB 00:00 2023-10-06T04:25:26.528 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-06T04:25:26.536 INFO:teuthology.orchestra.run.smithi135.stdout:(79/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 12 MB/s | 259 kB 00:00 2023-10-06T04:25:26.553 INFO:teuthology.orchestra.run.smithi135.stdout:(80/120): python3-babel-2.5.1-5.el8.noarch.rpm 30 MB/s | 4.8 MB 00:00 2023-10-06T04:25:26.559 INFO:teuthology.orchestra.run.smithi135.stdout:(81/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 9.8 MB/s | 225 kB 00:00 2023-10-06T04:25:26.571 INFO:teuthology.orchestra.run.smithi135.stdout:(82/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 6.9 MB/s | 126 kB 00:00 2023-10-06T04:25:26.589 INFO:teuthology.orchestra.run.smithi135.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 10 MB/s | 187 kB 00:00 2023-10-06T04:25:26.615 INFO:teuthology.orchestra.run.smithi135.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 21 MB/s | 538 kB 00:00 2023-10-06T04:25:26.635 INFO:teuthology.orchestra.run.smithi135.stdout:(85/120): socat-1.7.3.3-2.el8.x86_64.rpm 15 MB/s | 302 kB 00:00 2023-10-06T04:25:26.652 INFO:teuthology.orchestra.run.smithi135.stdout:(86/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 40 MB/s | 3.7 MB 00:00 2023-10-06T04:25:26.655 INFO:teuthology.orchestra.run.smithi135.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 7.9 MB/s | 157 kB 00:00 2023-10-06T04:25:26.666 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-06T04:25:26.666 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-06T04:25:26.667 INFO:teuthology.orchestra.run.smithi135.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 7.4 MB/s | 110 kB 00:00 2023-10-06T04:25:26.678 INFO:teuthology.orchestra.run.smithi135.stdout:(89/120): librdkafka-0.11.4-1.el8.x86_64.rpm 15 MB/s | 353 kB 00:00 2023-10-06T04:25:26.680 INFO:teuthology.orchestra.run.smithi135.stdout:(90/120): python3-jsonpointer-1.10-11.el8.noarc 1.5 MB/s | 20 kB 00:00 2023-10-06T04:25:26.696 INFO:teuthology.orchestra.run.smithi135.stdout:(91/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.5 MB/s | 54 kB 00:00 2023-10-06T04:25:26.708 INFO:teuthology.orchestra.run.smithi135.stdout:(92/120): libtool-2.4.6-25.el8.x86_64.rpm 24 MB/s | 709 kB 00:00 2023-10-06T04:25:26.824 INFO:teuthology.orchestra.run.smithi135.stdout:(93/120): openblas-threads-0.3.12-1.el8.x86_64. 37 MB/s | 4.7 MB 00:00 2023-10-06T04:25:26.845 INFO:teuthology.orchestra.run.smithi135.stdout:(94/120): openblas-0.3.12-1.el8.x86_64.rpm 33 MB/s | 4.6 MB 00:00 2023-10-06T04:25:26.860 INFO:teuthology.orchestra.run.smithi135.stdout:(95/120): automake-1.16.1-7.el8.noarch.rpm 20 MB/s | 713 kB 00:00 2023-10-06T04:25:26.863 INFO:teuthology.orchestra.run.smithi135.stdout:(96/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 1.0 MB/s | 19 kB 00:00 2023-10-06T04:25:26.877 INFO:teuthology.orchestra.run.smithi135.stdout:(97/120): python3-jwt-1.6.1-2.el8.noarch.rpm 2.4 MB/s | 43 kB 00:00 2023-10-06T04:25:26.890 INFO:teuthology.orchestra.run.smithi135.stdout:(98/120): python3-oauthlib-2.1.0-1.el8.noarch.r 5.8 MB/s | 155 kB 00:00 2023-10-06T04:25:26.898 INFO:teuthology.orchestra.run.smithi135.stdout:(99/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 10 MB/s | 220 kB 00:00 2023-10-06T04:25:26.906 INFO:teuthology.orchestra.run.smithi135.stdout:(100/120): keyutils-libs-devel-1.5.10-6.el8.x86 2.8 MB/s | 48 kB 00:00 2023-10-06T04:25:26.917 INFO:teuthology.orchestra.run.smithi135.stdout:(101/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 12 MB/s | 229 kB 00:00 2023-10-06T04:25:26.921 INFO:teuthology.orchestra.run.smithi135.stdout:(102/120): python3-requests-oauthlib-1.0.0-1.el 2.9 MB/s | 43 kB 00:00 2023-10-06T04:25:26.936 INFO:teuthology.orchestra.run.smithi135.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 1.2 MB/s | 18 kB 00:00 2023-10-06T04:25:26.962 INFO:teuthology.orchestra.run.smithi135.stdout:(104/120): pcre2-devel-10.32-2.el8.x86_64.rpm 22 MB/s | 605 kB 00:00 2023-10-06T04:25:26.979 INFO:teuthology.orchestra.run.smithi135.stdout:(105/120): openssl-devel-1.1.1g-15.el8_3.x86_64 37 MB/s | 2.3 MB 00:00 2023-10-06T04:25:26.981 INFO:teuthology.orchestra.run.smithi135.stdout:(106/120): fuse-2.9.7-12.el8.x86_64.rpm 4.4 MB/s | 83 kB 00:00 2023-10-06T04:25:26.998 INFO:teuthology.orchestra.run.smithi135.stdout:(107/120): libquadmath-8.4.1-1.el8.x86_64.rpm 10 MB/s | 169 kB 00:00 2023-10-06T04:25:26.999 INFO:teuthology.orchestra.run.smithi135.stdout:(108/120): elfutils-libelf-devel-0.182-3.el8.x8 3.0 MB/s | 59 kB 00:00 2023-10-06T04:25:27.012 INFO:teuthology.orchestra.run.smithi135.stdout:(109/120): libcom_err-devel-1.45.6-1.el8.x86_64 2.8 MB/s | 38 kB 00:00 2023-10-06T04:25:27.015 INFO:teuthology.orchestra.run.smithi135.stdout:(110/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.4 MB/s | 86 kB 00:00 2023-10-06T04:25:27.028 INFO:teuthology.orchestra.run.smithi135.stdout:(111/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.5 MB/s | 58 kB 00:00 2023-10-06T04:25:27.034 INFO:teuthology.orchestra.run.smithi135.stdout:(112/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.4 MB/s | 47 kB 00:00 2023-10-06T04:25:27.052 INFO:teuthology.orchestra.run.smithi135.stdout:(113/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 23 MB/s | 559 kB 00:00 2023-10-06T04:25:27.062 INFO:teuthology.orchestra.run.smithi135.stdout:(114/120): libgfortran-8.4.1-1.el8.x86_64.rpm 23 MB/s | 639 kB 00:00 2023-10-06T04:25:27.066 INFO:teuthology.orchestra.run.smithi135.stdout:(115/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 4.9 MB/s | 70 kB 00:00 2023-10-06T04:25:27.080 INFO:teuthology.orchestra.run.smithi135.stdout:(116/120): libselinux-devel-2.9-5.el8.x86_64.rp 11 MB/s | 200 kB 00:00 2023-10-06T04:25:27.082 INFO:teuthology.orchestra.run.smithi135.stdout:(117/120): libuuid-devel-2.32.1-27.el8.x86_64.r 6.1 MB/s | 97 kB 00:00 2023-10-06T04:25:27.584 INFO:teuthology.orchestra.run.smithi135.stdout:(118/120): librados2-17.2.6-1274.g68e53a4a.el8. 6.8 MB/s | 3.4 MB 00:00 2023-10-06T04:25:27.782 INFO:teuthology.orchestra.run.smithi135.stdout:(119/120): ceph-test-17.2.6-1274.g68e53a4a.el8. 7.6 MB/s | 52 MB 00:06 2023-10-06T04:25:27.796 INFO:teuthology.orchestra.run.smithi135.stdout:(120/120): librbd1-17.2.6-1274.g68e53a4a.el8.x8 5.0 MB/s | 3.5 MB 00:00 2023-10-06T04:25:27.800 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2023-10-06T04:25:27.800 INFO:teuthology.orchestra.run.smithi135.stdout:Total 14 MB/s | 201 MB 00:14 2023-10-06T04:25:27.867 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2023-10-06T04:25:27.990 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2023-10-06T04:25:27.990 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2023-10-06T04:25:28.551 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-06T04:25:28.556 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-06T04:25:29.776 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2023-10-06T04:25:29.780 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2023-10-06T04:25:33.399 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-06T04:25:33.592 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T04:25:33.844 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-06T04:25:34.052 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T04:25:34.230 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T04:25:34.416 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2023-10-06T04:25:34.460 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T04:25:34.624 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T04:25:34.834 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-06T04:25:34.914 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T04:25:35.034 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T04:25:35.143 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T04:25:35.211 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T04:25:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T04:25:35.606 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T04:25:35.818 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:25:35.981 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:25:36.153 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T04:25:36.218 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:25:36.342 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:25:36.585 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T04:25:36.755 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/122 2023-10-06T04:25:37.050 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T04:25:37.301 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:25:37.443 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:25:37.522 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T04:25:37.617 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:25:37.742 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:25:37.935 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:25:38.089 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:25:38.135 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/122 2023-10-06T04:25:38.334 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T04:25:38.535 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T04:25:38.718 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:25:38.884 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:25:38.891 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T04:25:39.060 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T04:25:39.092 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:25:39.168 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T04:25:39.236 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:25:39.391 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-06T04:25:39.515 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T04:25:39.551 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T04:25:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T04:25:39.766 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T04:25:39.917 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T04:25:39.950 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:25:40.085 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:25:40.242 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T04:25:40.347 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T04:25:40.548 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-06T04:25:40.566 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T04:25:40.717 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T04:25:40.751 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T04:25:40.891 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T04:25:41.108 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T04:25:41.393 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T04:25:41.551 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T04:25:41.928 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T04:25:42.117 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T04:25:42.490 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T04:25:42.705 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T04:25:42.916 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T04:25:42.965 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-06T04:25:43.190 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-06T04:25:43.387 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-06T04:25:43.700 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-06T04:25:43.803 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T04:25:44.006 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-06T04:25:44.084 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-06T04:25:44.252 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T04:25:44.310 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-06T04:25:44.400 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 26/122 2023-10-06T04:25:44.490 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-06T04:25:44.573 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 27/122 2023-10-06T04:25:44.758 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-06T04:25:44.843 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 28/122 2023-10-06T04:25:45.116 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-06T04:25:45.382 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T04:25:45.582 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 26/122 2023-10-06T04:25:45.721 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 27/122 2023-10-06T04:25:45.971 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 28/122 2023-10-06T04:25:46.039 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-06T04:25:46.432 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-06T04:25:46.724 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-06T04:25:46.981 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-06T04:25:47.149 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-06T04:25:47.289 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-06T04:25:47.508 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T04:25:47.560 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-06T04:25:47.893 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-06T04:25:48.229 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-06T04:25:48.525 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-06T04:25:48.791 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T04:25:50.065 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T04:25:50.388 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-06T04:25:50.651 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T04:25:50.830 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T04:25:51.057 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 38/122 2023-10-06T04:25:51.243 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T04:25:51.307 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 39/122 2023-10-06T04:25:51.483 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 40/122 2023-10-06T04:25:51.619 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-06T04:25:51.660 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-06T04:25:51.840 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-06T04:25:51.898 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T04:25:52.039 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-06T04:25:52.128 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T04:25:52.270 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-06T04:25:52.346 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 38/122 2023-10-06T04:25:52.417 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-06T04:25:52.591 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 39/122 2023-10-06T04:25:52.636 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-06T04:25:52.762 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 40/122 2023-10-06T04:25:52.849 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-06T04:25:52.947 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-06T04:25:53.113 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-06T04:25:53.219 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-06T04:25:53.327 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-06T04:25:53.515 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-06T04:25:53.518 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-06T04:25:53.689 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-06T04:25:53.797 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-06T04:25:53.939 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-06T04:25:54.129 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-06T04:25:54.160 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-06T04:25:54.392 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-06T04:25:54.496 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-06T04:25:54.593 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-06T04:25:54.782 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-06T04:25:54.788 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-06T04:25:55.007 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-06T04:25:55.074 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-06T04:25:55.183 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T04:25:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T04:25:55.488 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-06T04:25:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-06T04:25:55.697 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-06T04:25:55.774 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-06T04:25:55.862 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T04:25:55.966 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-06T04:25:56.073 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T04:25:56.176 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-06T04:25:56.344 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T04:25:56.353 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-06T04:25:56.543 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T04:25:56.605 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T04:25:56.626 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T04:25:56.793 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T04:25:56.809 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-06T04:25:56.981 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T04:25:57.003 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-06T04:25:57.140 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T04:25:57.193 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T04:25:57.340 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T04:25:57.383 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T04:25:57.564 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T04:25:57.646 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T04:25:57.892 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T04:25:57.922 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T04:25:58.065 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T04:25:58.096 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T04:25:58.204 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T04:25:58.375 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T04:25:58.378 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T04:25:58.581 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T04:25:58.597 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T04:25:58.782 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T04:25:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T04:25:59.014 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T04:25:59.075 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T04:25:59.193 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T04:25:59.370 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T04:25:59.419 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T04:25:59.613 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T04:25:59.778 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T04:25:59.855 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T04:25:59.982 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T04:26:00.072 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T04:26:00.280 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T04:26:00.422 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T04:26:00.683 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T04:26:00.910 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T04:26:01.169 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T04:26:01.776 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T04:26:02.116 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T04:26:02.358 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T04:26:02.582 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T04:26:02.710 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T04:26:02.929 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T04:26:02.995 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T04:26:03.180 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T04:26:03.344 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T04:26:03.511 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T04:26:03.565 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T04:26:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T04:26:03.783 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T04:26:04.015 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T04:26:04.137 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T04:26:04.376 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T04:26:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T04:26:04.839 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T04:26:11.679 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:26:11.929 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:26:12.029 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:26:12.248 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:26:12.626 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:26:12.967 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T04:26:13.309 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T04:26:13.322 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T04:26:13.456 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T04:26:13.512 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T04:26:13.597 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T04:26:13.653 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T04:26:33.265 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T04:26:33.265 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2023-10-06T04:26:33.265 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2023-10-06T04:26:33.265 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /dev 2023-10-06T04:26:33.265 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /run 2023-10-06T04:26:33.266 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2023-10-06T04:26:33.266 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2023-10-06T04:26:33.266 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2023-10-06T04:26:33.266 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2023-10-06T04:26:33.266 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /dev 2023-10-06T04:26:33.266 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:26:33.652 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T04:26:33.774 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T04:26:33.774 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /sys 2023-10-06T04:26:33.774 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /proc 2023-10-06T04:26:33.774 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /dev 2023-10-06T04:26:33.774 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /run 2023-10-06T04:26:33.774 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /mnt 2023-10-06T04:26:33.774 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /var/tmp 2023-10-06T04:26:33.774 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /home 2023-10-06T04:26:33.774 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /tmp 2023-10-06T04:26:33.775 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /dev 2023-10-06T04:26:33.775 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:26:34.170 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T04:26:35.276 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T04:26:35.436 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T04:26:35.708 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T04:26:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T04:26:35.899 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T04:26:36.122 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T04:26:36.361 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T04:26:36.409 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T04:26:36.551 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T04:26:36.591 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T04:26:36.611 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T04:26:37.105 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T04:26:37.278 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T04:26:37.320 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T04:26:40.970 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T04:26:41.208 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T04:26:41.392 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 95/122 2023-10-06T04:26:41.554 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 96/122 2023-10-06T04:26:41.749 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T04:26:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T04:26:42.015 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T04:26:42.092 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T04:26:42.184 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T04:26:42.294 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 95/122 2023-10-06T04:26:42.495 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 96/122 2023-10-06T04:26:42.676 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T04:26:42.956 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T04:26:43.154 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T04:26:43.301 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T04:26:43.458 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T04:26:43.598 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T04:26:43.999 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 100/122 2023-10-06T04:26:44.218 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T04:26:44.286 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T04:26:44.343 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T04:26:44.441 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T04:26:44.468 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T04:26:44.534 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T04:26:44.682 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T04:26:45.136 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 100/122 2023-10-06T04:26:45.371 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T04:26:45.442 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T04:26:45.626 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T04:26:45.654 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T04:26:46.184 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 103/122 2023-10-06T04:26:46.434 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T04:26:46.569 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T04:26:46.716 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T04:26:46.800 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T04:26:46.958 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T04:26:47.368 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T04:26:47.990 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T04:26:47.990 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 103/122 2023-10-06T04:26:47.990 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T04:26:47.990 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T04:26:48.093 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T04:26:48.174 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T04:26:48.343 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T04:26:48.778 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T04:26:49.001 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T04:26:52.963 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T04:26:53.301 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 108/122 2023-10-06T04:26:53.456 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T04:26:54.522 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T04:26:54.753 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T04:26:54.923 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-06T04:26:55.138 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 111/122 2023-10-06T04:26:55.242 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 108/122 2023-10-06T04:26:55.319 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-06T04:26:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T04:26:55.470 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 113/122 2023-10-06T04:26:55.637 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T04:26:55.848 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 115/122 2023-10-06T04:26:56.057 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 116/122 2023-10-06T04:26:56.207 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 117/122 2023-10-06T04:26:56.461 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-06T04:26:56.610 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T04:26:56.647 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T04:26:56.735 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T04:26:56.922 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T04:26:56.945 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T04:26:56.946 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T04:26:56.995 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-06T04:26:57.193 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 111/122 2023-10-06T04:26:57.220 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T04:26:57.220 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:26:57.505 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-06T04:26:57.590 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:26:57.590 INFO:teuthology.orchestra.run.smithi135.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-06T04:26:57.591 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:26:57.648 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 113/122 2023-10-06T04:26:57.790 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T04:26:57.993 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 115/122 2023-10-06T04:26:58.211 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 116/122 2023-10-06T04:26:58.394 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 117/122 2023-10-06T04:26:58.529 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 1/122 2023-10-06T04:26:58.529 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2/122 2023-10-06T04:26:58.529 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 3/122 2023-10-06T04:26:58.529 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/122 2023-10-06T04:26:58.529 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 5/122 2023-10-06T04:26:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:26:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:26:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/122 2023-10-06T04:26:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/122 2023-10-06T04:26:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:26:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 11/122 2023-10-06T04:26:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 12/122 2023-10-06T04:26:58.530 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:26:58.541 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 14/122 2023-10-06T04:26:58.542 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 15/122 2023-10-06T04:26:58.542 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 16/122 2023-10-06T04:26:58.542 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 17/122 2023-10-06T04:26:58.546 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/122 2023-10-06T04:26:58.546 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 19/122 2023-10-06T04:26:58.546 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 20/122 2023-10-06T04:26:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 21/122 2023-10-06T04:26:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 22/122 2023-10-06T04:26:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 23/122 2023-10-06T04:26:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 24/122 2023-10-06T04:26:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 25/122 2023-10-06T04:26:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 26/122 2023-10-06T04:26:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 27/122 2023-10-06T04:26:58.547 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 28/122 2023-10-06T04:26:58.548 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 29/122 2023-10-06T04:26:58.548 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 30/122 2023-10-06T04:26:58.548 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 31/122 2023-10-06T04:26:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 32/122 2023-10-06T04:26:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 33/122 2023-10-06T04:26:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 34/122 2023-10-06T04:26:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 35/122 2023-10-06T04:26:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 36/122 2023-10-06T04:26:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 37/122 2023-10-06T04:26:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 38/122 2023-10-06T04:26:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T04:26:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T04:26:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T04:26:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T04:26:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T04:26:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T04:26:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T04:26:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T04:26:58.550 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T04:26:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T04:26:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T04:26:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T04:26:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T04:26:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T04:26:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T04:26:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T04:26:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T04:26:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T04:26:58.551 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T04:26:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T04:26:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T04:26:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T04:26:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T04:26:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T04:26:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T04:26:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T04:26:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T04:26:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T04:26:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T04:26:58.552 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T04:26:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T04:26:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T04:26:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T04:26:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-06T04:26:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-06T04:26:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-06T04:26:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-06T04:26:58.553 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-06T04:26:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-06T04:26:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-06T04:26:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-06T04:26:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-06T04:26:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-06T04:26:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-06T04:26:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-06T04:26:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-06T04:26:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-06T04:26:58.554 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-06T04:26:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-06T04:26:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-06T04:26:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-06T04:26:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-06T04:26:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-06T04:26:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-06T04:26:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-06T04:26:58.555 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-06T04:26:58.556 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-06T04:26:58.556 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-06T04:26:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-06T04:26:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-06T04:26:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-06T04:26:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-06T04:26:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-06T04:26:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-06T04:26:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-06T04:26:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-06T04:26:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-06T04:26:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-06T04:26:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-06T04:26:58.557 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-06T04:26:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-06T04:26:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-06T04:26:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-06T04:26:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-06T04:26:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-06T04:26:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-06T04:26:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-06T04:26:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-06T04:26:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-06T04:26:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-06T04:26:58.558 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 119/122 2023-10-06T04:26:58.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T04:26:58.559 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 121/122 2023-10-06T04:26:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-06T04:26:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T04:26:58.927 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T04:26:59.068 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T04:26:59.090 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T04:26:59.090 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T04:26:59.364 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T04:26:59.365 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:26:59.723 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:26:59.723 INFO:teuthology.orchestra.run.smithi060.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-06T04:26:59.723 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:00.708 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 1/122 2023-10-06T04:27:00.708 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2/122 2023-10-06T04:27:00.708 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 3/122 2023-10-06T04:27:00.708 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/122 2023-10-06T04:27:00.708 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 5/122 2023-10-06T04:27:00.708 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T04:27:00.708 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T04:27:00.708 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/122 2023-10-06T04:27:00.709 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/122 2023-10-06T04:27:00.709 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T04:27:00.709 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 11/122 2023-10-06T04:27:00.709 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 12/122 2023-10-06T04:27:00.709 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T04:27:00.709 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 14/122 2023-10-06T04:27:00.709 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 15/122 2023-10-06T04:27:00.709 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 16/122 2023-10-06T04:27:00.709 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 17/122 2023-10-06T04:27:00.709 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/122 2023-10-06T04:27:00.709 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 19/122 2023-10-06T04:27:00.710 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 20/122 2023-10-06T04:27:00.710 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 21/122 2023-10-06T04:27:00.710 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 22/122 2023-10-06T04:27:00.710 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 23/122 2023-10-06T04:27:00.710 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 24/122 2023-10-06T04:27:00.710 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 25/122 2023-10-06T04:27:00.710 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 26/122 2023-10-06T04:27:00.710 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 27/122 2023-10-06T04:27:00.710 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 28/122 2023-10-06T04:27:00.718 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 29/122 2023-10-06T04:27:00.718 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 30/122 2023-10-06T04:27:00.718 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 31/122 2023-10-06T04:27:00.719 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 32/122 2023-10-06T04:27:00.719 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 33/122 2023-10-06T04:27:00.719 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 34/122 2023-10-06T04:27:00.719 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 35/122 2023-10-06T04:27:00.719 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 36/122 2023-10-06T04:27:00.719 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 37/122 2023-10-06T04:27:00.719 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 38/122 2023-10-06T04:27:00.719 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T04:27:00.719 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T04:27:00.719 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T04:27:00.719 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T04:27:00.719 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T04:27:00.720 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T04:27:00.720 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T04:27:00.720 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T04:27:00.720 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T04:27:00.720 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T04:27:00.720 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T04:27:00.720 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T04:27:00.721 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T04:27:00.721 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T04:27:00.721 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T04:27:00.721 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T04:27:00.721 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T04:27:00.721 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T04:27:00.721 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T04:27:00.721 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T04:27:00.721 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T04:27:00.721 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T04:27:00.721 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T04:27:00.721 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T04:27:00.722 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T04:27:00.722 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T04:27:00.722 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T04:27:00.722 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T04:27:00.722 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T04:27:00.722 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T04:27:00.722 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T04:27:00.722 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T04:27:00.722 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T04:27:00.722 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-06T04:27:00.722 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-06T04:27:00.722 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-06T04:27:00.723 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-06T04:27:00.723 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-06T04:27:00.723 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-06T04:27:00.723 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-06T04:27:00.723 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-06T04:27:00.723 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-06T04:27:00.723 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-06T04:27:00.723 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-06T04:27:00.723 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-06T04:27:00.723 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-06T04:27:00.723 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-06T04:27:00.723 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-06T04:27:00.723 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-06T04:27:00.724 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-06T04:27:00.724 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-06T04:27:00.724 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-06T04:27:00.724 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-06T04:27:00.724 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-06T04:27:00.724 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-06T04:27:00.724 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-06T04:27:00.724 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-06T04:27:00.724 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-06T04:27:00.724 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-06T04:27:00.724 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-06T04:27:00.724 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-06T04:27:00.725 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-06T04:27:00.725 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-06T04:27:00.725 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-06T04:27:00.725 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-06T04:27:00.725 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-06T04:27:00.725 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-06T04:27:00.725 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-06T04:27:00.725 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-06T04:27:00.725 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-06T04:27:00.725 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-06T04:27:00.725 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-06T04:27:00.725 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-06T04:27:00.726 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-06T04:27:00.726 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-06T04:27:00.726 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-06T04:27:00.726 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-06T04:27:00.726 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-06T04:27:00.726 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-06T04:27:00.726 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-06T04:27:00.726 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 119/122 2023-10-06T04:27:00.726 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T04:27:00.726 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 121/122 2023-10-06T04:27:00.899 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:27:00.899 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:56 ago on Fri 06 Oct 2023 04:25:04 AM UTC. 2023-10-06T04:27:03.013 INFO:teuthology.orchestra.run.smithi135.stdout:Installed products updated. 2023-10-06T04:27:03.133 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T04:27:03.133 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:58 ago on Fri 06 Oct 2023 04:25:05 AM UTC. 2023-10-06T04:27:03.144 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:03.144 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2023-10-06T04:27:03.144 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.145 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.145 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2023-10-06T04:27:03.145 INFO:teuthology.orchestra.run.smithi135.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T04:27:03.145 INFO:teuthology.orchestra.run.smithi135.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T04:27:03.145 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.145 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.145 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.145 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.146 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:27:03.146 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.146 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.146 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.146 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:27:03.146 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:27:03.146 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:27:03.146 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:27:03.146 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:27:03.146 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.147 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.147 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:27:03.147 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.147 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.147 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.147 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:27:03.147 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:27:03.147 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.147 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:27:03.148 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T04:27:03.148 INFO:teuthology.orchestra.run.smithi135.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T04:27:03.148 INFO:teuthology.orchestra.run.smithi135.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T04:27:03.148 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T04:27:03.148 INFO:teuthology.orchestra.run.smithi135.stdout: jq-1.5-12.el8.x86_64 2023-10-06T04:27:03.148 INFO:teuthology.orchestra.run.smithi135.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T04:27:03.148 INFO:teuthology.orchestra.run.smithi135.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T04:27:03.148 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T04:27:03.148 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.149 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.149 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.149 INFO:teuthology.orchestra.run.smithi135.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T04:27:03.149 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T04:27:03.149 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T04:27:03.149 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T04:27:03.149 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T04:27:03.149 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.149 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.150 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T04:27:03.150 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.150 INFO:teuthology.orchestra.run.smithi135.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T04:27:03.150 INFO:teuthology.orchestra.run.smithi135.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T04:27:03.150 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T04:27:03.150 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T04:27:03.150 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T04:27:03.150 INFO:teuthology.orchestra.run.smithi135.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T04:27:03.151 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T04:27:03.151 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T04:27:03.151 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T04:27:03.151 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T04:27:03.151 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T04:27:03.151 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T04:27:03.151 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T04:27:03.151 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T04:27:03.151 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T04:27:03.152 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T04:27:03.152 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T04:27:03.152 INFO:teuthology.orchestra.run.smithi135.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T04:27:03.152 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T04:27:03.152 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.152 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.152 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.152 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T04:27:03.152 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T04:27:03.152 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T04:27:03.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T04:27:03.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T04:27:03.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T04:27:03.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T04:27:03.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T04:27:03.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T04:27:03.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T04:27:03.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T04:27:03.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T04:27:03.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T04:27:03.153 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T04:27:03.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T04:27:03.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T04:27:03.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T04:27:03.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T04:27:03.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T04:27:03.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T04:27:03.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T04:27:03.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T04:27:03.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T04:27:03.154 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T04:27:03.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T04:27:03.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T04:27:03.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T04:27:03.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T04:27:03.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T04:27:03.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T04:27:03.155 INFO:teuthology.orchestra.run.smithi135.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T04:27:03.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T04:27:03.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T04:27:03.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T04:27:03.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T04:27:03.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T04:27:03.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T04:27:03.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T04:27:03.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T04:27:03.156 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T04:27:03.156 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.157 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.157 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:03.157 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T04:27:03.157 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T04:27:03.157 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T04:27:03.157 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T04:27:03.158 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T04:27:03.158 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:03.158 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-10-06T04:27:03.468 DEBUG:teuthology.parallel:result is None 2023-10-06T04:27:05.241 INFO:teuthology.orchestra.run.smithi060.stdout:Installed products updated. 2023-10-06T04:27:05.378 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:05.378 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2023-10-06T04:27:05.378 INFO:teuthology.orchestra.run.smithi060.stdout: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.379 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.379 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-06T04:27:05.379 INFO:teuthology.orchestra.run.smithi060.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T04:27:05.379 INFO:teuthology.orchestra.run.smithi060.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T04:27:05.379 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.379 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.380 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.380 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.380 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:27:05.380 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.380 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.380 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.381 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:27:05.381 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:27:05.381 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:27:05.381 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:27:05.381 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:27:05.382 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.382 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.382 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:27:05.382 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.382 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.383 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.383 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:27:05.383 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:27:05.383 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.383 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T04:27:05.383 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T04:27:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T04:27:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T04:27:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T04:27:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: jq-1.5-12.el8.x86_64 2023-10-06T04:27:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T04:27:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T04:27:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T04:27:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.385 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.385 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.385 INFO:teuthology.orchestra.run.smithi060.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T04:27:05.385 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T04:27:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T04:27:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T04:27:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T04:27:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T04:27:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T04:27:05.387 INFO:teuthology.orchestra.run.smithi060.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T04:27:05.387 INFO:teuthology.orchestra.run.smithi060.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T04:27:05.387 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T04:27:05.387 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T04:27:05.387 INFO:teuthology.orchestra.run.smithi060.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T04:27:05.387 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T04:27:05.387 INFO:teuthology.orchestra.run.smithi060.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T04:27:05.388 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T04:27:05.388 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T04:27:05.388 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T04:27:05.388 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T04:27:05.388 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T04:27:05.388 INFO:teuthology.orchestra.run.smithi060.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T04:27:05.388 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T04:27:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T04:27:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T04:27:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T04:27:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T04:27:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T04:27:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T04:27:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T04:27:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T04:27:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T04:27:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T04:27:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T04:27:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T04:27:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T04:27:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T04:27:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T04:27:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T04:27:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T04:27:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T04:27:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T04:27:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T04:27:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T04:27:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T04:27:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T04:27:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T04:27:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T04:27:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T04:27:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T04:27:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T04:27:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T04:27:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T04:27:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T04:27:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T04:27:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T04:27:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T04:27:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T04:27:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T04:27:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T04:27:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T04:27:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T04:27:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T04:27:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T04:27:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T04:27:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T04:27:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T04:27:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T04:27:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T04:27:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T04:27:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T04:27:05.394 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T04:27:05.394 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T04:27:05.394 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:05.394 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-06T04:27:05.697 DEBUG:teuthology.parallel:result is None 2023-10-06T04:27:05.698 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:27:05.839 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T04:27:05.889 INFO:teuthology.orchestra.run.smithi060.stdout:17.2.6-1274.g68e53a4a.el8 2023-10-06T04:27:05.890 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274.g68e53a4a.el8 2023-10-06T04:27:05.890 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274.g68e53a4a is installed. 2023-10-06T04:27:05.890 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T04:27:06.032 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T04:27:06.080 INFO:teuthology.orchestra.run.smithi135.stdout:17.2.6-1274.g68e53a4a.el8 2023-10-06T04:27:06.080 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274.g68e53a4a.el8 2023-10-06T04:27:06.080 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274.g68e53a4a is installed. 2023-10-06T04:27:06.081 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T04:27:06.081 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:06.081 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T04:27:06.170 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:06.170 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T04:27:06.256 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T04:27:06.256 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:06.256 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T04:27:06.318 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T04:27:06.421 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:06.421 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T04:27:06.483 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T04:27:06.583 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T04:27:06.584 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:06.584 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T04:27:06.646 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T04:27:06.751 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:06.751 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T04:27:06.812 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T04:27:06.913 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T04:27:06.913 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:06.913 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T04:27:06.978 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T04:27:07.081 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:07.082 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T04:27:07.143 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T04:27:07.243 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T04:27:07.312 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T04:27:07.312 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 777 /var/log/ceph 2023-10-06T04:27:07.317 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /var/log/ceph 2023-10-06T04:27:07.376 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T04:27:07.376 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T04:27:07.380 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T04:27:07.439 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T04:27:07.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T04:27:07.443 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T04:27:07.511 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T04:27:07.511 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T04:27:07.511 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T04:27:07.511 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:07.512 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T04:27:07.547 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T04:27:08.074 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T04:27:08.138 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:08.139 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T04:27:08.178 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T04:27:08.383 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T04:27:08.449 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T04:27:08.449 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T04:27:08.449 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412260', 'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412260', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4002, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'targets': {'smithi060.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMVOnWzSqUPydJV3XCwvfYgNl6e6b5Jw6JKDCvniUJDn9u8TBV3JlpyRnzOsbda1moAJgq/s42Y4Uiiv5riGegQ=', 'smithi135.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGYm5XCchr5cYsUBiHMbdCdN7DT6uOWCv3DehH55x9W3V7CcFFddTd9K6VQM6WlY72JboXRbPAGGu8Hp4ADsufg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_acls']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:54:57', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T04:27:08.450 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T04:27:08.454 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T04:27:08.491 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T04:27:08.533 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T04:27:08.594 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:08.594 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T04:27:08.630 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T04:27:08.631 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 2023-10-06T04:27:08.709 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T04:27:08.710 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:27:08.710 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-10-06T04:27:08.710 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:27:08.710 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:27:08.710 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-06 04:27:00.063645993 +0000 2023-10-06T04:27:08.710 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-06 04:24:09.769876626 +0000 2023-10-06T04:27:08.710 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-06 04:24:09.769876626 +0000 2023-10-06T04:27:08.710 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2023-10-06T04:27:08.711 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T04:27:08.808 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-10-06T04:27:08.809 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-10-06T04:27:08.809 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000247226 s, 2.1 MB/s 2023-10-06T04:27:08.811 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T04:27:08.849 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 2023-10-06T04:27:08.928 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T04:27:08.928 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:27:08.929 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-10-06T04:27:08.929 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:27:08.929 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:27:08.929 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-06 04:27:00.063645993 +0000 2023-10-06T04:27:08.929 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-06 04:24:10.558869840 +0000 2023-10-06T04:27:08.929 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-06 04:24:10.558869840 +0000 2023-10-06T04:27:08.929 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2023-10-06T04:27:08.929 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T04:27:09.028 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-10-06T04:27:09.028 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-10-06T04:27:09.029 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.00020599 s, 2.5 MB/s 2023-10-06T04:27:09.031 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T04:27:09.069 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 2023-10-06T04:27:09.146 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T04:27:09.147 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:27:09.147 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-10-06T04:27:09.147 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:27:09.147 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:27:09.147 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-06 04:27:00.063645993 +0000 2023-10-06T04:27:09.147 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-06 04:24:11.325863244 +0000 2023-10-06T04:27:09.147 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-06 04:24:11.325863244 +0000 2023-10-06T04:27:09.147 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2023-10-06T04:27:09.147 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T04:27:09.245 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-10-06T04:27:09.246 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-10-06T04:27:09.246 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000184619 s, 2.8 MB/s 2023-10-06T04:27:09.248 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T04:27:09.286 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 2023-10-06T04:27:09.365 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T04:27:09.365 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:27:09.365 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-10-06T04:27:09.365 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:27:09.365 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:27:09.365 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2023-10-06 04:27:00.063645993 +0000 2023-10-06T04:27:09.365 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2023-10-06 04:24:12.134856286 +0000 2023-10-06T04:27:09.365 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2023-10-06 04:24:12.134856286 +0000 2023-10-06T04:27:09.365 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2023-10-06T04:27:09.366 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T04:27:09.467 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2023-10-06T04:27:09.467 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2023-10-06T04:27:09.467 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000181694 s, 2.8 MB/s 2023-10-06T04:27:09.468 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T04:27:09.507 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:27:09.507 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:09.507 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T04:27:09.547 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T04:27:09.547 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2023-10-06T04:27:09.627 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T04:27:09.627 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:27:09.627 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-10-06T04:27:09.627 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:27:09.627 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:27:09.627 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-10-06 04:26:57.923369591 +0000 2023-10-06T04:27:09.627 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-10-06 04:23:53.936907611 +0000 2023-10-06T04:27:09.628 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-10-06 04:23:53.936907611 +0000 2023-10-06T04:27:09.628 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2023-10-06T04:27:09.628 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T04:27:09.727 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-10-06T04:27:09.728 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-10-06T04:27:09.728 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000363736 s, 1.4 MB/s 2023-10-06T04:27:09.731 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T04:27:09.769 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2023-10-06T04:27:09.846 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T04:27:09.846 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:27:09.846 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-10-06T04:27:09.847 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:27:09.847 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:27:09.847 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-10-06 04:26:57.923369591 +0000 2023-10-06T04:27:09.847 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-10-06 04:23:54.731891499 +0000 2023-10-06T04:27:09.847 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-10-06 04:23:54.731891499 +0000 2023-10-06T04:27:09.847 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2023-10-06T04:27:09.847 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T04:27:09.944 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-10-06T04:27:09.944 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-10-06T04:27:09.944 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000301703 s, 1.7 MB/s 2023-10-06T04:27:09.947 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T04:27:09.984 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2023-10-06T04:27:10.061 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T04:27:10.061 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:27:10.061 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-10-06T04:27:10.061 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:27:10.061 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:27:10.061 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-10-06 04:26:57.923369591 +0000 2023-10-06T04:27:10.061 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-10-06 04:23:55.500875914 +0000 2023-10-06T04:27:10.062 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-10-06 04:23:55.500875914 +0000 2023-10-06T04:27:10.062 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2023-10-06T04:27:10.062 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T04:27:10.158 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-10-06T04:27:10.158 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-10-06T04:27:10.158 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000302824 s, 1.7 MB/s 2023-10-06T04:27:10.161 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T04:27:10.199 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2023-10-06T04:27:10.275 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T04:27:10.276 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T04:27:10.276 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-10-06T04:27:10.276 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T04:27:10.276 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T04:27:10.276 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-10-06 04:26:57.923369591 +0000 2023-10-06T04:27:10.276 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-10-06 04:23:56.277860167 +0000 2023-10-06T04:27:10.276 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-10-06 04:23:56.277860167 +0000 2023-10-06T04:27:10.276 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2023-10-06T04:27:10.277 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T04:27:10.372 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-10-06T04:27:10.372 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-10-06T04:27:10.372 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000318205 s, 1.6 MB/s 2023-10-06T04:27:10.374 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T04:27:10.412 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:27:10.412 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi060.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T04:27:10.412 INFO:tasks.ceph:Generating config... 2023-10-06T04:27:10.413 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T04:27:10.413 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T04:27:10.414 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T04:27:10.414 INFO:tasks.ceph:[client] pid file = 2023-10-06T04:27:10.414 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T04:27:10.414 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T04:27:10.414 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-06T04:27:10.414 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T04:27:10.414 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T04:27:10.414 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T04:27:10.414 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T04:27:10.414 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T04:27:10.414 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T04:27:10.414 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T04:27:10.415 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T04:27:10.415 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T04:27:10.415 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T04:27:10.415 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T04:27:10.415 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T04:27:10.415 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T04:27:10.415 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T04:27:10.415 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T04:27:10.415 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T04:27:10.415 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T04:27:10.415 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-06T04:27:10.415 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-06T04:27:10.416 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T04:27:10.416 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T04:27:10.416 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-06T04:27:10.416 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T04:27:10.416 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T04:27:10.416 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T04:27:10.416 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T04:27:10.416 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T04:27:10.416 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T04:27:10.416 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T04:27:10.417 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T04:27:10.515 INFO:teuthology.orchestra.run.smithi060.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T04:27:10.521 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T04:27:10.609 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:27:10.670 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.60'), ('mon.b', '172.21.15.135'), ('mon.c', '[v2:172.21.15.135:3301,v1:172.21.15.135:6790]')] 2023-10-06T04:27:10.671 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.60,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T04:27:10.672 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:10.672 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T04:27:10.707 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.60 --add b 172.21.15.135 --addv c '[v2:172.21.15.135:3301,v1:172.21.15.135:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:27:10.822 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:27:10.822 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: generated fsid caf6a2b8-149e-4228-9a04-404e2d811afd 2023-10-06T04:27:10.822 INFO:teuthology.orchestra.run.smithi060.stdout:setting min_mon_release = octopus 2023-10-06T04:27:10.822 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 0 2023-10-06T04:27:10.822 INFO:teuthology.orchestra.run.smithi060.stdout:fsid caf6a2b8-149e-4228-9a04-404e2d811afd 2023-10-06T04:27:10.822 INFO:teuthology.orchestra.run.smithi060.stdout:last_changed 2023-10-06T04:27:10.821300+0000 2023-10-06T04:27:10.822 INFO:teuthology.orchestra.run.smithi060.stdout:created 2023-10-06T04:27:10.821300+0000 2023-10-06T04:27:10.823 INFO:teuthology.orchestra.run.smithi060.stdout:min_mon_release 15 (octopus) 2023-10-06T04:27:10.823 INFO:teuthology.orchestra.run.smithi060.stdout:election_strategy: 1 2023-10-06T04:27:10.823 INFO:teuthology.orchestra.run.smithi060.stdout:0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2023-10-06T04:27:10.823 INFO:teuthology.orchestra.run.smithi060.stdout:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2023-10-06T04:27:10.823 INFO:teuthology.orchestra.run.smithi060.stdout:2: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.c 2023-10-06T04:27:10.823 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T04:27:10.824 DEBUG:teuthology.orchestra.run.smithi060:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T04:27:10.859 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID caf6a2b8-149e-4228-9a04-404e2d811afd... 2023-10-06T04:27:10.861 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T04:27:10.905 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T04:27:11.013 INFO:teuthology.orchestra.run.smithi060.stdout:[global] 2023-10-06T04:27:11.013 INFO:teuthology.orchestra.run.smithi060.stdout: chdir = "" 2023-10-06T04:27:11.013 INFO:teuthology.orchestra.run.smithi060.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T04:27:11.014 INFO:teuthology.orchestra.run.smithi060.stdout: auth supported = cephx 2023-10-06T04:27:11.014 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.014 INFO:teuthology.orchestra.run.smithi060.stdout: filestore xattr use omap = true 2023-10-06T04:27:11.014 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.014 INFO:teuthology.orchestra.run.smithi060.stdout: mon clock drift allowed = 1.000 2023-10-06T04:27:11.014 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.014 INFO:teuthology.orchestra.run.smithi060.stdout: osd crush chooseleaf type = 0 2023-10-06T04:27:11.014 INFO:teuthology.orchestra.run.smithi060.stdout: auth debug = true 2023-10-06T04:27:11.014 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.014 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on old message = true 2023-10-06T04:27:11.015 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on bug = true 2023-10-06T04:27:11.015 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.015 INFO:teuthology.orchestra.run.smithi060.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T04:27:11.015 INFO:teuthology.orchestra.run.smithi060.stdout: mon pg warn max object skew = 0 2023-10-06T04:27:11.015 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.015 INFO:teuthology.orchestra.run.smithi060.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T04:27:11.015 INFO:teuthology.orchestra.run.smithi060.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T04:27:11.015 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.015 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default size = 2 2023-10-06T04:27:11.015 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.016 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow primary affinity = true 2023-10-06T04:27:11.016 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow pg remap = true 2023-10-06T04:27:11.016 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on legacy crush tunables = false 2023-10-06T04:27:11.016 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on crush straw calc version zero = false 2023-10-06T04:27:11.016 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on no sortbitwise = false 2023-10-06T04:27:11.016 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on osd down out interval zero = false 2023-10-06T04:27:11.016 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on too few osds = false 2023-10-06T04:27:11.016 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T04:27:11.016 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T04:27:11.016 INFO:teuthology.orchestra.run.smithi060.stdout: mon_allow_pool_size_one = true 2023-10-06T04:27:11.017 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.017 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T04:27:11.017 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.017 INFO:teuthology.orchestra.run.smithi060.stdout: osd default data pool replay window = 5 2023-10-06T04:27:11.017 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.017 INFO:teuthology.orchestra.run.smithi060.stdout: mon allow pool delete = true 2023-10-06T04:27:11.017 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.017 INFO:teuthology.orchestra.run.smithi060.stdout: mon cluster log file level = debug 2023-10-06T04:27:11.017 INFO:teuthology.orchestra.run.smithi060.stdout: debug asserts on shutdown = true 2023-10-06T04:27:11.017 INFO:teuthology.orchestra.run.smithi060.stdout: mon health detail to clog = false 2023-10-06T04:27:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: mon host = "172.21.15.60,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]" 2023-10-06T04:27:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on skipped message = False 2023-10-06T04:27:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: fsid = caf6a2b8-149e-4228-9a04-404e2d811afd 2023-10-06T04:27:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.018 INFO:teuthology.orchestra.run.smithi060.stdout:[osd] 2023-10-06T04:27:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: osd journal size = 100 2023-10-06T04:27:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub load threshold = 5.0 2023-10-06T04:27:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub max interval = 600 2023-10-06T04:27:11.018 INFO:teuthology.orchestra.run.smithi060.stdout: osd mclock profile = high_recovery_ops 2023-10-06T04:27:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: osd recover clone overlap = true 2023-10-06T04:27:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: osd recovery max chunk = 1048576 2023-10-06T04:27:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug shutdown = true 2023-10-06T04:27:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug op order = true 2023-10-06T04:27:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug verify stray on activate = true 2023-10-06T04:27:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: osd open classes on start = true 2023-10-06T04:27:11.019 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug pg log writeout = true 2023-10-06T04:27:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: osd deep scrub update digest min age = 30 2023-10-06T04:27:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: osd map max advance = 10 2023-10-06T04:27:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: journal zero on create = true 2023-10-06T04:27:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: filestore ondisk finisher threads = 3 2023-10-06T04:27:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: filestore apply finisher threads = 3 2023-10-06T04:27:11.020 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: bdev debug aio = true 2023-10-06T04:27:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug misdirected ops = true 2023-10-06T04:27:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore block size = 96636764160 2023-10-06T04:27:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore fsck on mount = True 2023-10-06T04:27:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluefs = 20 2023-10-06T04:27:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluestore = 20 2023-10-06T04:27:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2023-10-06T04:27:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: debug osd = 20 2023-10-06T04:27:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: debug rocksdb = 10 2023-10-06T04:27:11.021 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T04:27:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd full ratio = 0.9 2023-10-06T04:27:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd nearfull ratio = 0.8 2023-10-06T04:27:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: osd failsafe full ratio = 0.95 2023-10-06T04:27:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: osd objectstore = bluestore 2023-10-06T04:27:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: osd op complaint time = 180 2023-10-06T04:27:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.022 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr] 2023-10-06T04:27:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2023-10-06T04:27:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: debug mgr = 20 2023-10-06T04:27:11.022 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2023-10-06T04:27:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2023-10-06T04:27:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:27:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:27:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: mgr/telemetry/nag = false 2023-10-06T04:27:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.023 INFO:teuthology.orchestra.run.smithi060.stdout:[mon] 2023-10-06T04:27:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2023-10-06T04:27:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2023-10-06T04:27:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: debug paxos = 20 2023-10-06T04:27:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2023-10-06T04:27:11.023 INFO:teuthology.orchestra.run.smithi060.stdout: mon data avail warn = 5 2023-10-06T04:27:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: mon mgr mkfs grace = 240 2023-10-06T04:27:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:27:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd reporter subtree level = osd 2023-10-06T04:27:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd prime pg temp = true 2023-10-06T04:27:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:27:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T04:27:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T04:27:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T04:27:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T04:27:11.024 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T04:27:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T04:27:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: # 1m isn't quite enough 2023-10-06T04:27:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: mon_down_mkfs_grace = 2m 2023-10-06T04:27:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_filestore_osds = false 2023-10-06T04:27:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: mon op complaint time = 120 2023-10-06T04:27:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:11.025 INFO:teuthology.orchestra.run.smithi060.stdout:[client] 2023-10-06T04:27:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: rgw cache enabled = true 2023-10-06T04:27:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable ops log = true 2023-10-06T04:27:11.025 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable usage log = true 2023-10-06T04:27:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T04:27:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T04:27:11.026 INFO:teuthology.orchestra.run.smithi060.stdout: client mount timeout = 600 2023-10-06T04:27:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: debug client = 20 2023-10-06T04:27:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2023-10-06T04:27:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: pid file = "" 2023-10-06T04:27:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: rados mon op timeout = 900 2023-10-06T04:27:11.027 INFO:teuthology.orchestra.run.smithi060.stdout: rados osd op timeout = 900 2023-10-06T04:27:11.027 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.a] 2023-10-06T04:27:11.027 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.b] 2023-10-06T04:27:11.027 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.c] 2023-10-06T04:27:11.028 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.a] 2023-10-06T04:27:11.028 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.c] 2023-10-06T04:27:11.028 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.b] 2023-10-06T04:27:11.028 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.d] 2023-10-06T04:27:11.028 INFO:teuthology.orchestra.run.smithi060.stdout:[mds] 2023-10-06T04:27:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: debug mds = 20 2023-10-06T04:27:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2023-10-06T04:27:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: mds debug frag = True 2023-10-06T04:27:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: mds debug scatterstat = True 2023-10-06T04:27:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: mds op complaint time = 180 2023-10-06T04:27:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: mds verify scatter = True 2023-10-06T04:27:11.028 INFO:teuthology.orchestra.run.smithi060.stdout: osd op complaint time = 180 2023-10-06T04:27:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: rados mon op timeout = 900 2023-10-06T04:27:11.029 INFO:teuthology.orchestra.run.smithi060.stdout: rados osd op timeout = 900 2023-10-06T04:27:11.029 INFO:teuthology.orchestra.run.smithi135.stdout:[global] 2023-10-06T04:27:11.029 INFO:teuthology.orchestra.run.smithi135.stdout: chdir = "" 2023-10-06T04:27:11.030 INFO:teuthology.orchestra.run.smithi135.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T04:27:11.030 INFO:teuthology.orchestra.run.smithi135.stdout: auth supported = cephx 2023-10-06T04:27:11.030 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.030 INFO:teuthology.orchestra.run.smithi135.stdout: filestore xattr use omap = true 2023-10-06T04:27:11.030 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.030 INFO:teuthology.orchestra.run.smithi135.stdout: mon clock drift allowed = 1.000 2023-10-06T04:27:11.030 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.030 INFO:teuthology.orchestra.run.smithi135.stdout: osd crush chooseleaf type = 0 2023-10-06T04:27:11.031 INFO:teuthology.orchestra.run.smithi135.stdout: auth debug = true 2023-10-06T04:27:11.031 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.031 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on old message = true 2023-10-06T04:27:11.031 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on bug = true 2023-10-06T04:27:11.031 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.031 INFO:teuthology.orchestra.run.smithi135.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T04:27:11.031 INFO:teuthology.orchestra.run.smithi135.stdout: mon pg warn max object skew = 0 2023-10-06T04:27:11.031 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.031 INFO:teuthology.orchestra.run.smithi135.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T04:27:11.031 INFO:teuthology.orchestra.run.smithi135.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T04:27:11.031 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.031 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default size = 2 2023-10-06T04:27:11.032 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.032 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow primary affinity = true 2023-10-06T04:27:11.032 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow pg remap = true 2023-10-06T04:27:11.032 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on legacy crush tunables = false 2023-10-06T04:27:11.032 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on crush straw calc version zero = false 2023-10-06T04:27:11.032 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on no sortbitwise = false 2023-10-06T04:27:11.032 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on osd down out interval zero = false 2023-10-06T04:27:11.032 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on too few osds = false 2023-10-06T04:27:11.032 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T04:27:11.032 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T04:27:11.032 INFO:teuthology.orchestra.run.smithi135.stdout: mon_allow_pool_size_one = true 2023-10-06T04:27:11.032 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.033 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T04:27:11.033 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.033 INFO:teuthology.orchestra.run.smithi135.stdout: osd default data pool replay window = 5 2023-10-06T04:27:11.033 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.033 INFO:teuthology.orchestra.run.smithi135.stdout: mon allow pool delete = true 2023-10-06T04:27:11.033 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.033 INFO:teuthology.orchestra.run.smithi135.stdout: mon cluster log file level = debug 2023-10-06T04:27:11.033 INFO:teuthology.orchestra.run.smithi135.stdout: debug asserts on shutdown = true 2023-10-06T04:27:11.033 INFO:teuthology.orchestra.run.smithi135.stdout: mon health detail to clog = false 2023-10-06T04:27:11.033 INFO:teuthology.orchestra.run.smithi135.stdout: mon host = "172.21.15.60,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]" 2023-10-06T04:27:11.034 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on skipped message = False 2023-10-06T04:27:11.034 INFO:teuthology.orchestra.run.smithi135.stdout: fsid = caf6a2b8-149e-4228-9a04-404e2d811afd 2023-10-06T04:27:11.034 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.034 INFO:teuthology.orchestra.run.smithi135.stdout:[osd] 2023-10-06T04:27:11.034 INFO:teuthology.orchestra.run.smithi135.stdout: osd journal size = 100 2023-10-06T04:27:11.034 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.034 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub load threshold = 5.0 2023-10-06T04:27:11.034 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub max interval = 600 2023-10-06T04:27:11.034 INFO:teuthology.orchestra.run.smithi135.stdout: osd mclock profile = high_recovery_ops 2023-10-06T04:27:11.035 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.035 INFO:teuthology.orchestra.run.smithi135.stdout: osd recover clone overlap = true 2023-10-06T04:27:11.035 INFO:teuthology.orchestra.run.smithi135.stdout: osd recovery max chunk = 1048576 2023-10-06T04:27:11.035 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.035 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug shutdown = true 2023-10-06T04:27:11.035 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug op order = true 2023-10-06T04:27:11.035 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug verify stray on activate = true 2023-10-06T04:27:11.035 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.035 INFO:teuthology.orchestra.run.smithi135.stdout: osd open classes on start = true 2023-10-06T04:27:11.035 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug pg log writeout = true 2023-10-06T04:27:11.035 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.036 INFO:teuthology.orchestra.run.smithi135.stdout: osd deep scrub update digest min age = 30 2023-10-06T04:27:11.036 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.036 INFO:teuthology.orchestra.run.smithi135.stdout: osd map max advance = 10 2023-10-06T04:27:11.036 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.036 INFO:teuthology.orchestra.run.smithi135.stdout: journal zero on create = true 2023-10-06T04:27:11.036 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.036 INFO:teuthology.orchestra.run.smithi135.stdout: filestore ondisk finisher threads = 3 2023-10-06T04:27:11.036 INFO:teuthology.orchestra.run.smithi135.stdout: filestore apply finisher threads = 3 2023-10-06T04:27:11.036 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.036 INFO:teuthology.orchestra.run.smithi135.stdout: bdev debug aio = true 2023-10-06T04:27:11.036 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug misdirected ops = true 2023-10-06T04:27:11.037 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore block size = 96636764160 2023-10-06T04:27:11.037 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore fsck on mount = True 2023-10-06T04:27:11.037 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluefs = 20 2023-10-06T04:27:11.038 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluestore = 20 2023-10-06T04:27:11.038 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-10-06T04:27:11.038 INFO:teuthology.orchestra.run.smithi135.stdout: debug osd = 20 2023-10-06T04:27:11.041 INFO:teuthology.orchestra.run.smithi135.stdout: debug rocksdb = 10 2023-10-06T04:27:11.041 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T04:27:11.042 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd full ratio = 0.9 2023-10-06T04:27:11.042 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd nearfull ratio = 0.8 2023-10-06T04:27:11.042 INFO:teuthology.orchestra.run.smithi135.stdout: osd failsafe full ratio = 0.95 2023-10-06T04:27:11.042 INFO:teuthology.orchestra.run.smithi135.stdout: osd objectstore = bluestore 2023-10-06T04:27:11.042 INFO:teuthology.orchestra.run.smithi135.stdout: osd op complaint time = 180 2023-10-06T04:27:11.042 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.042 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr] 2023-10-06T04:27:11.042 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-10-06T04:27:11.043 INFO:teuthology.orchestra.run.smithi135.stdout: debug mgr = 20 2023-10-06T04:27:11.043 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2023-10-06T04:27:11.043 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2023-10-06T04:27:11.043 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:27:11.043 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:27:11.044 INFO:teuthology.orchestra.run.smithi135.stdout: mgr/telemetry/nag = false 2023-10-06T04:27:11.044 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.044 INFO:teuthology.orchestra.run.smithi135.stdout:[mon] 2023-10-06T04:27:11.044 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-10-06T04:27:11.044 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2023-10-06T04:27:11.044 INFO:teuthology.orchestra.run.smithi135.stdout: debug paxos = 20 2023-10-06T04:27:11.044 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2023-10-06T04:27:11.044 INFO:teuthology.orchestra.run.smithi135.stdout: mon data avail warn = 5 2023-10-06T04:27:11.044 INFO:teuthology.orchestra.run.smithi135.stdout: mon mgr mkfs grace = 240 2023-10-06T04:27:11.044 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2023-10-06T04:27:11.044 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd reporter subtree level = osd 2023-10-06T04:27:11.044 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd prime pg temp = true 2023-10-06T04:27:11.045 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2023-10-06T04:27:11.045 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.045 INFO:teuthology.orchestra.run.smithi135.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T04:27:11.045 INFO:teuthology.orchestra.run.smithi135.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T04:27:11.045 INFO:teuthology.orchestra.run.smithi135.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T04:27:11.045 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.045 INFO:teuthology.orchestra.run.smithi135.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T04:27:11.045 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T04:27:11.045 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T04:27:11.045 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.045 INFO:teuthology.orchestra.run.smithi135.stdout: # 1m isn't quite enough 2023-10-06T04:27:11.045 INFO:teuthology.orchestra.run.smithi135.stdout: mon_down_mkfs_grace = 2m 2023-10-06T04:27:11.046 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.046 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_filestore_osds = false 2023-10-06T04:27:11.046 INFO:teuthology.orchestra.run.smithi135.stdout: mon op complaint time = 120 2023-10-06T04:27:11.046 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-10-06T04:27:11.046 INFO:teuthology.orchestra.run.smithi135.stdout:[client] 2023-10-06T04:27:11.046 INFO:teuthology.orchestra.run.smithi135.stdout: rgw cache enabled = true 2023-10-06T04:27:11.046 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable ops log = true 2023-10-06T04:27:11.046 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable usage log = true 2023-10-06T04:27:11.046 INFO:teuthology.orchestra.run.smithi135.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T04:27:11.046 INFO:teuthology.orchestra.run.smithi135.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T04:27:11.046 INFO:teuthology.orchestra.run.smithi135.stdout: client mount timeout = 600 2023-10-06T04:27:11.047 INFO:teuthology.orchestra.run.smithi135.stdout: debug client = 20 2023-10-06T04:27:11.047 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-10-06T04:27:11.047 INFO:teuthology.orchestra.run.smithi135.stdout: pid file = "" 2023-10-06T04:27:11.047 INFO:teuthology.orchestra.run.smithi135.stdout: rados mon op timeout = 900 2023-10-06T04:27:11.047 INFO:teuthology.orchestra.run.smithi135.stdout: rados osd op timeout = 900 2023-10-06T04:27:11.047 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.a] 2023-10-06T04:27:11.047 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.b] 2023-10-06T04:27:11.048 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.c] 2023-10-06T04:27:11.048 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a] 2023-10-06T04:27:11.048 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c] 2023-10-06T04:27:11.048 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b] 2023-10-06T04:27:11.048 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d] 2023-10-06T04:27:11.048 INFO:teuthology.orchestra.run.smithi135.stdout:[mds] 2023-10-06T04:27:11.048 INFO:teuthology.orchestra.run.smithi135.stdout: debug mds = 20 2023-10-06T04:27:11.048 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2023-10-06T04:27:11.048 INFO:teuthology.orchestra.run.smithi135.stdout: mds debug frag = True 2023-10-06T04:27:11.048 INFO:teuthology.orchestra.run.smithi135.stdout: mds debug scatterstat = True 2023-10-06T04:27:11.050 INFO:teuthology.orchestra.run.smithi135.stdout: mds op complaint time = 180 2023-10-06T04:27:11.050 INFO:teuthology.orchestra.run.smithi135.stdout: mds verify scatter = True 2023-10-06T04:27:11.050 INFO:teuthology.orchestra.run.smithi135.stdout: osd op complaint time = 180 2023-10-06T04:27:11.050 INFO:teuthology.orchestra.run.smithi135.stdout: rados mon op timeout = 900 2023-10-06T04:27:11.050 INFO:teuthology.orchestra.run.smithi135.stdout: rados osd op timeout = 900 2023-10-06T04:27:11.052 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T04:27:11.052 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T04:27:11.155 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T04:27:11.155 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:11.155 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T04:27:11.191 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:11.191 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T04:27:11.266 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi060.front.sepia.ceph.com 2023-10-06T04:27:11.267 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:11.267 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T04:27:11.267 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:27:11.395 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:11.395 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:27:11.471 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi135.front.sepia.ceph.com 2023-10-06T04:27:11.471 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:11.471 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T04:27:11.471 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T04:27:11.559 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:11.560 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:27:11.635 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T04:27:11.635 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T04:27:11.635 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T04:27:11.747 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T04:27:11.752 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T04:27:11.869 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T04:27:11.874 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T04:27:11.875 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T04:27:11.986 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T04:27:11.991 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T04:27:12.053 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T04:27:12.163 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T04:27:12.168 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T04:27:12.229 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T04:27:12.340 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T04:27:12.345 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T04:27:12.406 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T04:27:12.514 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T04:27:12.519 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T04:27:12.578 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T04:27:12.579 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T04:27:12.664 INFO:teuthology.orchestra.run.smithi060.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T04:27:12.695 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T04:27:12.779 INFO:teuthology.orchestra.run.smithi060.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T04:27:12.811 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T04:27:12.895 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T04:27:12.925 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T04:27:13.007 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T04:27:13.038 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T04:27:13.038 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi060.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T04:27:13.038 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T04:27:13.102 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:27:13.102 INFO:tasks.ceph:role: osd.0 2023-10-06T04:27:13.103 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi060.front.sepia.ceph.com 2023-10-06T04:27:13.103 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T04:27:13.164 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:27:13.164 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:27:13.164 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:27:13.164 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 2023-10-06T04:27:13.164 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:27:13.164 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:27:13.164 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:27:13.164 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:27:13.165 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:27:13.165 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:27:13.187 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2023-10-06T04:27:13.192 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2023-10-06T04:27:13.192 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T04:27:13.293 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T04:27:13.361 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T04:27:13.423 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:27:13.423 INFO:tasks.ceph:role: osd.1 2023-10-06T04:27:13.423 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi060.front.sepia.ceph.com 2023-10-06T04:27:13.423 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T04:27:13.484 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:27:13.484 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:27:13.484 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:27:13.484 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 2023-10-06T04:27:13.485 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:27:13.485 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:27:13.485 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:27:13.485 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:27:13.485 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:27:13.485 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:27:13.510 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2023-10-06T04:27:13.512 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2023-10-06T04:27:13.512 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T04:27:13.609 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T04:27:13.677 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T04:27:13.739 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:27:13.739 INFO:tasks.ceph:role: osd.2 2023-10-06T04:27:13.739 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi060.front.sepia.ceph.com 2023-10-06T04:27:13.739 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T04:27:13.800 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:27:13.800 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:27:13.800 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:27:13.800 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 2023-10-06T04:27:13.801 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:27:13.801 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:27:13.801 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:27:13.801 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:27:13.801 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:27:13.801 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:27:13.823 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2023-10-06T04:27:13.828 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2023-10-06T04:27:13.828 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T04:27:13.925 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T04:27:13.994 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T04:27:14.055 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T04:27:14.056 INFO:tasks.ceph:role: osd.3 2023-10-06T04:27:14.056 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi060.front.sepia.ceph.com 2023-10-06T04:27:14.056 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T04:27:14.116 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:27:14.116 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:27:14.116 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:27:14.117 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 2023-10-06T04:27:14.117 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:27:14.117 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:27:14.117 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:27:14.117 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:27:14.117 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:27:14.117 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:27:14.139 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2023-10-06T04:27:14.143 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2023-10-06T04:27:14.143 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T04:27:14.241 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T04:27:14.308 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:27:14.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:14.407+0000 7fb7233b3540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T04:27:14.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:14.408+0000 7fb7233b3540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T04:27:14.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:14.408+0000 7fb7233b3540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:27:14.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:14.408+0000 7fb7233b3540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:27:14.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:14.408+0000 7fb7233b3540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T04:27:14.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:14.410+0000 7fb7233b3540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T04:27:14.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:14.946+0000 7fb7233b3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:15.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:15.706+0000 7fb7233b3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:16.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:16.470+0000 7fb7233b3540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:17.293 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T04:27:17.361 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:27:17.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:17.454+0000 7f4935d87540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T04:27:17.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:17.455+0000 7f4935d87540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T04:27:17.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:17.455+0000 7f4935d87540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:27:17.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:17.455+0000 7f4935d87540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:27:17.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:17.455+0000 7f4935d87540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T04:27:17.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:17.456+0000 7f4935d87540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T04:27:17.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:17.991+0000 7f4935d87540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:18.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:18.752+0000 7f4935d87540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:19.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:19.521+0000 7f4935d87540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:20.344 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T04:27:20.412 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:27:20.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:20.505+0000 7f82b354e540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T04:27:20.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:20.506+0000 7f82b354e540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T04:27:20.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:20.506+0000 7f82b354e540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:27:20.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:20.506+0000 7f82b354e540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:27:20.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:20.506+0000 7f82b354e540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T04:27:20.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:20.507+0000 7f82b354e540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T04:27:21.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:21.043+0000 7f82b354e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:21.805 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:21.803+0000 7f82b354e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:22.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:22.566+0000 7f82b354e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:23.393 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T04:27:23.459 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:27:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:23.550+0000 7f16cdc19540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T04:27:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:23.550+0000 7f16cdc19540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T04:27:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:23.550+0000 7f16cdc19540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:27:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:23.550+0000 7f16cdc19540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:27:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:23.550+0000 7f16cdc19540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T04:27:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:23.552+0000 7f16cdc19540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T04:27:24.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:24.087+0000 7f16cdc19540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:24.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:24.848+0000 7f16cdc19540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:25.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:25.614+0000 7f16cdc19540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:26.429 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T04:27:26.497 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T04:27:26.565 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:27:26.566 INFO:tasks.ceph:role: osd.4 2023-10-06T04:27:26.566 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com 2023-10-06T04:27:26.566 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T04:27:26.635 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:27:26.635 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:27:26.635 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:27:26.635 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 2023-10-06T04:27:26.635 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:27:26.636 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:27:26.636 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:27:26.636 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:27:26.636 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:27:26.636 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:27:27.062 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2023-10-06T04:27:27.067 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2023-10-06T04:27:27.067 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T04:27:27.244 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T04:27:27.313 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T04:27:27.373 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:27:27.373 INFO:tasks.ceph:role: osd.5 2023-10-06T04:27:27.373 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com 2023-10-06T04:27:27.373 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T04:27:27.441 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:27:27.441 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:27:27.441 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:27:27.441 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 2023-10-06T04:27:27.441 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:27:27.441 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:27:27.441 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:27:27.441 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:27:27.441 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:27:27.442 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:27:27.851 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2023-10-06T04:27:27.855 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2023-10-06T04:27:27.856 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T04:27:27.976 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T04:27:28.043 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T04:27:28.103 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:27:28.103 INFO:tasks.ceph:role: osd.6 2023-10-06T04:27:28.103 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com 2023-10-06T04:27:28.104 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T04:27:28.170 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:27:28.170 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:27:28.170 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:27:28.170 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 2023-10-06T04:27:28.170 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:27:28.171 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:27:28.171 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:27:28.171 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:27:28.171 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:27:28.171 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:27:28.625 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2023-10-06T04:27:28.629 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2023-10-06T04:27:28.629 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T04:27:28.791 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T04:27:28.859 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T04:27:28.920 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T04:27:28.920 INFO:tasks.ceph:role: osd.7 2023-10-06T04:27:28.920 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com 2023-10-06T04:27:28.920 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T04:27:28.987 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T04:27:28.987 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T04:27:28.987 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T04:27:28.987 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 2023-10-06T04:27:28.988 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T04:27:28.988 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2023-10-06T04:27:28.988 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T04:27:28.988 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T04:27:28.988 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T04:27:28.988 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T04:27:29.421 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2023-10-06T04:27:29.424 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2023-10-06T04:27:29.424 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T04:27:29.591 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T04:27:29.660 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:27:29.771 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:29.769+0000 7fa7cff81540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T04:27:29.771 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:29.769+0000 7fa7cff81540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T04:27:29.772 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:29.770+0000 7fa7cff81540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:27:29.772 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:29.770+0000 7fa7cff81540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:27:29.772 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:29.770+0000 7fa7cff81540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T04:27:29.773 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:29.771+0000 7fa7cff81540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T04:27:30.308 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:30.306+0000 7fa7cff81540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:31.071 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:31.069+0000 7fa7cff81540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:31.834 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:31.832+0000 7fa7cff81540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:32.645 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T04:27:32.707 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:27:32.797 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:32.795+0000 7f41ddec0540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T04:27:32.797 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:32.796+0000 7f41ddec0540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T04:27:32.798 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:32.796+0000 7f41ddec0540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:27:32.798 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:32.796+0000 7f41ddec0540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:27:32.798 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:32.796+0000 7f41ddec0540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T04:27:32.799 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:32.797+0000 7f41ddec0540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T04:27:33.337 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:33.335+0000 7f41ddec0540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:34.099 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:34.098+0000 7f41ddec0540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:34.862 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:34.860+0000 7f41ddec0540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:35.672 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T04:27:35.734 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:27:35.887 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:35.885+0000 7fa0087ff540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T04:27:35.887 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:35.885+0000 7fa0087ff540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T04:27:35.888 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:35.885+0000 7fa0087ff540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:27:35.888 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:35.885+0000 7fa0087ff540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:27:35.888 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:35.885+0000 7fa0087ff540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T04:27:35.888 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:35.887+0000 7fa0087ff540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T04:27:36.428 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:36.426+0000 7fa0087ff540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:37.194 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:37.192+0000 7fa0087ff540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:37.961 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:37.959+0000 7fa0087ff540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:38.451 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:27:38.456 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:27:38.774 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T04:27:38.835 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:27:38.928 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:38.925+0000 7fb526cff540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T04:27:38.928 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:38.925+0000 7fb526cff540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T04:27:38.929 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:38.925+0000 7fb526cff540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:27:38.929 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:38.925+0000 7fb526cff540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:27:38.929 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:38.925+0000 7fb526cff540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T04:27:38.929 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:38.927+0000 7fb526cff540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T04:27:39.463 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:39.461+0000 7fb526cff540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:40.233 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:40.231+0000 7fb526cff540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:40.996 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:40.994+0000 7fb526cff540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T04:27:41.809 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T04:27:41.871 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T04:27:41.871 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:41.871 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T04:27:41.942 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:41.942 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T04:27:42.048 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:42.048 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T04:27:42.151 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:42.151 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T04:27:42.252 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:42.252 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T04:27:42.353 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:42.354 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T04:27:42.455 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:42.455 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T04:27:42.556 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:42.557 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T04:27:42.623 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:42.623 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T04:27:42.726 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:42.726 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T04:27:42.826 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:42.826 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T04:27:42.925 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:42.925 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T04:27:43.025 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:43.025 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T04:27:43.125 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:43.125 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T04:27:43.225 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:43.226 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T04:27:43.264 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:43.264 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T04:27:43.341 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:43.341 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T04:27:43.377 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:43.377 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T04:27:43.451 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T04:27:43.452 DEBUG:teuthology.orchestra.run.smithi060:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T04:27:43.456 DEBUG:teuthology.orchestra.run.smithi135:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T04:27:43.511 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr.y] 2023-10-06T04:27:43.511 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQCfjB9lLZN8LBAABSiC4B4GbjHl1K+WrPY6EA== 2023-10-06T04:27:43.511 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.a] 2023-10-06T04:27:43.511 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQCfjB9l31LHOhAA7oRZKqE2zYkwjD5IUSmSlw== 2023-10-06T04:27:43.511 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.c] 2023-10-06T04:27:43.512 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQCgjB9lzD64CRAAflvW0zdIHohaoWwPATxBaw== 2023-10-06T04:27:43.512 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.0] 2023-10-06T04:27:43.512 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQCijB9lMRRnGBAA03hwJv6eO23P0qs0lKCM1A== 2023-10-06T04:27:43.512 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.1] 2023-10-06T04:27:43.512 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQCljB9lSTk1GxAA6pc+JLH5X3q5VXsvnSwtxQ== 2023-10-06T04:27:43.512 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.2] 2023-10-06T04:27:43.512 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQCojB9lx5w8HhAAmd4iqtLPN6rfaizHMb0s4g== 2023-10-06T04:27:43.512 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.3] 2023-10-06T04:27:43.512 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQCrjB9lLFjnIBAA1lGjBDCfouDKIInGZbxKDA== 2023-10-06T04:27:43.512 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr.x] 2023-10-06T04:27:43.512 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQCfjB9ltbW7MxAAx/dyhjAhe0ZnLw85f+JvQQ== 2023-10-06T04:27:43.512 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.b] 2023-10-06T04:27:43.513 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQCgjB9lsLtCFBAAtWYATiOcWNMUcmh6pc1nfA== 2023-10-06T04:27:43.513 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.d] 2023-10-06T04:27:43.513 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQCgjB9lZ/WlHhAAdyWltCo3F+8GYbyqbsLSOw== 2023-10-06T04:27:43.513 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.4] 2023-10-06T04:27:43.513 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQCxjB9lFgDvLRAAPnUuIfk9o0PlF+5ME6/vrw== 2023-10-06T04:27:43.513 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.5] 2023-10-06T04:27:43.513 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQC0jB9lQ+p7LxAAH2RCxHfabLzYeiRZq92iSg== 2023-10-06T04:27:43.513 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.6] 2023-10-06T04:27:43.513 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQC3jB9lhTzVNBAAXY87rsg6PV7HgHg0hoHrrQ== 2023-10-06T04:27:43.513 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.7] 2023-10-06T04:27:43.513 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQC6jB9ltew1NxAAabw9KZLEA0/VCw6NCxk6Gg== 2023-10-06T04:27:43.513 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2023-10-06T04:27:43.514 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQCgjB9laCuNJxAADKvUHEMFjkCoHT5eURKJlA== 2023-10-06T04:27:43.514 INFO:teuthology.orchestra.run.smithi060.stdout:[client.2] 2023-10-06T04:27:43.514 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQCgjB9lgBloLhAA/s1+hc35sIjChCTkDYB01A== 2023-10-06T04:27:43.514 INFO:teuthology.orchestra.run.smithi060.stdout:[client.1] 2023-10-06T04:27:43.514 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQCgjB9lHQ9TNRAA4zKKwf6W90r+fnH78woWIw== 2023-10-06T04:27:43.514 INFO:teuthology.orchestra.run.smithi060.stdout:[client.3] 2023-10-06T04:27:43.514 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQChjB9lA5BlABAAkcO/5PzjO/EEjMcK0YUtFw== 2023-10-06T04:27:43.548 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.y] 2023-10-06T04:27:43.548 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCfjB9lLZN8LBAABSiC4B4GbjHl1K+WrPY6EA== 2023-10-06T04:27:43.548 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a] 2023-10-06T04:27:43.548 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCfjB9l31LHOhAA7oRZKqE2zYkwjD5IUSmSlw== 2023-10-06T04:27:43.548 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c] 2023-10-06T04:27:43.548 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCgjB9lzD64CRAAflvW0zdIHohaoWwPATxBaw== 2023-10-06T04:27:43.548 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.0] 2023-10-06T04:27:43.549 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCijB9lMRRnGBAA03hwJv6eO23P0qs0lKCM1A== 2023-10-06T04:27:43.549 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.1] 2023-10-06T04:27:43.549 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCljB9lSTk1GxAA6pc+JLH5X3q5VXsvnSwtxQ== 2023-10-06T04:27:43.549 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.2] 2023-10-06T04:27:43.549 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCojB9lx5w8HhAAmd4iqtLPN6rfaizHMb0s4g== 2023-10-06T04:27:43.549 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.3] 2023-10-06T04:27:43.549 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCrjB9lLFjnIBAA1lGjBDCfouDKIInGZbxKDA== 2023-10-06T04:27:43.549 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.x] 2023-10-06T04:27:43.549 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCfjB9ltbW7MxAAx/dyhjAhe0ZnLw85f+JvQQ== 2023-10-06T04:27:43.549 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b] 2023-10-06T04:27:43.549 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCgjB9lsLtCFBAAtWYATiOcWNMUcmh6pc1nfA== 2023-10-06T04:27:43.549 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d] 2023-10-06T04:27:43.550 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCgjB9lZ/WlHhAAdyWltCo3F+8GYbyqbsLSOw== 2023-10-06T04:27:43.550 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.4] 2023-10-06T04:27:43.550 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCxjB9lFgDvLRAAPnUuIfk9o0PlF+5ME6/vrw== 2023-10-06T04:27:43.550 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.5] 2023-10-06T04:27:43.550 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQC0jB9lQ+p7LxAAH2RCxHfabLzYeiRZq92iSg== 2023-10-06T04:27:43.550 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.6] 2023-10-06T04:27:43.550 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQC3jB9lhTzVNBAAXY87rsg6PV7HgHg0hoHrrQ== 2023-10-06T04:27:43.550 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.7] 2023-10-06T04:27:43.550 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQC6jB9ltew1NxAAabw9KZLEA0/VCw6NCxk6Gg== 2023-10-06T04:27:43.550 INFO:teuthology.orchestra.run.smithi135.stdout:[client.0] 2023-10-06T04:27:43.550 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCgjB9laCuNJxAADKvUHEMFjkCoHT5eURKJlA== 2023-10-06T04:27:43.551 INFO:teuthology.orchestra.run.smithi135.stdout:[client.2] 2023-10-06T04:27:43.551 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCgjB9lgBloLhAA/s1+hc35sIjChCTkDYB01A== 2023-10-06T04:27:43.551 INFO:teuthology.orchestra.run.smithi135.stdout:[client.1] 2023-10-06T04:27:43.551 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCgjB9lHQ9TNRAA4zKKwf6W90r+fnH78woWIw== 2023-10-06T04:27:43.551 INFO:teuthology.orchestra.run.smithi135.stdout:[client.3] 2023-10-06T04:27:43.551 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQChjB9lA5BlABAAkcO/5PzjO/EEjMcK0YUtFw== 2023-10-06T04:27:43.552 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:27:43.559 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:27:43.686 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:27:43.691 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:27:43.788 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:27:43.792 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:27:43.889 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:27:43.893 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:27:43.988 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:27:43.992 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:27:44.086 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:27:44.090 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:27:44.184 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:27:44.189 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:27:44.283 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:27:44.288 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T04:27:44.382 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:27:44.387 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:27:44.484 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:27:44.488 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T04:27:44.585 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:27:44.590 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:27:44.684 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:27:44.688 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:27:44.782 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:27:44.787 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:27:44.880 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:27:44.885 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T04:27:44.979 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:27:44.983 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:27:45.080 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:27:45.085 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:27:45.184 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:27:45.189 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:27:45.285 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:27:45.290 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T04:27:45.386 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T04:27:45.387 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T04:27:45.448 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:27:45.558 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T04:27:45.620 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T04:27:45.680 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:27:45.789 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T04:27:45.850 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T04:27:45.911 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T04:27:46.017 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T04:27:46.077 DEBUG:teuthology.orchestra.run.smithi060:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:27:46.081 DEBUG:teuthology.orchestra.run.smithi135:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T04:27:46.119 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T04:27:46.120 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T04:27:46.120 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T04:27:46.159 INFO:tasks.ceph.mon.a:Started 2023-10-06T04:27:46.159 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T04:27:46.160 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T04:27:46.164 INFO:tasks.ceph.mon.b:Started 2023-10-06T04:27:46.164 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T04:27:46.164 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T04:27:46.168 INFO:tasks.ceph.mon.c:Started 2023-10-06T04:27:46.168 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T04:27:46.169 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T04:27:46.169 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T04:27:46.173 INFO:tasks.ceph.mgr.y:Started 2023-10-06T04:27:46.173 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T04:27:46.173 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T04:27:46.177 INFO:tasks.ceph.mgr.x:Started 2023-10-06T04:27:46.178 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T04:27:46.178 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T04:27:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.376+0000 7f847d39d700 1 Processor -- start 2023-10-06T04:27:46.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.376+0000 7f847d39d700 1 -- start start 2023-10-06T04:27:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.377+0000 7f847d39d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f84780b2620 0x7f84780cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.377+0000 7f847d39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84780b29f0 0x7f84780cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.378+0000 7f847d39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f84780ceaa0 0x7f84780cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.378+0000 7f847d39d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84780cc970 con 0x7f84780b2620 2023-10-06T04:27:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.378+0000 7f847d39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84780cf480 con 0x7f84780ceaa0 2023-10-06T04:27:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.378+0000 7f847d39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84780cbd60 con 0x7f84780b29f0 2023-10-06T04:27:46.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.378+0000 7f8477fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f84780b2620 0x7f84780cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:46.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.378+0000 7f8477fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f84780b2620 0x7f84780cccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44572/0 (socket says 172.21.15.60:44572) 2023-10-06T04:27:46.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.378+0000 7f8477fff700 1 -- 172.21.15.60:0/445569885 learned_addr learned my addr 172.21.15.60:0/445569885 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:27:46.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.378+0000 7f847cb9c700 1 --2- 172.21.15.60:0/445569885 >> v2:172.21.15.135:3300/0 conn(0x7f84780ceaa0 0x7f84780cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.378+0000 7f84777fe700 1 --2- 172.21.15.60:0/445569885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84780b29f0 0x7f84780cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.378+0000 7f8477fff700 1 -- 172.21.15.60:0/445569885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84780b29f0 msgr2=0x7f84780cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:27:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.378+0000 7f8477fff700 1 --2- 172.21.15.60:0/445569885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84780b29f0 0x7f84780cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.379+0000 7f8477fff700 1 -- 172.21.15.60:0/445569885 >> v2:172.21.15.135:3300/0 conn(0x7f84780ceaa0 msgr2=0x7f84780cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:27:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.379+0000 7f8477fff700 1 --2- 172.21.15.60:0/445569885 >> v2:172.21.15.135:3300/0 conn(0x7f84780ceaa0 0x7f84780cef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.379+0000 7f8477fff700 1 -- 172.21.15.60:0/445569885 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84780cc040 con 0x7f84780b2620 2023-10-06T04:27:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.379+0000 7f8477fff700 1 --2- 172.21.15.60:0/445569885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84780b2620 0x7f84780cccb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8478089650 tx=0x7f8468009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435b29ae9eafa3a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.379+0000 7f8476ffd700 1 -- 172.21.15.60:0/445569885 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846800b640 con 0x7f84780b2620 2023-10-06T04:27:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.379+0000 7f8476ffd700 1 -- 172.21.15.60:0/445569885 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846800b7a0 con 0x7f84780b2620 2023-10-06T04:27:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.379+0000 7f8476ffd700 1 -- 172.21.15.60:0/445569885 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846800bb60 con 0x7f84780b2620 2023-10-06T04:27:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.380+0000 7f847d39d700 1 -- 172.21.15.60:0/445569885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84780b2620 msgr2=0x7f84780cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:46.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.380+0000 7f847d39d700 1 --2- 172.21.15.60:0/445569885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84780b2620 0x7f84780cccb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8478089650 tx=0x7f8468009250 comp rx=0 tx=0).stop 2023-10-06T04:27:46.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.380+0000 7f847d39d700 1 -- 172.21.15.60:0/445569885 shutdown_connections 2023-10-06T04:27:46.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.380+0000 7f847d39d700 1 --2- 172.21.15.60:0/445569885 >> v2:172.21.15.135:3300/0 conn(0x7f84780ceaa0 0x7f84780cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:46.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.380+0000 7f847d39d700 1 --2- 172.21.15.60:0/445569885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84780b2620 0x7f84780cccb0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:46.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.380+0000 7f847d39d700 1 --2- 172.21.15.60:0/445569885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84780b29f0 0x7f84780cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:46.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.380+0000 7f847d39d700 1 -- 172.21.15.60:0/445569885 >> 172.21.15.60:0/445569885 conn(0x7f8478099520 msgr2=0x7f847806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:46.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.380+0000 7f847d39d700 1 -- 172.21.15.60:0/445569885 shutdown_connections 2023-10-06T04:27:46.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.380+0000 7f847d39d700 1 -- 172.21.15.60:0/445569885 wait complete. 2023-10-06T04:27:46.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.381+0000 7f847d39d700 1 Processor -- start 2023-10-06T04:27:46.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.382+0000 7f847d39d700 1 -- start start 2023-10-06T04:27:46.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.382+0000 7f847d39d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84780b2620 0x7f8478099f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:46.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.382+0000 7f847d39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84780b29f0 0x7f8478157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:46.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.382+0000 7f847d39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84780ceaa0 0x7f84780c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:46.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.382+0000 7f847d39d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8478158330 con 0x7f84780b2620 2023-10-06T04:27:46.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.382+0000 7f847d39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847809b180 con 0x7f84780b29f0 2023-10-06T04:27:46.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.382+0000 7f847d39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847809a570 con 0x7f84780ceaa0 2023-10-06T04:27:46.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.383+0000 7f8477fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84780b2620 0x7f8478099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:46.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.383+0000 7f8477fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84780b2620 0x7f8478099f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44586/0 (socket says 172.21.15.60:44586) 2023-10-06T04:27:46.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.383+0000 7f8477fff700 1 -- 172.21.15.60:0/529927273 learned_addr learned my addr 172.21.15.60:0/529927273 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:27:46.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.383+0000 7f84777fe700 1 --2- 172.21.15.60:0/529927273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84780b29f0 0x7f8478157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:46.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.383+0000 7f847cb9c700 1 --2- 172.21.15.60:0/529927273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84780ceaa0 0x7f84780c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:46.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.383+0000 7f8477fff700 1 -- 172.21.15.60:0/529927273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84780ceaa0 msgr2=0x7f84780c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:46.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.383+0000 7f8477fff700 1 --2- 172.21.15.60:0/529927273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84780ceaa0 0x7f84780c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:46.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.383+0000 7f8477fff700 1 -- 172.21.15.60:0/529927273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84780b29f0 msgr2=0x7f8478157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:46.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.383+0000 7f8477fff700 1 --2- 172.21.15.60:0/529927273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84780b29f0 0x7f8478157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:46.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.383+0000 7f8477fff700 1 -- 172.21.15.60:0/529927273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8468009490 con 0x7f84780b2620 2023-10-06T04:27:46.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.383+0000 7f84777fe700 1 --2- 172.21.15.60:0/529927273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84780b29f0 0x7f8478157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:27:46.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.383+0000 7f847cb9c700 1 --2- 172.21.15.60:0/529927273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84780ceaa0 0x7f84780c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:27:46.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.383+0000 7f8477fff700 1 --2- 172.21.15.60:0/529927273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84780b2620 0x7f8478099f90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8468009fd0 tx=0x7f8468017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:46.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.384+0000 7f845ffff700 1 -- 172.21.15.60:0/529927273 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846801f070 con 0x7f84780b2620 2023-10-06T04:27:46.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.384+0000 7f845ffff700 1 -- 172.21.15.60:0/529927273 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8468000bc0 con 0x7f84780b2620 2023-10-06T04:27:46.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.384+0000 7f847d39d700 1 -- 172.21.15.60:0/529927273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f847809a850 con 0x7f84780b2620 2023-10-06T04:27:46.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.384+0000 7f845ffff700 1 -- 172.21.15.60:0/529927273 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846800bb40 con 0x7f84780b2620 2023-10-06T04:27:46.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.384+0000 7f847d39d700 1 -- 172.21.15.60:0/529927273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f847809ae10 con 0x7f84780b2620 2023-10-06T04:27:46.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.384+0000 7f845ffff700 1 -- 172.21.15.60:0/529927273 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8468023070 con 0x7f84780b2620 2023-10-06T04:27:46.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.384+0000 7f845ffff700 1 -- 172.21.15.60:0/529927273 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f846802f440 con 0x7f84780b2620 2023-10-06T04:27:46.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.385+0000 7f847d39d700 1 -- 172.21.15.60:0/529927273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f847805f230 con 0x7f84780b2620 2023-10-06T04:27:46.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.390+0000 7f845ffff700 1 -- 172.21.15.60:0/529927273 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f846802a070 con 0x7f84780b2620 2023-10-06T04:27:46.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.469+0000 7f847d39d700 1 -- 172.21.15.60:0/529927273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f84780cc320 con 0x7f84780b2620 2023-10-06T04:27:46.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.472+0000 7f845ffff700 1 -- 172.21.15.60:0/529927273 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8468015020 con 0x7f84780b2620 2023-10-06T04:27:46.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.473+0000 7f847d39d700 1 -- 172.21.15.60:0/529927273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84780b2620 msgr2=0x7f8478099f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:46.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.473+0000 7f847d39d700 1 --2- 172.21.15.60:0/529927273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84780b2620 0x7f8478099f90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8468009fd0 tx=0x7f8468017000 comp rx=0 tx=0).stop 2023-10-06T04:27:46.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.473+0000 7f847d39d700 1 -- 172.21.15.60:0/529927273 shutdown_connections 2023-10-06T04:27:46.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.473+0000 7f847d39d700 1 --2- 172.21.15.60:0/529927273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84780b2620 0x7f8478099f90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:46.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.473+0000 7f847d39d700 1 --2- 172.21.15.60:0/529927273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84780ceaa0 0x7f84780c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:46.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.473+0000 7f847d39d700 1 --2- 172.21.15.60:0/529927273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84780b29f0 0x7f8478157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:46.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.473+0000 7f847d39d700 1 -- 172.21.15.60:0/529927273 >> 172.21.15.60:0/529927273 conn(0x7f8478099520 msgr2=0x7f84780cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:46.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.474+0000 7f847d39d700 1 -- 172.21.15.60:0/529927273 shutdown_connections 2023-10-06T04:27:46.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:46.474+0000 7f847d39d700 1 -- 172.21.15.60:0/529927273 wait complete. 2023-10-06T04:27:46.476 INFO:teuthology.orchestra.run.smithi060.stderr:adjusted tunables profile to default 2023-10-06T04:27:46.495 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T04:27:46.495 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:46.495 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T04:27:46.565 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:46.566 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T04:27:46.669 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:46.669 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T04:27:46.772 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:27:46.772 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T04:27:46.877 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:46.877 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T04:27:46.939 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:46.939 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T04:27:47.041 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:47.041 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T04:27:47.141 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-10-06T04:27:47.141 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T04:27:47.243 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 980b2611-d623-4101-bba3-1f1a600ead7a 0 2023-10-06T04:27:47.462 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.460+0000 7f3a9a19d700 1 Processor -- start 2023-10-06T04:27:47.462 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.461+0000 7f3a9a19d700 1 -- start start 2023-10-06T04:27:47.465 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.462+0000 7f3a9a19d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3a940cca70 0x7f3a940d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:47.465 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.462+0000 7f3a9a19d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3a940d07f0 0x7f3a940ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:47.465 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.462+0000 7f3a9a19d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a940cdbf0 con 0x7f3a94153990 2023-10-06T04:27:47.465 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.462+0000 7f3a9a19d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a940cb4c0 con 0x7f3a940cca70 2023-10-06T04:27:47.465 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.462+0000 7f3a9a19d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a940d0c10 con 0x7f3a940d07f0 2023-10-06T04:27:47.465 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.462+0000 7f3a9999c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3a940d07f0 0x7f3a940ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:47.465 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.462+0000 7f3a9999c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3a940d07f0 0x7f3a940ce860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37194/0 (socket says 172.21.15.135:37194) 2023-10-06T04:27:47.465 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.462+0000 7f3a9999c700 1 -- 172.21.15.135:0/1064643991 learned_addr learned my addr 172.21.15.135:0/1064643991 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-06T04:27:47.465 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.462+0000 7f3a9899a700 1 --2- 172.21.15.135:0/1064643991 >> v2:172.21.15.60:3300/0 conn(0x7f3a940cca70 0x7f3a940d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:47.466 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.463+0000 7f3a9999c700 1 -- 172.21.15.135:0/1064643991 >> v2:172.21.15.60:3300/0 conn(0x7f3a940cca70 msgr2=0x7f3a940d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:27:47.466 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.463+0000 7f3a9999c700 1 --2- 172.21.15.135:0/1064643991 >> v2:172.21.15.60:3300/0 conn(0x7f3a940cca70 0x7f3a940d02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:47.466 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.463+0000 7f3a9999c700 1 -- 172.21.15.135:0/1064643991 >> v1:172.21.15.135:6789/0 conn(0x7f3a94153990 legacy=0x7f3a9415a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:47.466 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.463+0000 7f3a9999c700 1 -- 172.21.15.135:0/1064643991 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a940ccfe0 con 0x7f3a940d07f0 2023-10-06T04:27:47.466 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.463+0000 7f3a9999c700 1 --2- 172.21.15.135:0/1064643991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a940d07f0 0x7f3a940ce860 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3a940cae50 tx=0x7f3a8c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=331c80ff5c40c015 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:47.466 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.463+0000 7f3a8bfff700 1 -- 172.21.15.135:0/1064643991 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c00e070 con 0x7f3a940d07f0 2023-10-06T04:27:47.466 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.463+0000 7f3a8bfff700 1 -- 172.21.15.135:0/1064643991 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8c00ba20 con 0x7f3a940d07f0 2023-10-06T04:27:47.466 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.463+0000 7f3a8bfff700 1 -- 172.21.15.135:0/1064643991 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c0092e0 con 0x7f3a940d07f0 2023-10-06T04:27:47.467 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.464+0000 7f3a9a19d700 1 -- 172.21.15.135:0/1064643991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a940d07f0 msgr2=0x7f3a940ce860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:47.467 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.464+0000 7f3a9a19d700 1 --2- 172.21.15.135:0/1064643991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a940d07f0 0x7f3a940ce860 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3a940cae50 tx=0x7f3a8c009840 comp rx=0 tx=0).stop 2023-10-06T04:27:47.467 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.464+0000 7f3a9a19d700 1 -- 172.21.15.135:0/1064643991 shutdown_connections 2023-10-06T04:27:47.468 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.464+0000 7f3a9a19d700 1 --2- 172.21.15.135:0/1064643991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a940d07f0 0x7f3a940ce860 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:47.468 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.464+0000 7f3a9a19d700 1 --2- 172.21.15.135:0/1064643991 >> v2:172.21.15.60:3300/0 conn(0x7f3a940cca70 0x7f3a940d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:47.468 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.464+0000 7f3a9a19d700 1 -- 172.21.15.135:0/1064643991 >> 172.21.15.135:0/1064643991 conn(0x7f3a940680c0 msgr2=0x7f3a94068490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:47.468 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.464+0000 7f3a9a19d700 1 -- 172.21.15.135:0/1064643991 shutdown_connections 2023-10-06T04:27:47.468 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.464+0000 7f3a9a19d700 1 -- 172.21.15.135:0/1064643991 wait complete. 2023-10-06T04:27:47.468 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.465+0000 7f3a9a19d700 1 Processor -- start 2023-10-06T04:27:47.468 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.465+0000 7f3a9a19d700 1 -- start start 2023-10-06T04:27:47.470 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.466+0000 7f3a9a19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a940cca70 0x7f3a9415cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:47.470 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.466+0000 7f3a9a19d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a940d07f0 0x7f3a940c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:47.470 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.466+0000 7f3a9a19d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a94153990 0x7f3a941510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:47.470 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.466+0000 7f3a9a19d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9415d430 con 0x7f3a94153990 2023-10-06T04:27:47.470 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.466+0000 7f3a9a19d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9415d710 con 0x7f3a940d07f0 2023-10-06T04:27:47.471 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.466+0000 7f3a9a19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9415d9f0 con 0x7f3a940cca70 2023-10-06T04:27:47.471 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.467+0000 7f3a9919b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a940cca70 0x7f3a9415cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:47.471 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.467+0000 7f3a9899a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a940d07f0 0x7f3a940c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:47.471 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.467+0000 7f3a9919b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a940cca70 0x7f3a9415cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:53796/0 (socket says 172.21.15.135:53796) 2023-10-06T04:27:47.471 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.467+0000 7f3a9919b700 1 -- 172.21.15.135:0/3122001058 learned_addr learned my addr 172.21.15.135:0/3122001058 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-06T04:27:47.471 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.467+0000 7f3a9999c700 1 --2- 172.21.15.135:0/3122001058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a94153990 0x7f3a941510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:47.471 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.467+0000 7f3a9999c700 1 -- 172.21.15.135:0/3122001058 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a940cca70 msgr2=0x7f3a9415cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:47.471 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.467+0000 7f3a9999c700 1 --2- 172.21.15.135:0/3122001058 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a940cca70 0x7f3a9415cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:47.471 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.467+0000 7f3a9999c700 1 -- 172.21.15.135:0/3122001058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a940d07f0 msgr2=0x7f3a940c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:47.471 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.467+0000 7f3a9999c700 1 --2- 172.21.15.135:0/3122001058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a940d07f0 0x7f3a940c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:47.471 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.467+0000 7f3a9999c700 1 -- 172.21.15.135:0/3122001058 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c009ae0 con 0x7f3a94153990 2023-10-06T04:27:47.472 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.467+0000 7f3a9899a700 1 --2- 172.21.15.135:0/3122001058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a940d07f0 0x7f3a940c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:27:47.472 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.467+0000 7f3a9999c700 1 --2- 172.21.15.135:0/3122001058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a94153990 0x7f3a941510f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c015000 tx=0x7f3a8c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:47.472 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.468+0000 7f3a897fa700 1 -- 172.21.15.135:0/3122001058 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c008b30 con 0x7f3a94153990 2023-10-06T04:27:47.472 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.468+0000 7f3a897fa700 1 -- 172.21.15.135:0/3122001058 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8c008cd0 con 0x7f3a94153990 2023-10-06T04:27:47.472 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.468+0000 7f3a897fa700 1 -- 172.21.15.135:0/3122001058 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c0256b0 con 0x7f3a94153990 2023-10-06T04:27:47.472 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.468+0000 7f3a9a19d700 1 -- 172.21.15.135:0/3122001058 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9415dcd0 con 0x7f3a94153990 2023-10-06T04:27:47.472 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.468+0000 7f3a9a19d700 1 -- 172.21.15.135:0/3122001058 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a940c8e90 con 0x7f3a94153990 2023-10-06T04:27:47.472 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.468+0000 7f3a897fa700 1 -- 172.21.15.135:0/3122001058 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3a8c003040 con 0x7f3a94153990 2023-10-06T04:27:47.472 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.468+0000 7f3a897fa700 1 -- 172.21.15.135:0/3122001058 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3a8c025d20 con 0x7f3a94153990 2023-10-06T04:27:47.473 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.469+0000 7f3a9a19d700 1 -- 172.21.15.135:0/3122001058 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a9415db30 con 0x7f3a94153990 2023-10-06T04:27:47.473 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.471+0000 7f3a897fa700 1 -- 172.21.15.135:0/3122001058 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3a9415db30 con 0x7f3a94153990 2023-10-06T04:27:47.558 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.557+0000 7f3a9a19d700 1 -- 172.21.15.135:0/3122001058 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd new", "uuid": "980b2611-d623-4101-bba3-1f1a600ead7a", "id": 0} v 0) v1 -- 0x7f3a9415e1f0 con 0x7f3a94153990 2023-10-06T04:27:47.561 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.560+0000 7f3a897fa700 1 -- 172.21.15.135:0/3122001058 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "980b2611-d623-4101-bba3-1f1a600ead7a", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3a9415e1f0 con 0x7f3a94153990 2023-10-06T04:27:47.562 INFO:teuthology.orchestra.run.smithi135.stdout:0 2023-10-06T04:27:47.563 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.561+0000 7f3a9a19d700 1 -- 172.21.15.135:0/3122001058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a94153990 msgr2=0x7f3a941510f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:47.563 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.561+0000 7f3a9a19d700 1 --2- 172.21.15.135:0/3122001058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a94153990 0x7f3a941510f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c015000 tx=0x7f3a8c018000 comp rx=0 tx=0).stop 2023-10-06T04:27:47.563 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.561+0000 7f3a9a19d700 1 -- 172.21.15.135:0/3122001058 shutdown_connections 2023-10-06T04:27:47.563 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.561+0000 7f3a9a19d700 1 --2- 172.21.15.135:0/3122001058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a94153990 0x7f3a941510f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:47.563 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.561+0000 7f3a9a19d700 1 --2- 172.21.15.135:0/3122001058 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3a940cca70 0x7f3a9415cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:47.563 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.561+0000 7f3a9a19d700 1 --2- 172.21.15.135:0/3122001058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a940d07f0 0x7f3a940c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:47.564 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.561+0000 7f3a9a19d700 1 -- 172.21.15.135:0/3122001058 >> 172.21.15.135:0/3122001058 conn(0x7f3a940680c0 msgr2=0x7f3a94158010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:47.564 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.561+0000 7f3a9a19d700 1 -- 172.21.15.135:0/3122001058 shutdown_connections 2023-10-06T04:27:47.564 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.561+0000 7f3a9a19d700 1 -- 172.21.15.135:0/3122001058 wait complete. 2023-10-06T04:27:47.580 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 9d917ccf-bddf-4b2b-b789-5c05f4d36df3 1 2023-10-06T04:27:47.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.755+0000 7fb31139d700 1 Processor -- start 2023-10-06T04:27:47.757 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.756+0000 7fb31139d700 1 -- start start 2023-10-06T04:27:47.759 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.757+0000 7fb31139d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb30c0b2620 0x7fb30c0cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:47.759 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.757+0000 7fb31139d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb30c0b29f0 0x7fb30c0cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:47.759 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.757+0000 7fb31139d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30c0cc970 con 0x7fb30c0ceaa0 2023-10-06T04:27:47.760 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.757+0000 7fb31139d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30c0cbd60 con 0x7fb30c0b2620 2023-10-06T04:27:47.760 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.757+0000 7fb31139d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30c0cc040 con 0x7fb30c0b29f0 2023-10-06T04:27:47.760 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.757+0000 7fb30b7fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb30c0b29f0 0x7fb30c0cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:47.760 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.757+0000 7fb30b7fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb30c0b29f0 0x7fb30c0cd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37206/0 (socket says 172.21.15.135:37206) 2023-10-06T04:27:47.760 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.757+0000 7fb30b7fe700 1 -- 172.21.15.135:0/4218416355 learned_addr learned my addr 172.21.15.135:0/4218416355 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-06T04:27:47.760 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.757+0000 7fb30bfff700 1 --2- 172.21.15.135:0/4218416355 >> v2:172.21.15.60:3300/0 conn(0x7fb30c0b2620 0x7fb30c0cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:47.760 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.757+0000 7fb30b7fe700 1 -- 172.21.15.135:0/4218416355 >> v2:172.21.15.60:3300/0 conn(0x7fb30c0b2620 msgr2=0x7fb30c0cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:27:47.760 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.758+0000 7fb30b7fe700 1 --2- 172.21.15.135:0/4218416355 >> v2:172.21.15.60:3300/0 conn(0x7fb30c0b2620 0x7fb30c0cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:47.760 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.758+0000 7fb30b7fe700 1 -- 172.21.15.135:0/4218416355 >> v1:172.21.15.60:6789/0 conn(0x7fb30c0ceaa0 legacy=0x7fb30c0cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:47.760 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.758+0000 7fb30b7fe700 1 -- 172.21.15.135:0/4218416355 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c0cc320 con 0x7fb30c0b29f0 2023-10-06T04:27:47.760 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.758+0000 7fb30b7fe700 1 --2- 172.21.15.135:0/4218416355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb30c0b29f0 0x7fb30c0cd1f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0b62d0 tx=0x7fb300009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83dedbca28e63933 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:47.761 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.758+0000 7fb30affd700 1 -- 172.21.15.135:0/4218416355 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb300009e70 con 0x7fb30c0b29f0 2023-10-06T04:27:47.761 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.758+0000 7fb30affd700 1 -- 172.21.15.135:0/4218416355 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30000b860 con 0x7fb30c0b29f0 2023-10-06T04:27:47.762 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.758+0000 7fb30affd700 1 -- 172.21.15.135:0/4218416355 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30000bc00 con 0x7fb30c0b29f0 2023-10-06T04:27:47.762 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.759+0000 7fb31139d700 1 -- 172.21.15.135:0/4218416355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb30c0b29f0 msgr2=0x7fb30c0cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:47.762 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.759+0000 7fb31139d700 1 --2- 172.21.15.135:0/4218416355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb30c0b29f0 0x7fb30c0cd1f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0b62d0 tx=0x7fb300009250 comp rx=0 tx=0).stop 2023-10-06T04:27:47.762 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.759+0000 7fb31139d700 1 -- 172.21.15.135:0/4218416355 shutdown_connections 2023-10-06T04:27:47.762 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.759+0000 7fb31139d700 1 --2- 172.21.15.135:0/4218416355 >> v2:172.21.15.60:3300/0 conn(0x7fb30c0b2620 0x7fb30c0cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:47.762 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.759+0000 7fb31139d700 1 --2- 172.21.15.135:0/4218416355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb30c0b29f0 0x7fb30c0cd1f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:47.762 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.759+0000 7fb31139d700 1 -- 172.21.15.135:0/4218416355 >> 172.21.15.135:0/4218416355 conn(0x7fb30c099520 msgr2=0x7fb30c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:47.762 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.759+0000 7fb31139d700 1 -- 172.21.15.135:0/4218416355 shutdown_connections 2023-10-06T04:27:47.762 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.759+0000 7fb31139d700 1 -- 172.21.15.135:0/4218416355 wait complete. 2023-10-06T04:27:47.765 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.760+0000 7fb31139d700 1 Processor -- start 2023-10-06T04:27:47.765 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.760+0000 7fb31139d700 1 -- start start 2023-10-06T04:27:47.765 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.761+0000 7fb31139d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb30c0b2620 0x7fb30c15d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:47.765 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.761+0000 7fb31139d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb30c0b29f0 0x7fb30c154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:47.765 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.761+0000 7fb31139d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb30c0ceaa0 0x7fb30c151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:47.765 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.761+0000 7fb31139d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c154820 con 0x7fb30c0b2620 2023-10-06T04:27:47.765 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.761+0000 7fb31139d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c0c7e80 con 0x7fb30c0b29f0 2023-10-06T04:27:47.765 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.761+0000 7fb31139d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c0c8160 con 0x7fb30c0ceaa0 2023-10-06T04:27:47.765 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.761+0000 7fb30b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb30c0b29f0 0x7fb30c154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:47.766 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.762+0000 7fb310b9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb30c0ceaa0 0x7fb30c151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:47.766 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.762+0000 7fb30bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb30c0b2620 0x7fb30c15d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:47.766 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.762+0000 7fb30b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb30c0b29f0 0x7fb30c154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37218/0 (socket says 172.21.15.135:37218) 2023-10-06T04:27:47.766 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.762+0000 7fb30b7fe700 1 -- 172.21.15.135:0/2207033568 learned_addr learned my addr 172.21.15.135:0/2207033568 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-06T04:27:47.767 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.762+0000 7fb30b7fe700 1 -- 172.21.15.135:0/2207033568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb30c0ceaa0 msgr2=0x7fb30c151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:47.767 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.762+0000 7fb30b7fe700 1 --2- 172.21.15.135:0/2207033568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb30c0ceaa0 0x7fb30c151c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:47.767 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.762+0000 7fb30b7fe700 1 -- 172.21.15.135:0/2207033568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb30c0b2620 msgr2=0x7fb30c15d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:47.767 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.762+0000 7fb30b7fe700 1 --2- 172.21.15.135:0/2207033568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb30c0b2620 0x7fb30c15d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:47.767 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.762+0000 7fb30b7fe700 1 -- 172.21.15.135:0/2207033568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3000094f0 con 0x7fb30c0b29f0 2023-10-06T04:27:47.767 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.762+0000 7fb30b7fe700 1 --2- 172.21.15.135:0/2207033568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb30c0b29f0 0x7fb30c154110 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0cc180 tx=0x7fb300017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:47.768 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.763+0000 7fb2f3fff700 1 -- 172.21.15.135:0/2207033568 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30000b9d0 con 0x7fb30c0b29f0 2023-10-06T04:27:47.768 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.763+0000 7fb2f3fff700 1 -- 172.21.15.135:0/2207033568 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30000bb50 con 0x7fb30c0b29f0 2023-10-06T04:27:47.768 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.763+0000 7fb31139d700 1 -- 172.21.15.135:0/2207033568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30c0c8440 con 0x7fb30c0b29f0 2023-10-06T04:27:47.768 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.763+0000 7fb2f3fff700 1 -- 172.21.15.135:0/2207033568 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb300025670 con 0x7fb30c0b29f0 2023-10-06T04:27:47.768 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.763+0000 7fb31139d700 1 -- 172.21.15.135:0/2207033568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30c152180 con 0x7fb30c0b29f0 2023-10-06T04:27:47.769 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.763+0000 7fb2f3fff700 1 -- 172.21.15.135:0/2207033568 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb300023070 con 0x7fb30c0b29f0 2023-10-06T04:27:47.769 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.763+0000 7fb2f3fff700 1 -- 172.21.15.135:0/2207033568 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fb30002f850 con 0x7fb30c0b29f0 2023-10-06T04:27:47.769 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.764+0000 7fb31139d700 1 -- 172.21.15.135:0/2207033568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb30c0c8960 con 0x7fb30c0b29f0 2023-10-06T04:27:47.770 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.769+0000 7fb2f3fff700 1 -- 172.21.15.135:0/2207033568 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb30c0c8960 con 0x7fb30c0b29f0 2023-10-06T04:27:47.816 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:47.815+0000 7f07e1726180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T04:27:47.856 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.854+0000 7fb31139d700 1 -- 172.21.15.135:0/2207033568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9d917ccf-bddf-4b2b-b789-5c05f4d36df3", "id": 1} v 0) v1 -- 0x7fb30c05f230 con 0x7fb30c0b29f0 2023-10-06T04:27:47.860 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.858+0000 7fb2f3fff700 1 -- 172.21.15.135:0/2207033568 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d917ccf-bddf-4b2b-b789-5c05f4d36df3", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb30002a070 con 0x7fb30c0b29f0 2023-10-06T04:27:47.861 INFO:teuthology.orchestra.run.smithi135.stdout:1 2023-10-06T04:27:47.862 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.859+0000 7fb31139d700 1 -- 172.21.15.135:0/2207033568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb30c0b29f0 msgr2=0x7fb30c154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:47.862 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.859+0000 7fb31139d700 1 --2- 172.21.15.135:0/2207033568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb30c0b29f0 0x7fb30c154110 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0cc180 tx=0x7fb300017000 comp rx=0 tx=0).stop 2023-10-06T04:27:47.862 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.859+0000 7fb31139d700 1 -- 172.21.15.135:0/2207033568 shutdown_connections 2023-10-06T04:27:47.862 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.859+0000 7fb31139d700 1 --2- 172.21.15.135:0/2207033568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb30c0b2620 0x7fb30c15d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:47.863 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.859+0000 7fb31139d700 1 --2- 172.21.15.135:0/2207033568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb30c0ceaa0 0x7fb30c151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:47.864 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.859+0000 7fb31139d700 1 --2- 172.21.15.135:0/2207033568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb30c0b29f0 0x7fb30c154110 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:47.864 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.859+0000 7fb31139d700 1 -- 172.21.15.135:0/2207033568 >> 172.21.15.135:0/2207033568 conn(0x7fb30c099520 msgr2=0x7fb30c0cde00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:47.864 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.859+0000 7fb31139d700 1 -- 172.21.15.135:0/2207033568 shutdown_connections 2023-10-06T04:27:47.864 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:47.859+0000 7fb31139d700 1 -- 172.21.15.135:0/2207033568 wait complete. 2023-10-06T04:27:47.879 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 7dd03cbd-960c-49c2-8380-066f29f247b3 2 2023-10-06T04:27:47.930 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:47.927+0000 7fb29649b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T04:27:47.988 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:47.986+0000 7f07e1726180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T04:27:48.056 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.054+0000 7f0b2919d700 1 Processor -- start 2023-10-06T04:27:48.056 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.054+0000 7f0b2919d700 1 -- start start 2023-10-06T04:27:48.057 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.055+0000 7f0b2919d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b240b2620 0x7f0b240cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:48.057 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.055+0000 7f0b2919d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0b240b29f0 0x7f0b240cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:48.057 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.055+0000 7f0b2919d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b240cc970 con 0x7f0b240ceaa0 2023-10-06T04:27:48.057 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.055+0000 7f0b2919d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b240cbd60 con 0x7f0b240b29f0 2023-10-06T04:27:48.058 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.055+0000 7f0b2919d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b240cc040 con 0x7f0b240b2620 2023-10-06T04:27:48.058 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.055+0000 7f0b237fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0b240b29f0 0x7f0b240cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:48.058 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.055+0000 7f0b23fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b240b2620 0x7f0b240cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:48.058 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.055+0000 7f0b237fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0b240b29f0 0x7f0b240cd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37228/0 (socket says 172.21.15.135:37228) 2023-10-06T04:27:48.058 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.055+0000 7f0b237fe700 1 -- 172.21.15.135:0/2116218133 learned_addr learned my addr 172.21.15.135:0/2116218133 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-06T04:27:48.059 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.056+0000 7f0b237fe700 1 -- 172.21.15.135:0/2116218133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b240b2620 msgr2=0x7f0b240cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:27:48.060 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.056+0000 7f0b237fe700 1 --2- 172.21.15.135:0/2116218133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b240b2620 0x7f0b240cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.060 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.056+0000 7f0b237fe700 1 -- 172.21.15.135:0/2116218133 >> v1:172.21.15.60:6789/0 conn(0x7f0b240ceaa0 legacy=0x7f0b240cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:48.060 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.056+0000 7f0b237fe700 1 -- 172.21.15.135:0/2116218133 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b240cc320 con 0x7f0b240b29f0 2023-10-06T04:27:48.060 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.056+0000 7f0b23fff700 1 --2- 172.21.15.135:0/2116218133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b240b2620 0x7f0b240cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:27:48.060 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.056+0000 7f0b22ffd700 1 -- 172.21.15.135:0/2116218133 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749206506 0 0) 0x7f0b240cc970 con 0x7f0b240ceaa0 2023-10-06T04:27:48.060 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.056+0000 7f0b237fe700 1 --2- 172.21.15.135:0/2116218133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b240b29f0 0x7f0b240cd1f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0b180099b0 tx=0x7f0b18009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c80012edd9c1588 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:48.060 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.057+0000 7f0b22ffd700 1 -- 172.21.15.135:0/2116218133 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b18009ea0 con 0x7f0b240b29f0 2023-10-06T04:27:48.060 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.057+0000 7f0b22ffd700 1 -- 172.21.15.135:0/2116218133 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1800b860 con 0x7f0b240b29f0 2023-10-06T04:27:48.060 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.057+0000 7f0b22ffd700 1 -- 172.21.15.135:0/2116218133 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1800bc00 con 0x7f0b240b29f0 2023-10-06T04:27:48.061 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.057+0000 7f0b2919d700 1 -- 172.21.15.135:0/2116218133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b240b29f0 msgr2=0x7f0b240cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:48.061 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.057+0000 7f0b2919d700 1 --2- 172.21.15.135:0/2116218133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b240b29f0 0x7f0b240cd1f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0b180099b0 tx=0x7f0b18009250 comp rx=0 tx=0).stop 2023-10-06T04:27:48.061 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.057+0000 7f0b2919d700 1 -- 172.21.15.135:0/2116218133 shutdown_connections 2023-10-06T04:27:48.061 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.057+0000 7f0b2919d700 1 --2- 172.21.15.135:0/2116218133 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b240b2620 0x7f0b240cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.061 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.057+0000 7f0b2919d700 1 --2- 172.21.15.135:0/2116218133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b240b29f0 0x7f0b240cd1f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.061 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.057+0000 7f0b2919d700 1 -- 172.21.15.135:0/2116218133 >> 172.21.15.135:0/2116218133 conn(0x7f0b24099520 msgr2=0x7f0b2406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:48.061 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.057+0000 7f0b2919d700 1 -- 172.21.15.135:0/2116218133 shutdown_connections 2023-10-06T04:27:48.061 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.058+0000 7f0b2919d700 1 -- 172.21.15.135:0/2116218133 wait complete. 2023-10-06T04:27:48.063 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.059+0000 7f0b2919d700 1 Processor -- start 2023-10-06T04:27:48.064 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.059+0000 7f0b2919d700 1 -- start start 2023-10-06T04:27:48.064 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.060+0000 7f0b2919d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b240b2620 0x7f0b24158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:48.064 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.060+0000 7f0b2919d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b240b29f0 0x7f0b240b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:48.064 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.060+0000 7f0b2919d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b240ceaa0 0x7f0b24144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:48.064 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.060+0000 7f0b2919d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b24155a50 con 0x7f0b240b2620 2023-10-06T04:27:48.064 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.060+0000 7f0b2919d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2416d0f0 con 0x7f0b240ceaa0 2023-10-06T04:27:48.064 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.060+0000 7f0b2919d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2416d340 con 0x7f0b240b29f0 2023-10-06T04:27:48.064 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.060+0000 7f0b23fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b240b2620 0x7f0b24158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:48.065 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.060+0000 7f0b237fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b240b29f0 0x7f0b240b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:48.065 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.060+0000 7f0b23fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b240b2620 0x7f0b24158670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.135:50952/0 (socket says 172.21.15.135:50952) 2023-10-06T04:27:48.065 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.060+0000 7f0b237fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b240b29f0 0x7f0b240b5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:53822/0 (socket says 172.21.15.135:53822) 2023-10-06T04:27:48.065 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.060+0000 7f0b2899c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b240ceaa0 0x7f0b24144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:48.065 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.060+0000 7f0b23fff700 1 -- 172.21.15.135:0/1903436841 learned_addr learned my addr 172.21.15.135:0/1903436841 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-06T04:27:48.065 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.061+0000 7f0b23fff700 1 -- 172.21.15.135:0/1903436841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b240b29f0 msgr2=0x7f0b240b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:48.065 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.061+0000 7f0b23fff700 1 --2- 172.21.15.135:0/1903436841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b240b29f0 0x7f0b240b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.065 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.061+0000 7f0b23fff700 1 -- 172.21.15.135:0/1903436841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b240ceaa0 msgr2=0x7f0b24144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:48.065 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.061+0000 7f0b23fff700 1 --2- 172.21.15.135:0/1903436841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b240ceaa0 0x7f0b24144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.065 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.061+0000 7f0b23fff700 1 -- 172.21.15.135:0/1903436841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b140093c0 con 0x7f0b240b2620 2023-10-06T04:27:48.065 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.061+0000 7f0b237fe700 1 --2- 172.21.15.135:0/1903436841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b240b29f0 0x7f0b240b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:27:48.066 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.061+0000 7f0b23fff700 1 --2- 172.21.15.135:0/1903436841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b240b2620 0x7f0b24158670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400ec80 tx=0x7f0b14009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:48.066 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.061+0000 7f0b0bfff700 1 -- 172.21.15.135:0/1903436841 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b14005a00 con 0x7f0b240b2620 2023-10-06T04:27:48.066 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.061+0000 7f0b0bfff700 1 -- 172.21.15.135:0/1903436841 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b14005b60 con 0x7f0b240b2620 2023-10-06T04:27:48.066 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.061+0000 7f0b0bfff700 1 -- 172.21.15.135:0/1903436841 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1400c850 con 0x7f0b240b2620 2023-10-06T04:27:48.066 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.061+0000 7f0b2919d700 1 -- 172.21.15.135:0/1903436841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b180094f0 con 0x7f0b240b2620 2023-10-06T04:27:48.066 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.061+0000 7f0b2919d700 1 -- 172.21.15.135:0/1903436841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b2416d900 con 0x7f0b240b2620 2023-10-06T04:27:48.066 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.062+0000 7f0b0bfff700 1 -- 172.21.15.135:0/1903436841 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0b14006030 con 0x7f0b240b2620 2023-10-06T04:27:48.066 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.062+0000 7f0b0bfff700 1 -- 172.21.15.135:0/1903436841 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f0b1400ce40 con 0x7f0b240b2620 2023-10-06T04:27:48.067 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.062+0000 7f0b2919d700 1 -- 172.21.15.135:0/1903436841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b240c7360 con 0x7f0b240b2620 2023-10-06T04:27:48.067 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.065+0000 7f0b0bfff700 1 -- 172.21.15.135:0/1903436841 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0b1403a6d0 con 0x7f0b240b2620 2023-10-06T04:27:48.086 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:48.085+0000 7f07e1726180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T04:27:48.101 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:48.100+0000 7fb29649b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T04:27:48.153 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.151+0000 7f0b2919d700 1 -- 172.21.15.135:0/1903436841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7dd03cbd-960c-49c2-8380-066f29f247b3", "id": 2} v 0) v1 -- 0x7f0b2405f260 con 0x7f0b240b2620 2023-10-06T04:27:48.155 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.154+0000 7f0b0bfff700 1 -- 172.21.15.135:0/1903436841 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7dd03cbd-960c-49c2-8380-066f29f247b3", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0b14029070 con 0x7f0b240b2620 2023-10-06T04:27:48.156 INFO:teuthology.orchestra.run.smithi135.stdout:2 2023-10-06T04:27:48.158 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.155+0000 7f0b2919d700 1 -- 172.21.15.135:0/1903436841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b240b2620 msgr2=0x7f0b24158670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:48.158 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.155+0000 7f0b2919d700 1 --2- 172.21.15.135:0/1903436841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b240b2620 0x7f0b24158670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400ec80 tx=0x7f0b14009120 comp rx=0 tx=0).stop 2023-10-06T04:27:48.158 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.155+0000 7f0b2919d700 1 -- 172.21.15.135:0/1903436841 shutdown_connections 2023-10-06T04:27:48.158 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.155+0000 7f0b2919d700 1 --2- 172.21.15.135:0/1903436841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b240b2620 0x7f0b24158670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.158 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.155+0000 7f0b2919d700 1 --2- 172.21.15.135:0/1903436841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b240ceaa0 0x7f0b24144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.159 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.155+0000 7f0b2919d700 1 --2- 172.21.15.135:0/1903436841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b240b29f0 0x7f0b240b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.159 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.155+0000 7f0b2919d700 1 -- 172.21.15.135:0/1903436841 >> 172.21.15.135:0/1903436841 conn(0x7f0b24099520 msgr2=0x7f0b240ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:48.159 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.155+0000 7f0b2919d700 1 -- 172.21.15.135:0/1903436841 shutdown_connections 2023-10-06T04:27:48.159 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.155+0000 7f0b2919d700 1 -- 172.21.15.135:0/1903436841 wait complete. 2023-10-06T04:27:48.173 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 60411bb4-9bdb-4306-94fe-012d9b336824 3 2023-10-06T04:27:48.199 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:48.198+0000 7fb29649b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T04:27:48.316 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:48.314+0000 7f07e1726180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:27:48.354 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.352+0000 7fe3a09fe700 1 Processor -- start 2023-10-06T04:27:48.355 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.352+0000 7fe3a09fe700 1 -- start start 2023-10-06T04:27:48.357 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.354+0000 7fe3a09fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe39c153990 0x7fe39c15a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:48.357 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.354+0000 7fe3a09fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39c0d09c0 0x7fe39c0ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:48.357 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.354+0000 7fe3a09fe700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39c0cdbf0 con 0x7fe39c0cca70 2023-10-06T04:27:48.357 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.354+0000 7fe3a09fe700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39c0cb4c0 con 0x7fe39c153990 2023-10-06T04:27:48.357 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.354+0000 7fe3a09fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c15a8b0 con 0x7fe39c0d09c0 2023-10-06T04:27:48.357 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.354+0000 7fe39ad9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe39c153990 0x7fe39c15a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:48.357 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.354+0000 7fe39b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39c0d09c0 0x7fe39c0ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:48.358 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.354+0000 7fe39ad9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe39c153990 0x7fe39c15a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37248/0 (socket says 172.21.15.135:37248) 2023-10-06T04:27:48.358 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.354+0000 7fe39b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39c0d09c0 0x7fe39c0ce860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:53826/0 (socket says 172.21.15.135:53826) 2023-10-06T04:27:48.358 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.354+0000 7fe39ad9d700 1 -- 172.21.15.135:0/1345444631 learned_addr learned my addr 172.21.15.135:0/1345444631 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-06T04:27:48.358 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.354+0000 7fe39ad9d700 1 -- 172.21.15.135:0/1345444631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39c0d09c0 msgr2=0x7fe39c0ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:27:48.358 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.354+0000 7fe39ad9d700 1 --2- 172.21.15.135:0/1345444631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39c0d09c0 0x7fe39c0ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.358 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.354+0000 7fe39ad9d700 1 -- 172.21.15.135:0/1345444631 >> v1:172.21.15.135:6789/0 conn(0x7fe39c0cca70 legacy=0x7fe39c0d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:48.358 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.355+0000 7fe39ad9d700 1 -- 172.21.15.135:0/1345444631 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c0ccfe0 con 0x7fe39c153990 2023-10-06T04:27:48.358 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.355+0000 7fe39b59e700 1 --2- 172.21.15.135:0/1345444631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39c0d09c0 0x7fe39c0ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:27:48.358 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.354+0000 7fe399d9b700 1 -- 172.21.15.135:0/1345444631 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3255597614 0 0) 0x7fe39c0cdbf0 con 0x7fe39c0cca70 2023-10-06T04:27:48.358 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.355+0000 7fe39ad9d700 1 --2- 172.21.15.135:0/1345444631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe39c153990 0x7fe39c15a370 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0099b0 tx=0x7fe38c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2b1033d5bd67ed3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:48.359 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.355+0000 7fe399d9b700 1 -- 172.21.15.135:0/1345444631 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c009ea0 con 0x7fe39c153990 2023-10-06T04:27:48.359 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.355+0000 7fe399d9b700 1 -- 172.21.15.135:0/1345444631 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c00b860 con 0x7fe39c153990 2023-10-06T04:27:48.359 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.355+0000 7fe399d9b700 1 -- 172.21.15.135:0/1345444631 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c00bc00 con 0x7fe39c153990 2023-10-06T04:27:48.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.356+0000 7fe3a09fe700 1 -- 172.21.15.135:0/1345444631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe39c153990 msgr2=0x7fe39c15a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:48.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.356+0000 7fe3a09fe700 1 --2- 172.21.15.135:0/1345444631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe39c153990 0x7fe39c15a370 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0099b0 tx=0x7fe38c009250 comp rx=0 tx=0).stop 2023-10-06T04:27:48.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.356+0000 7fe3a09fe700 1 -- 172.21.15.135:0/1345444631 shutdown_connections 2023-10-06T04:27:48.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.356+0000 7fe3a09fe700 1 --2- 172.21.15.135:0/1345444631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39c0d09c0 0x7fe39c0ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.356+0000 7fe3a09fe700 1 --2- 172.21.15.135:0/1345444631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe39c153990 0x7fe39c15a370 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.356+0000 7fe3a09fe700 1 -- 172.21.15.135:0/1345444631 >> 172.21.15.135:0/1345444631 conn(0x7fe39c0680c0 msgr2=0x7fe39c068490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:48.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.356+0000 7fe3a09fe700 1 -- 172.21.15.135:0/1345444631 shutdown_connections 2023-10-06T04:27:48.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.356+0000 7fe3a09fe700 1 -- 172.21.15.135:0/1345444631 wait complete. 2023-10-06T04:27:48.362 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.357+0000 7fe3a09fe700 1 Processor -- start 2023-10-06T04:27:48.363 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.357+0000 7fe3a09fe700 1 -- start start 2023-10-06T04:27:48.363 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.358+0000 7fe3a09fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39c0cca70 0x7fe39c151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:48.363 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.358+0000 7fe3a09fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe39c0d09c0 0x7fe39c144e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:48.363 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.358+0000 7fe3a09fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe39c153990 0x7fe39c0c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:48.363 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.358+0000 7fe3a09fe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0b4c10 con 0x7fe39c0d09c0 2023-10-06T04:27:48.363 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.358+0000 7fe3a09fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0b3550 con 0x7fe39c153990 2023-10-06T04:27:48.363 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.358+0000 7fe3a09fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0b13b0 con 0x7fe39c0cca70 2023-10-06T04:27:48.363 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.358+0000 7fe39ad9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39c0cca70 0x7fe39c151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:48.363 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.358+0000 7fe39ad9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39c0cca70 0x7fe39c151d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:53836/0 (socket says 172.21.15.135:53836) 2023-10-06T04:27:48.364 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.358+0000 7fe39ad9d700 1 -- 172.21.15.135:0/1220313505 learned_addr learned my addr 172.21.15.135:0/1220313505 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-06T04:27:48.364 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.359+0000 7fe39b59e700 1 --2- 172.21.15.135:0/1220313505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe39c153990 0x7fe39c0c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:48.364 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.359+0000 7fe39a59c700 1 --2- 172.21.15.135:0/1220313505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe39c0d09c0 0x7fe39c144e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:48.364 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.359+0000 7fe39ad9d700 1 -- 172.21.15.135:0/1220313505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe39c153990 msgr2=0x7fe39c0c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:48.364 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.359+0000 7fe39ad9d700 1 --2- 172.21.15.135:0/1220313505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe39c153990 0x7fe39c0c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.364 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.359+0000 7fe39ad9d700 1 -- 172.21.15.135:0/1220313505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe39c0d09c0 msgr2=0x7fe39c144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:48.364 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.359+0000 7fe39ad9d700 1 --2- 172.21.15.135:0/1220313505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe39c0d09c0 0x7fe39c144e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.364 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.359+0000 7fe39ad9d700 1 -- 172.21.15.135:0/1220313505 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe394009a20 con 0x7fe39c0cca70 2023-10-06T04:27:48.364 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.359+0000 7fe39ad9d700 1 --2- 172.21.15.135:0/1220313505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39c0cca70 0x7fe39c151d90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0890b0 tx=0x7fe38c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:48.364 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.359+0000 7fe382ffd700 1 -- 172.21.15.135:0/1220313505 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c000d10 con 0x7fe39c0cca70 2023-10-06T04:27:48.365 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.359+0000 7fe382ffd700 1 -- 172.21.15.135:0/1220313505 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c00bbe0 con 0x7fe39c0cca70 2023-10-06T04:27:48.365 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.359+0000 7fe382ffd700 1 -- 172.21.15.135:0/1220313505 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c011670 con 0x7fe39c0cca70 2023-10-06T04:27:48.365 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.359+0000 7fe3a09fe700 1 -- 172.21.15.135:0/1220313505 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38c0094f0 con 0x7fe39c0cca70 2023-10-06T04:27:48.365 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.360+0000 7fe3a09fe700 1 -- 172.21.15.135:0/1220313505 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39c0b0d60 con 0x7fe39c0cca70 2023-10-06T04:27:48.365 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.360+0000 7fe382ffd700 1 -- 172.21.15.135:0/1220313505 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe38c011aa0 con 0x7fe39c0cca70 2023-10-06T04:27:48.366 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.360+0000 7fe382ffd700 1 -- 172.21.15.135:0/1220313505 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fe38c023890 con 0x7fe39c0cca70 2023-10-06T04:27:48.366 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.361+0000 7fe3a09fe700 1 -- 172.21.15.135:0/1220313505 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39c05f230 con 0x7fe39c0cca70 2023-10-06T04:27:48.366 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.364+0000 7fe382ffd700 1 -- 172.21.15.135:0/1220313505 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe38c028070 con 0x7fe39c0cca70 2023-10-06T04:27:48.448 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:48.446+0000 7fb29649b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:27:48.468 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.466+0000 7fe3a09fe700 1 -- 172.21.15.135:0/1220313505 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "60411bb4-9bdb-4306-94fe-012d9b336824", "id": 3} v 0) v1 -- 0x7fe39c0cd2c0 con 0x7fe39c0cca70 2023-10-06T04:27:48.471 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.470+0000 7fe382ffd700 1 -- 172.21.15.135:0/1220313505 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "60411bb4-9bdb-4306-94fe-012d9b336824", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe38c015020 con 0x7fe39c0cca70 2023-10-06T04:27:48.471 INFO:teuthology.orchestra.run.smithi135.stdout:3 2023-10-06T04:27:48.473 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.471+0000 7fe3a09fe700 1 -- 172.21.15.135:0/1220313505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39c0cca70 msgr2=0x7fe39c151d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:48.473 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.471+0000 7fe3a09fe700 1 --2- 172.21.15.135:0/1220313505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39c0cca70 0x7fe39c151d90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0890b0 tx=0x7fe38c017000 comp rx=0 tx=0).stop 2023-10-06T04:27:48.473 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.471+0000 7fe3a09fe700 1 -- 172.21.15.135:0/1220313505 shutdown_connections 2023-10-06T04:27:48.473 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.471+0000 7fe3a09fe700 1 --2- 172.21.15.135:0/1220313505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe39c153990 0x7fe39c0c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.473 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.471+0000 7fe3a09fe700 1 --2- 172.21.15.135:0/1220313505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe39c0cca70 0x7fe39c151d90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.473 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.471+0000 7fe3a09fe700 1 --2- 172.21.15.135:0/1220313505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe39c0d09c0 0x7fe39c144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.474 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.471+0000 7fe3a09fe700 1 -- 172.21.15.135:0/1220313505 >> 172.21.15.135:0/1220313505 conn(0x7fe39c0680c0 msgr2=0x7fe39c15c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:48.474 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.471+0000 7fe3a09fe700 1 -- 172.21.15.135:0/1220313505 shutdown_connections 2023-10-06T04:27:48.474 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.471+0000 7fe3a09fe700 1 -- 172.21.15.135:0/1220313505 wait complete. 2023-10-06T04:27:48.490 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new c93dac22-53ef-4fcd-91dc-2eea732f7c07 4 2023-10-06T04:27:48.536 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:48.535+0000 7f07e1726180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T04:27:48.635 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:48.634+0000 7f07e1726180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T04:27:48.669 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:48.667+0000 7fb29649b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T04:27:48.708 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.706+0000 7f28d919d700 1 Processor -- start 2023-10-06T04:27:48.708 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.706+0000 7f28d919d700 1 -- start start 2023-10-06T04:27:48.709 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.707+0000 7f28d919d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f28d413c430 0x7f28d40ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:48.709 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.707+0000 7f28d919d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d415a250 0x7f28d40c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:48.709 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.707+0000 7f28d919d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d40ca5b0 con 0x7f28d40cae90 2023-10-06T04:27:48.709 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.707+0000 7f28d919d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d40cb330 con 0x7f28d413c430 2023-10-06T04:27:48.709 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.707+0000 7f28d919d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d415a8e0 con 0x7f28d415a250 2023-10-06T04:27:48.711 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.708+0000 7f28d899c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d415a250 0x7f28d40c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:48.712 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.708+0000 7f28d37fe700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f28d40cae90 0x7f28d4159b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:58922/0 (socket says 172.21.15.135:58922) 2023-10-06T04:27:48.712 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.708+0000 7f28d37fe700 1 -- 172.21.15.135:0/1966430289 learned_addr learned my addr 172.21.15.135:0/1966430289 (peer_addr_for_me v1:172.21.15.135:0/0) 2023-10-06T04:27:48.712 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.708+0000 7f28d3fff700 1 --2- 172.21.15.135:0/1966430289 >> v2:172.21.15.60:3300/0 conn(0x7f28d413c430 0x7f28d40ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:48.712 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.708+0000 7f28d2ffd700 1 -- 172.21.15.135:0/1966430289 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777953173 0 0) 0x7f28d40ca5b0 con 0x7f28d40cae90 2023-10-06T04:27:48.712 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.708+0000 7f28d2ffd700 1 -- 172.21.15.135:0/1966430289 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28bc003570 con 0x7f28d40cae90 2023-10-06T04:27:48.712 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.708+0000 7f28d899c700 1 -- 172.21.15.135:0/1966430289 >> v2:172.21.15.60:3300/0 conn(0x7f28d413c430 msgr2=0x7f28d40ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:27:48.712 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.708+0000 7f28d899c700 1 --2- 172.21.15.135:0/1966430289 >> v2:172.21.15.60:3300/0 conn(0x7f28d413c430 0x7f28d40ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.712 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.708+0000 7f28d899c700 1 -- 172.21.15.135:0/1966430289 >> v1:172.21.15.135:6789/0 conn(0x7f28d40cae90 legacy=0x7f28d4159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:48.713 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.708+0000 7f28d899c700 1 -- 172.21.15.135:0/1966430289 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d415a6b0 con 0x7f28d415a250 2023-10-06T04:27:48.713 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.709+0000 7f28d899c700 1 --2- 172.21.15.135:0/1966430289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d415a250 0x7f28d40c86f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f28cc009e90 tx=0x7f28cc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f518874466570f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:48.713 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.709+0000 7f28d2ffd700 1 -- 172.21.15.135:0/1966430289 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc00e070 con 0x7f28d415a250 2023-10-06T04:27:48.713 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.709+0000 7f28d2ffd700 1 -- 172.21.15.135:0/1966430289 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc00bb40 con 0x7f28d415a250 2023-10-06T04:27:48.713 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.709+0000 7f28d2ffd700 1 -- 172.21.15.135:0/1966430289 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc012430 con 0x7f28d415a250 2023-10-06T04:27:48.713 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.709+0000 7f28d919d700 1 -- 172.21.15.135:0/1966430289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d415a250 msgr2=0x7f28d40c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:48.713 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.709+0000 7f28d919d700 1 --2- 172.21.15.135:0/1966430289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d415a250 0x7f28d40c86f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f28cc009e90 tx=0x7f28cc009780 comp rx=0 tx=0).stop 2023-10-06T04:27:48.713 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.709+0000 7f28d919d700 1 -- 172.21.15.135:0/1966430289 shutdown_connections 2023-10-06T04:27:48.713 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.710+0000 7f28d919d700 1 --2- 172.21.15.135:0/1966430289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d415a250 0x7f28d40c86f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.713 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.710+0000 7f28d919d700 1 --2- 172.21.15.135:0/1966430289 >> v2:172.21.15.60:3300/0 conn(0x7f28d413c430 0x7f28d40ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.714 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.710+0000 7f28d919d700 1 -- 172.21.15.135:0/1966430289 >> 172.21.15.135:0/1966430289 conn(0x7f28d406b330 msgr2=0x7f28d406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:48.714 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.710+0000 7f28d919d700 1 -- 172.21.15.135:0/1966430289 shutdown_connections 2023-10-06T04:27:48.714 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.710+0000 7f28d919d700 1 -- 172.21.15.135:0/1966430289 wait complete. 2023-10-06T04:27:48.717 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.711+0000 7f28d919d700 1 Processor -- start 2023-10-06T04:27:48.717 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.711+0000 7f28d919d700 1 -- start start 2023-10-06T04:27:48.717 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.712+0000 7f28d919d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d40cae90 0x7f28d40b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:48.717 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.712+0000 7f28d919d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28d413c430 0x7f28d415dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:48.717 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.712+0000 7f28d919d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d415a250 0x7f28d413b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:48.717 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.712+0000 7f28d919d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40b2360 con 0x7f28d413c430 2023-10-06T04:27:48.717 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.712+0000 7f28d919d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40b2610 con 0x7f28d415a250 2023-10-06T04:27:48.717 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.712+0000 7f28d919d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40b28f0 con 0x7f28d40cae90 2023-10-06T04:27:48.718 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.712+0000 7f28d3fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d40cae90 0x7f28d40b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:48.718 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.712+0000 7f28d3fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d40cae90 0x7f28d40b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:53862/0 (socket says 172.21.15.135:53862) 2023-10-06T04:27:48.718 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.712+0000 7f28d3fff700 1 -- 172.21.15.135:0/182445342 learned_addr learned my addr 172.21.15.135:0/182445342 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-06T04:27:48.718 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.712+0000 7f28d37fe700 1 --2- 172.21.15.135:0/182445342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28d413c430 0x7f28d415dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:48.718 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.712+0000 7f28d899c700 1 --2- 172.21.15.135:0/182445342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d415a250 0x7f28d413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:48.718 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.713+0000 7f28d3fff700 1 -- 172.21.15.135:0/182445342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d415a250 msgr2=0x7f28d413b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:48.718 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.713+0000 7f28d3fff700 1 --2- 172.21.15.135:0/182445342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d415a250 0x7f28d413b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.718 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.713+0000 7f28d3fff700 1 -- 172.21.15.135:0/182445342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28d413c430 msgr2=0x7f28d415dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:48.718 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.713+0000 7f28d3fff700 1 --2- 172.21.15.135:0/182445342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28d413c430 0x7f28d415dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.719 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.713+0000 7f28d3fff700 1 -- 172.21.15.135:0/182445342 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc009a20 con 0x7f28d40cae90 2023-10-06T04:27:48.719 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.713+0000 7f28d3fff700 1 --2- 172.21.15.135:0/182445342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d40cae90 0x7f28d40b1e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f28c400ec80 tx=0x7f28c40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:48.719 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.713+0000 7f28bbfff700 1 -- 172.21.15.135:0/182445342 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c400c850 con 0x7f28d40cae90 2023-10-06T04:27:48.719 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.713+0000 7f28bbfff700 1 -- 172.21.15.135:0/182445342 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c400c9b0 con 0x7f28d40cae90 2023-10-06T04:27:48.719 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.713+0000 7f28d919d700 1 -- 172.21.15.135:0/182445342 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d40b2bd0 con 0x7f28d40cae90 2023-10-06T04:27:48.719 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.713+0000 7f28bbfff700 1 -- 172.21.15.135:0/182445342 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c400cd50 con 0x7f28d40cae90 2023-10-06T04:27:48.719 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.713+0000 7f28d919d700 1 -- 172.21.15.135:0/182445342 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d40b3190 con 0x7f28d40cae90 2023-10-06T04:27:48.719 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.714+0000 7f28bbfff700 1 -- 172.21.15.135:0/182445342 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f28c4005c80 con 0x7f28d40cae90 2023-10-06T04:27:48.720 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.714+0000 7f28bbfff700 1 -- 172.21.15.135:0/182445342 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f28c4013680 con 0x7f28d40cae90 2023-10-06T04:27:48.720 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.714+0000 7f28d919d700 1 -- 172.21.15.135:0/182445342 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d40b3500 con 0x7f28d40cae90 2023-10-06T04:27:48.720 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.717+0000 7f28bbfff700 1 -- 172.21.15.135:0/182445342 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f28c4021060 con 0x7f28d40cae90 2023-10-06T04:27:48.768 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:48.766+0000 7fb29649b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T04:27:48.800 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:48.799+0000 7f07e1726180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T04:27:48.804 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.803+0000 7f28d919d700 1 -- 172.21.15.135:0/182445342 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c93dac22-53ef-4fcd-91dc-2eea732f7c07", "id": 4} v 0) v1 -- 0x7f28d405f230 con 0x7f28d40cae90 2023-10-06T04:27:48.811 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.809+0000 7f28bbfff700 1 -- 172.21.15.135:0/182445342 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c93dac22-53ef-4fcd-91dc-2eea732f7c07", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f28c4029020 con 0x7f28d40cae90 2023-10-06T04:27:48.812 INFO:teuthology.orchestra.run.smithi135.stdout:4 2023-10-06T04:27:48.812 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.810+0000 7f28d919d700 1 -- 172.21.15.135:0/182445342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d40cae90 msgr2=0x7f28d40b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:48.812 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.810+0000 7f28d919d700 1 --2- 172.21.15.135:0/182445342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d40cae90 0x7f28d40b1e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f28c400ec80 tx=0x7f28c40091a0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.812 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.811+0000 7f28d919d700 1 -- 172.21.15.135:0/182445342 shutdown_connections 2023-10-06T04:27:48.813 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.811+0000 7f28d919d700 1 --2- 172.21.15.135:0/182445342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28d415a250 0x7f28d413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.813 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.811+0000 7f28d919d700 1 --2- 172.21.15.135:0/182445342 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f28d40cae90 0x7f28d40b1e20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.813 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.811+0000 7f28d919d700 1 --2- 172.21.15.135:0/182445342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28d413c430 0x7f28d415dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:48.813 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.811+0000 7f28d919d700 1 -- 172.21.15.135:0/182445342 >> 172.21.15.135:0/182445342 conn(0x7f28d406b330 msgr2=0x7f28d40c3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:48.813 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.811+0000 7f28d919d700 1 -- 172.21.15.135:0/182445342 shutdown_connections 2023-10-06T04:27:48.813 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:48.811+0000 7f28d919d700 1 -- 172.21.15.135:0/182445342 wait complete. 2023-10-06T04:27:48.831 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 6ff97668-2f94-46a1-9682-8669f7d2a35d 5 2023-10-06T04:27:48.922 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:48.921+0000 7f07e1726180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T04:27:48.940 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:48.938+0000 7fb29649b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T04:27:49.009 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.007+0000 7ff41639d700 1 Processor -- start 2023-10-06T04:27:49.009 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.007+0000 7ff41639d700 1 -- start start 2023-10-06T04:27:49.012 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.008+0000 7ff41639d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff4100b2620 0x7ff4100cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:49.012 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.008+0000 7ff41639d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4100b29f0 0x7ff4100cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:49.013 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.008+0000 7ff41639d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4100cc970 con 0x7ff4100ceaa0 2023-10-06T04:27:49.013 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.008+0000 7ff41639d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4100cbd60 con 0x7ff4100b2620 2023-10-06T04:27:49.013 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.008+0000 7ff41639d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100cc040 con 0x7ff4100b29f0 2023-10-06T04:27:49.013 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.008+0000 7ff414b9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4100b29f0 0x7ff4100cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:49.013 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.008+0000 7ff41539b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff4100b2620 0x7ff4100cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:49.014 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.008+0000 7ff414b9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4100b29f0 0x7ff4100cd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:53878/0 (socket says 172.21.15.135:53878) 2023-10-06T04:27:49.014 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.008+0000 7ff414b9a700 1 -- 172.21.15.135:0/1465501455 learned_addr learned my addr 172.21.15.135:0/1465501455 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-06T04:27:49.014 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.009+0000 7ff41539b700 1 -- 172.21.15.135:0/1465501455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4100b29f0 msgr2=0x7ff4100cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:27:49.014 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.009+0000 7ff41539b700 1 --2- 172.21.15.135:0/1465501455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4100b29f0 0x7ff4100cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.014 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.009+0000 7ff41539b700 1 -- 172.21.15.135:0/1465501455 >> v1:172.21.15.60:6789/0 conn(0x7ff4100ceaa0 legacy=0x7ff4100cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:49.015 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.009+0000 7ff407fff700 1 -- 172.21.15.135:0/1465501455 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374181468 0 0) 0x7ff4100cc970 con 0x7ff4100ceaa0 2023-10-06T04:27:49.015 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.009+0000 7ff41539b700 1 -- 172.21.15.135:0/1465501455 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4100cc320 con 0x7ff4100b2620 2023-10-06T04:27:49.015 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.009+0000 7ff414b9a700 1 --2- 172.21.15.135:0/1465501455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4100b29f0 0x7ff4100cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:27:49.015 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.009+0000 7ff41539b700 1 --2- 172.21.15.135:0/1465501455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4100b2620 0x7ff4100cccb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0098d0 tx=0x7ff40c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce02143c9cf832ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:49.015 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.009+0000 7ff407fff700 1 -- 172.21.15.135:0/1465501455 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c00b640 con 0x7ff4100b2620 2023-10-06T04:27:49.015 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.009+0000 7ff407fff700 1 -- 172.21.15.135:0/1465501455 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c00b7a0 con 0x7ff4100b2620 2023-10-06T04:27:49.016 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.009+0000 7ff407fff700 1 -- 172.21.15.135:0/1465501455 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c00bb60 con 0x7ff4100b2620 2023-10-06T04:27:49.016 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.010+0000 7ff41639d700 1 -- 172.21.15.135:0/1465501455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4100b2620 msgr2=0x7ff4100cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:49.016 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.010+0000 7ff41639d700 1 --2- 172.21.15.135:0/1465501455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4100b2620 0x7ff4100cccb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0098d0 tx=0x7ff40c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.016 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.010+0000 7ff41639d700 1 -- 172.21.15.135:0/1465501455 shutdown_connections 2023-10-06T04:27:49.016 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.010+0000 7ff41639d700 1 --2- 172.21.15.135:0/1465501455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4100b2620 0x7ff4100cccb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.016 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.010+0000 7ff41639d700 1 --2- 172.21.15.135:0/1465501455 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4100b29f0 0x7ff4100cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.016 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.010+0000 7ff41639d700 1 -- 172.21.15.135:0/1465501455 >> 172.21.15.135:0/1465501455 conn(0x7ff410099520 msgr2=0x7ff41006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:49.016 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.010+0000 7ff41639d700 1 -- 172.21.15.135:0/1465501455 shutdown_connections 2023-10-06T04:27:49.017 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.010+0000 7ff41639d700 1 -- 172.21.15.135:0/1465501455 wait complete. 2023-10-06T04:27:49.020 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.012+0000 7ff41639d700 1 Processor -- start 2023-10-06T04:27:49.020 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.012+0000 7ff41639d700 1 -- start start 2023-10-06T04:27:49.020 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.013+0000 7ff41639d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4100b2620 0x7ff4100c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:49.020 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.013+0000 7ff41639d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4100b29f0 0x7ff4100b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:49.020 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.013+0000 7ff41639d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4100ceaa0 0x7ff4100c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:49.020 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.013+0000 7ff41639d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100b5fb0 con 0x7ff4100b2620 2023-10-06T04:27:49.020 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.013+0000 7ff41639d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100b49e0 con 0x7ff4100ceaa0 2023-10-06T04:27:49.021 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.013+0000 7ff41639d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41016a770 con 0x7ff4100b29f0 2023-10-06T04:27:49.021 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.013+0000 7ff414b9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4100b29f0 0x7ff4100b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:49.021 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.013+0000 7ff415b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4100ceaa0 0x7ff4100c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:49.021 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.013+0000 7ff414b9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4100b29f0 0x7ff4100b44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:53882/0 (socket says 172.21.15.135:53882) 2023-10-06T04:27:49.021 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.013+0000 7ff414b9a700 1 -- 172.21.15.135:0/1082526064 learned_addr learned my addr 172.21.15.135:0/1082526064 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-06T04:27:49.021 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.013+0000 7ff41539b700 1 --2- 172.21.15.135:0/1082526064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4100b2620 0x7ff4100c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:49.021 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.013+0000 7ff414b9a700 1 -- 172.21.15.135:0/1082526064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4100ceaa0 msgr2=0x7ff4100c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:49.021 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.013+0000 7ff414b9a700 1 --2- 172.21.15.135:0/1082526064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4100ceaa0 0x7ff4100c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.021 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.013+0000 7ff414b9a700 1 -- 172.21.15.135:0/1082526064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4100b2620 msgr2=0x7ff4100c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:49.021 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.013+0000 7ff414b9a700 1 --2- 172.21.15.135:0/1082526064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4100b2620 0x7ff4100c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.021 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.013+0000 7ff414b9a700 1 -- 172.21.15.135:0/1082526064 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4000094f0 con 0x7ff4100b29f0 2023-10-06T04:27:49.022 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.014+0000 7ff414b9a700 1 --2- 172.21.15.135:0/1082526064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4100b29f0 0x7ff4100b44a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff40000ec50 tx=0x7ff400009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:49.022 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.014+0000 7ff4057fa700 1 -- 172.21.15.135:0/1082526064 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40000c850 con 0x7ff4100b29f0 2023-10-06T04:27:49.022 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.014+0000 7ff4057fa700 1 -- 172.21.15.135:0/1082526064 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40000c9b0 con 0x7ff4100b29f0 2023-10-06T04:27:49.022 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.014+0000 7ff41639d700 1 -- 172.21.15.135:0/1082526064 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40c0093c0 con 0x7ff4100b29f0 2023-10-06T04:27:49.022 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.014+0000 7ff4057fa700 1 -- 172.21.15.135:0/1082526064 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40000cd50 con 0x7ff4100b29f0 2023-10-06T04:27:49.022 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.014+0000 7ff41639d700 1 -- 172.21.15.135:0/1082526064 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4100c7980 con 0x7ff4100b29f0 2023-10-06T04:27:49.022 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.014+0000 7ff4057fa700 1 -- 172.21.15.135:0/1082526064 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff400005a00 con 0x7ff4100b29f0 2023-10-06T04:27:49.022 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.014+0000 7ff4057fa700 1 -- 172.21.15.135:0/1082526064 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7ff4000123d0 con 0x7ff4100b29f0 2023-10-06T04:27:49.022 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.015+0000 7ff41639d700 1 -- 172.21.15.135:0/1082526064 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41005f230 con 0x7ff4100b29f0 2023-10-06T04:27:49.022 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.017+0000 7ff4057fa700 1 -- 172.21.15.135:0/1082526064 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff400021060 con 0x7ff4100b29f0 2023-10-06T04:27:49.063 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:49.061+0000 7fb29649b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T04:27:49.105 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.103+0000 7ff41639d700 1 -- 172.21.15.135:0/1082526064 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6ff97668-2f94-46a1-9682-8669f7d2a35d", "id": 5} v 0) v1 -- 0x7ff4100cc600 con 0x7ff4100b29f0 2023-10-06T04:27:49.114 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.112+0000 7ff4057fa700 1 -- 172.21.15.135:0/1082526064 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6ff97668-2f94-46a1-9682-8669f7d2a35d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff400017070 con 0x7ff4100b29f0 2023-10-06T04:27:49.115 INFO:teuthology.orchestra.run.smithi135.stdout:5 2023-10-06T04:27:49.116 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.113+0000 7ff41639d700 1 -- 172.21.15.135:0/1082526064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4100b29f0 msgr2=0x7ff4100b44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:49.116 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.113+0000 7ff41639d700 1 --2- 172.21.15.135:0/1082526064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4100b29f0 0x7ff4100b44a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff40000ec50 tx=0x7ff400009250 comp rx=0 tx=0).stop 2023-10-06T04:27:49.116 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.113+0000 7ff41639d700 1 -- 172.21.15.135:0/1082526064 shutdown_connections 2023-10-06T04:27:49.117 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.113+0000 7ff41639d700 1 --2- 172.21.15.135:0/1082526064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4100b2620 0x7ff4100c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.117 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.113+0000 7ff41639d700 1 --2- 172.21.15.135:0/1082526064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4100ceaa0 0x7ff4100c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.117 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.113+0000 7ff41639d700 1 --2- 172.21.15.135:0/1082526064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4100b29f0 0x7ff4100b44a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.117 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.113+0000 7ff41639d700 1 -- 172.21.15.135:0/1082526064 >> 172.21.15.135:0/1082526064 conn(0x7ff410099520 msgr2=0x7ff410154000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:49.117 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.113+0000 7ff41639d700 1 -- 172.21.15.135:0/1082526064 shutdown_connections 2023-10-06T04:27:49.117 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.113+0000 7ff41639d700 1 -- 172.21.15.135:0/1082526064 wait complete. 2023-10-06T04:27:49.132 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 9acb6ea5-5b3a-435f-8593-fa711459750c 6 2023-10-06T04:27:49.308 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.306+0000 7efe0639d700 1 Processor -- start 2023-10-06T04:27:49.308 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.307+0000 7efe0639d700 1 -- start start 2023-10-06T04:27:49.311 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.308+0000 7efe0639d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efe000cca70 0x7efe000d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:49.311 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.308+0000 7efe0639d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efe000d07f0 0x7efe000ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:49.311 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.308+0000 7efe0639d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe000cdbf0 con 0x7efe00153990 2023-10-06T04:27:49.311 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.308+0000 7efe0639d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe000cb4c0 con 0x7efe000d07f0 2023-10-06T04:27:49.311 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.308+0000 7efe0639d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe000d0c10 con 0x7efe000cca70 2023-10-06T04:27:49.312 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.308+0000 7efe04b9a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efe000cca70 0x7efe000d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:49.312 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.308+0000 7efe04b9a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efe000cca70 0x7efe000d02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37284/0 (socket says 172.21.15.135:37284) 2023-10-06T04:27:49.312 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.308+0000 7efe04b9a700 1 -- 172.21.15.135:0/2442869379 learned_addr learned my addr 172.21.15.135:0/2442869379 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-06T04:27:49.312 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.308+0000 7efe05b9c700 1 --2- 172.21.15.135:0/2442869379 >> v2:172.21.15.60:3300/0 conn(0x7efe000d07f0 0x7efe000ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:49.312 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.309+0000 7efe04b9a700 1 -- 172.21.15.135:0/2442869379 >> v2:172.21.15.60:3300/0 conn(0x7efe000d07f0 msgr2=0x7efe000ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:27:49.312 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.309+0000 7efe04b9a700 1 --2- 172.21.15.135:0/2442869379 >> v2:172.21.15.60:3300/0 conn(0x7efe000d07f0 0x7efe000ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.313 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.309+0000 7efe04b9a700 1 -- 172.21.15.135:0/2442869379 >> v1:172.21.15.60:6789/0 conn(0x7efe00153990 legacy=0x7efe0015a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:49.313 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.309+0000 7efe04b9a700 1 -- 172.21.15.135:0/2442869379 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe000ccfe0 con 0x7efe000cca70 2023-10-06T04:27:49.313 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.309+0000 7efe04b9a700 1 --2- 172.21.15.135:0/2442869379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe000cca70 0x7efe000d02b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efe00088f40 tx=0x7efdf0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aab09ce7375a4c0c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:49.313 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.309+0000 7efdf7fff700 1 -- 172.21.15.135:0/2442869379 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf000b860 con 0x7efe000cca70 2023-10-06T04:27:49.313 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.309+0000 7efdf7fff700 1 -- 172.21.15.135:0/2442869379 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf000b9c0 con 0x7efe000cca70 2023-10-06T04:27:49.313 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.309+0000 7efdf7fff700 1 -- 172.21.15.135:0/2442869379 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf000bd60 con 0x7efe000cca70 2023-10-06T04:27:49.316 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.310+0000 7efe0639d700 1 -- 172.21.15.135:0/2442869379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe000cca70 msgr2=0x7efe000d02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:49.317 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.310+0000 7efe0639d700 1 --2- 172.21.15.135:0/2442869379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe000cca70 0x7efe000d02b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efe00088f40 tx=0x7efdf0009250 comp rx=0 tx=0).stop 2023-10-06T04:27:49.317 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.310+0000 7efe0639d700 1 -- 172.21.15.135:0/2442869379 shutdown_connections 2023-10-06T04:27:49.317 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.310+0000 7efe0639d700 1 --2- 172.21.15.135:0/2442869379 >> v2:172.21.15.60:3300/0 conn(0x7efe000d07f0 0x7efe000ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.317 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.310+0000 7efe0639d700 1 --2- 172.21.15.135:0/2442869379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe000cca70 0x7efe000d02b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.317 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.310+0000 7efe0639d700 1 -- 172.21.15.135:0/2442869379 >> 172.21.15.135:0/2442869379 conn(0x7efe000680c0 msgr2=0x7efe00068490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:49.317 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.310+0000 7efe0639d700 1 -- 172.21.15.135:0/2442869379 shutdown_connections 2023-10-06T04:27:49.317 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.310+0000 7efe0639d700 1 -- 172.21.15.135:0/2442869379 wait complete. 2023-10-06T04:27:49.317 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.311+0000 7efe0639d700 1 Processor -- start 2023-10-06T04:27:49.317 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.311+0000 7efe0639d700 1 -- start start 2023-10-06T04:27:49.317 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.312+0000 7efe0639d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe000cca70 0x7efe0016a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:49.318 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.312+0000 7efe0639d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe000d07f0 0x7efe000b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:49.318 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.312+0000 7efe0639d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe00153990 0x7efe0016c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:49.318 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.312+0000 7efe0639d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe000b4500 con 0x7efe000d07f0 2023-10-06T04:27:49.318 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.312+0000 7efe0639d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe000b3fc0 con 0x7efe000cca70 2023-10-06T04:27:49.318 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.312+0000 7efe0639d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe00169b00 con 0x7efe00153990 2023-10-06T04:27:49.318 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.312+0000 7efe0539b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe000cca70 0x7efe0016a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:49.318 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.312+0000 7efe05b9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe00153990 0x7efe0016c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:49.318 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.312+0000 7efe0539b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe000cca70 0x7efe0016a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37296/0 (socket says 172.21.15.135:37296) 2023-10-06T04:27:49.318 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.312+0000 7efe04b9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe000d07f0 0x7efe000b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:49.318 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.312+0000 7efe0539b700 1 -- 172.21.15.135:0/3625951180 learned_addr learned my addr 172.21.15.135:0/3625951180 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-06T04:27:49.319 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.313+0000 7efe0539b700 1 -- 172.21.15.135:0/3625951180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe00153990 msgr2=0x7efe0016c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:49.319 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.313+0000 7efe0539b700 1 --2- 172.21.15.135:0/3625951180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe00153990 0x7efe0016c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.319 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.313+0000 7efe0539b700 1 -- 172.21.15.135:0/3625951180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe000d07f0 msgr2=0x7efe000b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:49.319 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.313+0000 7efe0539b700 1 --2- 172.21.15.135:0/3625951180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe000d07f0 0x7efe000b3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.319 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.313+0000 7efe0539b700 1 -- 172.21.15.135:0/3625951180 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf00094f0 con 0x7efe000cca70 2023-10-06T04:27:49.319 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.313+0000 7efe04b9a700 1 --2- 172.21.15.135:0/3625951180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe000d07f0 0x7efe000b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:27:49.319 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.313+0000 7efe0539b700 1 --2- 172.21.15.135:0/3625951180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe000cca70 0x7efe0016a7f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00c590 tx=0x7efdfc00c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:49.320 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.313+0000 7efdf57fa700 1 -- 172.21.15.135:0/3625951180 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc011590 con 0x7efe000cca70 2023-10-06T04:27:49.320 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.313+0000 7efdf57fa700 1 -- 172.21.15.135:0/3625951180 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc011710 con 0x7efe000cca70 2023-10-06T04:27:49.320 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.313+0000 7efe0639d700 1 -- 172.21.15.135:0/3625951180 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe00169de0 con 0x7efe000cca70 2023-10-06T04:27:49.320 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.313+0000 7efdf57fa700 1 -- 172.21.15.135:0/3625951180 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc011ad0 con 0x7efe000cca70 2023-10-06T04:27:49.320 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.313+0000 7efe0639d700 1 -- 172.21.15.135:0/3625951180 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0016a3a0 con 0x7efe000cca70 2023-10-06T04:27:49.320 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.314+0000 7efdf57fa700 1 -- 172.21.15.135:0/3625951180 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7efdfc01c6c0 con 0x7efe000cca70 2023-10-06T04:27:49.320 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.314+0000 7efdf57fa700 1 -- 172.21.15.135:0/3625951180 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7efdfc012a20 con 0x7efe000cca70 2023-10-06T04:27:49.320 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.314+0000 7efe0639d700 1 -- 172.21.15.135:0/3625951180 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0005f230 con 0x7efe000cca70 2023-10-06T04:27:49.321 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.317+0000 7efdf57fa700 1 -- 172.21.15.135:0/3625951180 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7efdfc017070 con 0x7efe000cca70 2023-10-06T04:27:49.406 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.405+0000 7efe0639d700 1 -- 172.21.15.135:0/3625951180 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9acb6ea5-5b3a-435f-8593-fa711459750c", "id": 6} v 0) v1 -- 0x7efe000c8b20 con 0x7efe000cca70 2023-10-06T04:27:49.415 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.413+0000 7efdf57fa700 1 -- 172.21.15.135:0/3625951180 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9acb6ea5-5b3a-435f-8593-fa711459750c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7efdfc01c970 con 0x7efe000cca70 2023-10-06T04:27:49.415 INFO:teuthology.orchestra.run.smithi135.stdout:6 2023-10-06T04:27:49.416 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.414+0000 7efe0639d700 1 -- 172.21.15.135:0/3625951180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe000cca70 msgr2=0x7efe0016a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:49.416 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.414+0000 7efe0639d700 1 --2- 172.21.15.135:0/3625951180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe000cca70 0x7efe0016a7f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00c590 tx=0x7efdfc00c8a0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.416 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.414+0000 7efe0639d700 1 -- 172.21.15.135:0/3625951180 shutdown_connections 2023-10-06T04:27:49.416 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.414+0000 7efe0639d700 1 --2- 172.21.15.135:0/3625951180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efe00153990 0x7efe0016c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.417 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.414+0000 7efe0639d700 1 --2- 172.21.15.135:0/3625951180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe000cca70 0x7efe0016a7f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.417 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.414+0000 7efe0639d700 1 --2- 172.21.15.135:0/3625951180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe000d07f0 0x7efe000b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.417 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.414+0000 7efe0639d700 1 -- 172.21.15.135:0/3625951180 >> 172.21.15.135:0/3625951180 conn(0x7efe000680c0 msgr2=0x7efe00157550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:49.417 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.414+0000 7efe0639d700 1 -- 172.21.15.135:0/3625951180 shutdown_connections 2023-10-06T04:27:49.417 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.414+0000 7efe0639d700 1 -- 172.21.15.135:0/3625951180 wait complete. 2023-10-06T04:27:49.434 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new ae599361-48c6-4731-b4fe-18a603c1ca1d 7 2023-10-06T04:27:49.549 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:49.548+0000 7f07e1726180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T04:27:49.612 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.610+0000 7f104ab9d700 1 Processor -- start 2023-10-06T04:27:49.613 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.611+0000 7f104ab9d700 1 -- start start 2023-10-06T04:27:49.614 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.612+0000 7f104ab9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1044153990 0x7f104415a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:49.614 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.612+0000 7f104ab9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f10440d09c0 0x7f10440ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:49.614 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.612+0000 7f104ab9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10440cdbf0 con 0x7f10440cca70 2023-10-06T04:27:49.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.612+0000 7f104ab9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10440cb4c0 con 0x7f10440d09c0 2023-10-06T04:27:49.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.612+0000 7f104ab9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f104415a8b0 con 0x7f1044153990 2023-10-06T04:27:49.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.612+0000 7f1049b9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1044153990 0x7f104415a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:49.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.612+0000 7f1049b9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1044153990 0x7f104415a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:53904/0 (socket says 172.21.15.135:53904) 2023-10-06T04:27:49.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.612+0000 7f1049b9b700 1 -- 172.21.15.135:0/3217570289 learned_addr learned my addr 172.21.15.135:0/3217570289 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-06T04:27:49.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.612+0000 7f104939a700 1 --1- 172.21.15.135:0/3217570289 >> v1:172.21.15.135:6789/0 conn(0x7f10440cca70 0x7f10440d02b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:58938/0 (socket says 172.21.15.135:58938) 2023-10-06T04:27:49.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.612+0000 7f104a39c700 1 --2- 172.21.15.135:0/3217570289 >> v2:172.21.15.60:3300/0 conn(0x7f10440d09c0 0x7f10440ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:49.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.613+0000 7f1049b9b700 1 -- 172.21.15.135:0/3217570289 >> v2:172.21.15.60:3300/0 conn(0x7f10440d09c0 msgr2=0x7f10440ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:27:49.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.613+0000 7f1049b9b700 1 --2- 172.21.15.135:0/3217570289 >> v2:172.21.15.60:3300/0 conn(0x7f10440d09c0 0x7f10440ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.613+0000 7f1049b9b700 1 -- 172.21.15.135:0/3217570289 >> v1:172.21.15.135:6789/0 conn(0x7f10440cca70 legacy=0x7f10440d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:49.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.613+0000 7f1049b9b700 1 -- 172.21.15.135:0/3217570289 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10440ccfe0 con 0x7f1044153990 2023-10-06T04:27:49.615 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.613+0000 7f1048b99700 1 -- 172.21.15.135:0/3217570289 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665548677 0 0) 0x7f10440cdbf0 con 0x7f10440cca70 2023-10-06T04:27:49.616 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.613+0000 7f1049b9b700 1 --2- 172.21.15.135:0/3217570289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1044153990 0x7f104415a370 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f10400099b0 tx=0x7f1040009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6eb6519dcc792b7b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:49.617 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.613+0000 7f1048b99700 1 -- 172.21.15.135:0/3217570289 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1040009ea0 con 0x7f1044153990 2023-10-06T04:27:49.617 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.613+0000 7f1048b99700 1 -- 172.21.15.135:0/3217570289 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104000b860 con 0x7f1044153990 2023-10-06T04:27:49.617 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.613+0000 7f1048b99700 1 -- 172.21.15.135:0/3217570289 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104000bc00 con 0x7f1044153990 2023-10-06T04:27:49.617 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.614+0000 7f104ab9d700 1 -- 172.21.15.135:0/3217570289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1044153990 msgr2=0x7f104415a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:49.617 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.614+0000 7f104ab9d700 1 --2- 172.21.15.135:0/3217570289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1044153990 0x7f104415a370 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f10400099b0 tx=0x7f1040009250 comp rx=0 tx=0).stop 2023-10-06T04:27:49.617 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.614+0000 7f104ab9d700 1 -- 172.21.15.135:0/3217570289 shutdown_connections 2023-10-06T04:27:49.617 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.614+0000 7f104ab9d700 1 --2- 172.21.15.135:0/3217570289 >> v2:172.21.15.60:3300/0 conn(0x7f10440d09c0 0x7f10440ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.617 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.614+0000 7f104ab9d700 1 --2- 172.21.15.135:0/3217570289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1044153990 0x7f104415a370 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.617 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.614+0000 7f104ab9d700 1 -- 172.21.15.135:0/3217570289 >> 172.21.15.135:0/3217570289 conn(0x7f10440680c0 msgr2=0x7f1044068490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:49.617 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.614+0000 7f104ab9d700 1 -- 172.21.15.135:0/3217570289 shutdown_connections 2023-10-06T04:27:49.617 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.614+0000 7f104ab9d700 1 -- 172.21.15.135:0/3217570289 wait complete. 2023-10-06T04:27:49.620 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.616+0000 7f104ab9d700 1 Processor -- start 2023-10-06T04:27:49.620 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.616+0000 7f104ab9d700 1 -- start start 2023-10-06T04:27:49.620 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.617+0000 7f104ab9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10440cca70 0x7f10440c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:49.620 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.617+0000 7f104ab9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10440d09c0 0x7f104414f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:49.620 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.617+0000 7f104ab9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1044153990 0x7f104415b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:49.620 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.617+0000 7f104ab9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10440c71a0 con 0x7f10440d09c0 2023-10-06T04:27:49.620 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.617+0000 7f104ab9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10440c73d0 con 0x7f10440cca70 2023-10-06T04:27:49.620 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.617+0000 7f104ab9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10440c7990 con 0x7f1044153990 2023-10-06T04:27:49.620 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.617+0000 7f1049b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10440cca70 0x7f10440c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:49.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.617+0000 7f1049b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10440cca70 0x7f10440c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37300/0 (socket says 172.21.15.135:37300) 2023-10-06T04:27:49.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.617+0000 7f1049b9b700 1 -- 172.21.15.135:0/3898382944 learned_addr learned my addr 172.21.15.135:0/3898382944 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-10-06T04:27:49.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.617+0000 7f104939a700 1 --2- 172.21.15.135:0/3898382944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10440d09c0 0x7f104414f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:49.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.617+0000 7f104a39c700 1 --2- 172.21.15.135:0/3898382944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1044153990 0x7f104415b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:49.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.617+0000 7f1049b9b700 1 -- 172.21.15.135:0/3898382944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1044153990 msgr2=0x7f104415b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:49.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.617+0000 7f1049b9b700 1 --2- 172.21.15.135:0/3898382944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1044153990 0x7f104415b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.617+0000 7f1049b9b700 1 -- 172.21.15.135:0/3898382944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10440d09c0 msgr2=0x7f104414f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:49.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.617+0000 7f1049b9b700 1 --2- 172.21.15.135:0/3898382944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10440d09c0 0x7f104414f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.617+0000 7f1049b9b700 1 -- 172.21.15.135:0/3898382944 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10400094f0 con 0x7f10440cca70 2023-10-06T04:27:49.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.617+0000 7f104a39c700 1 --2- 172.21.15.135:0/3898382944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1044153990 0x7f104415b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:27:49.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.618+0000 7f1049b9b700 1 --2- 172.21.15.135:0/3898382944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10440cca70 0x7f10440c6c60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f104000b3c0 tx=0x7f1040017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:49.621 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.618+0000 7f1039ffb700 1 -- 172.21.15.135:0/3898382944 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1040000d10 con 0x7f10440cca70 2023-10-06T04:27:49.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.618+0000 7f1039ffb700 1 -- 172.21.15.135:0/3898382944 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104000bbe0 con 0x7f10440cca70 2023-10-06T04:27:49.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.618+0000 7f104ab9d700 1 -- 172.21.15.135:0/3898382944 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10440c5c50 con 0x7f10440cca70 2023-10-06T04:27:49.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.618+0000 7f1039ffb700 1 -- 172.21.15.135:0/3898382944 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1040011670 con 0x7f10440cca70 2023-10-06T04:27:49.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.618+0000 7f104ab9d700 1 -- 172.21.15.135:0/3898382944 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10440c7620 con 0x7f10440cca70 2023-10-06T04:27:49.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.618+0000 7f1039ffb700 1 -- 172.21.15.135:0/3898382944 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1040011ce0 con 0x7f10440cca70 2023-10-06T04:27:49.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.618+0000 7f1039ffb700 1 -- 172.21.15.135:0/3898382944 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f1040025a70 con 0x7f10440cca70 2023-10-06T04:27:49.622 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.619+0000 7f104ab9d700 1 -- 172.21.15.135:0/3898382944 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f104405f230 con 0x7f10440cca70 2023-10-06T04:27:49.623 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.621+0000 7f1039ffb700 1 -- 172.21.15.135:0/3898382944 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1040015020 con 0x7f10440cca70 2023-10-06T04:27:49.648 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:49.647+0000 7f07e1726180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T04:27:49.699 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:49.697+0000 7fb29649b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T04:27:49.708 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.706+0000 7f104ab9d700 1 -- 172.21.15.135:0/3898382944 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ae599361-48c6-4731-b4fe-18a603c1ca1d", "id": 7} v 0) v1 -- 0x7f10440cd2c0 con 0x7f10440cca70 2023-10-06T04:27:49.716 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.714+0000 7f1039ffb700 1 -- 172.21.15.135:0/3898382944 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ae599361-48c6-4731-b4fe-18a603c1ca1d", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f104002e440 con 0x7f10440cca70 2023-10-06T04:27:49.717 INFO:teuthology.orchestra.run.smithi135.stdout:7 2023-10-06T04:27:49.718 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.715+0000 7f104ab9d700 1 -- 172.21.15.135:0/3898382944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10440cca70 msgr2=0x7f10440c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:49.718 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.715+0000 7f104ab9d700 1 --2- 172.21.15.135:0/3898382944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10440cca70 0x7f10440c6c60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f104000b3c0 tx=0x7f1040017000 comp rx=0 tx=0).stop 2023-10-06T04:27:49.718 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.715+0000 7f104ab9d700 1 -- 172.21.15.135:0/3898382944 shutdown_connections 2023-10-06T04:27:49.719 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.715+0000 7f104ab9d700 1 --2- 172.21.15.135:0/3898382944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1044153990 0x7f104415b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.719 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.715+0000 7f104ab9d700 1 --2- 172.21.15.135:0/3898382944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10440cca70 0x7f10440c6c60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.719 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.715+0000 7f104ab9d700 1 --2- 172.21.15.135:0/3898382944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10440d09c0 0x7f104414f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:49.719 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.715+0000 7f104ab9d700 1 -- 172.21.15.135:0/3898382944 >> 172.21.15.135:0/3898382944 conn(0x7f10440680c0 msgr2=0x7f104415c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:49.719 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.715+0000 7f104ab9d700 1 -- 172.21.15.135:0/3898382944 shutdown_connections 2023-10-06T04:27:49.719 INFO:teuthology.orchestra.run.smithi135.stderr:2023-10-06T04:27:49.716+0000 7f104ab9d700 1 -- 172.21.15.135:0/3898382944 wait complete. 2023-10-06T04:27:49.734 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T04:27:49.734 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T04:27:49.738 INFO:tasks.ceph.osd.0:Started 2023-10-06T04:27:49.738 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T04:27:49.739 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T04:27:49.743 INFO:tasks.ceph.osd.1:Started 2023-10-06T04:27:49.743 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T04:27:49.743 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T04:27:49.749 INFO:tasks.ceph.osd.2:Started 2023-10-06T04:27:49.749 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T04:27:49.749 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T04:27:49.756 INFO:tasks.ceph.osd.3:Started 2023-10-06T04:27:49.756 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T04:27:49.756 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T04:27:49.757 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:49.751+0000 7f07e1726180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T04:27:49.762 INFO:tasks.ceph.osd.4:Started 2023-10-06T04:27:49.762 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T04:27:49.762 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T04:27:49.766 INFO:tasks.ceph.osd.5:Started 2023-10-06T04:27:49.767 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T04:27:49.767 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T04:27:49.773 INFO:tasks.ceph.osd.6:Started 2023-10-06T04:27:49.774 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T04:27:49.774 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T04:27:49.779 INFO:tasks.ceph.osd.7:Started 2023-10-06T04:27:49.780 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:27:49.810 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:49.808+0000 7fb29649b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T04:27:49.927 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:49.925+0000 7fb29649b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T04:27:50.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.026+0000 7f53b39ff700 1 Processor -- start 2023-10-06T04:27:50.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.027+0000 7f53b39ff700 1 -- start start 2023-10-06T04:27:50.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.028+0000 7f53b39ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53ac0b49a0 0x7f53ac0aac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:50.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.028+0000 7f53b39ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f53ac0b0760 0x7f53ac0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:50.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.028+0000 7f53b39ff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ac0b0c60 con 0x7f53ac159560 2023-10-06T04:27:50.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.028+0000 7f53b39ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ac0b0f40 con 0x7f53ac0b0760 2023-10-06T04:27:50.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.028+0000 7f53b39ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac0b1220 con 0x7f53ac0b49a0 2023-10-06T04:27:50.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.028+0000 7f53b179b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f53ac159560 0x7f53ac0aa530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55640/0 (socket says 172.21.15.60:55640) 2023-10-06T04:27:50.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.028+0000 7f53b179b700 1 -- 172.21.15.60:0/3355035734 learned_addr learned my addr 172.21.15.60:0/3355035734 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:27:50.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.028+0000 7f53b1f9c700 1 --2- 172.21.15.60:0/3355035734 >> v2:172.21.15.135:3300/0 conn(0x7f53ac0b0760 0x7f53ac0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:50.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.028+0000 7f53b0f9a700 1 --2- 172.21.15.60:0/3355035734 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53ac0b49a0 0x7f53ac0aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:50.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.029+0000 7f53a3fff700 1 -- 172.21.15.60:0/3355035734 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1615738137 0 0) 0x7f53ac0b0c60 con 0x7f53ac159560 2023-10-06T04:27:50.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.029+0000 7f53a3fff700 1 -- 172.21.15.60:0/3355035734 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5398003570 con 0x7f53ac159560 2023-10-06T04:27:50.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.029+0000 7f53b0f9a700 1 -- 172.21.15.60:0/3355035734 >> v2:172.21.15.135:3300/0 conn(0x7f53ac0b0760 msgr2=0x7f53ac0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:27:50.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.029+0000 7f53b0f9a700 1 --2- 172.21.15.60:0/3355035734 >> v2:172.21.15.135:3300/0 conn(0x7f53ac0b0760 0x7f53ac0b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:50.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.029+0000 7f53b0f9a700 1 -- 172.21.15.60:0/3355035734 >> v1:172.21.15.60:6789/0 conn(0x7f53ac159560 legacy=0x7f53ac0aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:50.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.029+0000 7f53b0f9a700 1 -- 172.21.15.60:0/3355035734 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac0b1500 con 0x7f53ac0b49a0 2023-10-06T04:27:50.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.029+0000 7f53b1f9c700 1 --2- 172.21.15.60:0/3355035734 >> v2:172.21.15.135:3300/0 conn(0x7f53ac0b0760 0x7f53ac0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:27:50.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.029+0000 7f53b0f9a700 1 --2- 172.21.15.60:0/3355035734 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53ac0b49a0 0x7f53ac0aac40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f539c0098e0 tx=0x7f539c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4dd7932fd0cd80b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:50.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.029+0000 7f53a3fff700 1 -- 172.21.15.60:0/3355035734 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c011630 con 0x7f53ac0b49a0 2023-10-06T04:27:50.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.029+0000 7f53a3fff700 1 -- 172.21.15.60:0/3355035734 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539c011790 con 0x7f53ac0b49a0 2023-10-06T04:27:50.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.029+0000 7f53a3fff700 1 -- 172.21.15.60:0/3355035734 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c011b50 con 0x7f53ac0b49a0 2023-10-06T04:27:50.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.030+0000 7f53b39ff700 1 -- 172.21.15.60:0/3355035734 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53ac0b49a0 msgr2=0x7f53ac0aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:50.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.030+0000 7f53b39ff700 1 --2- 172.21.15.60:0/3355035734 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53ac0b49a0 0x7f53ac0aac40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f539c0098e0 tx=0x7f539c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:27:50.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.030+0000 7f53b39ff700 1 -- 172.21.15.60:0/3355035734 shutdown_connections 2023-10-06T04:27:50.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.030+0000 7f53b39ff700 1 --2- 172.21.15.60:0/3355035734 >> v2:172.21.15.135:3300/0 conn(0x7f53ac0b0760 0x7f53ac0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:50.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.030+0000 7f53b39ff700 1 --2- 172.21.15.60:0/3355035734 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53ac0b49a0 0x7f53ac0aac40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:50.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.030+0000 7f53b39ff700 1 -- 172.21.15.60:0/3355035734 >> 172.21.15.60:0/3355035734 conn(0x7f53ac0997f0 msgr2=0x7f53ac06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:50.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.030+0000 7f53b39ff700 1 -- 172.21.15.60:0/3355035734 shutdown_connections 2023-10-06T04:27:50.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.030+0000 7f53b39ff700 1 -- 172.21.15.60:0/3355035734 wait complete. 2023-10-06T04:27:50.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.032+0000 7f53b39ff700 1 Processor -- start 2023-10-06T04:27:50.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.032+0000 7f53b39ff700 1 -- start start 2023-10-06T04:27:50.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.033+0000 7f53b39ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53ac0b0760 0x7f53ac0aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:50.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.033+0000 7f53b39ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53ac0b49a0 0x7f53ac169aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:50.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.033+0000 7f53b39ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53ac159560 0x7f53ac15c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:50.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.033+0000 7f53b39ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac15d150 con 0x7f53ac0b49a0 2023-10-06T04:27:50.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.033+0000 7f53b39ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac0abcd0 con 0x7f53ac159560 2023-10-06T04:27:50.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.033+0000 7f53b39ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac15ce80 con 0x7f53ac0b0760 2023-10-06T04:27:50.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.033+0000 7f53b179b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53ac0b0760 0x7f53ac0aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:50.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.033+0000 7f53b0f9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53ac0b49a0 0x7f53ac169aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:50.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.033+0000 7f53b179b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53ac0b0760 0x7f53ac0aeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:33858/0 (socket says 172.21.15.60:33858) 2023-10-06T04:27:50.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.033+0000 7f53b179b700 1 -- 172.21.15.60:0/2644170554 learned_addr learned my addr 172.21.15.60:0/2644170554 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:27:50.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.033+0000 7f53b0f9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53ac0b49a0 0x7f53ac169aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44640/0 (socket says 172.21.15.60:44640) 2023-10-06T04:27:50.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.033+0000 7f53b1f9c700 1 --2- 172.21.15.60:0/2644170554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53ac159560 0x7f53ac15c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:50.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.034+0000 7f53b179b700 1 -- 172.21.15.60:0/2644170554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53ac159560 msgr2=0x7f53ac15c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:50.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.034+0000 7f53b179b700 1 --2- 172.21.15.60:0/2644170554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53ac159560 0x7f53ac15c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:50.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.034+0000 7f53b179b700 1 -- 172.21.15.60:0/2644170554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53ac0b49a0 msgr2=0x7f53ac169aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:50.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.034+0000 7f53b179b700 1 --2- 172.21.15.60:0/2644170554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53ac0b49a0 0x7f53ac169aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:50.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.034+0000 7f53b179b700 1 -- 172.21.15.60:0/2644170554 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a4009a20 con 0x7f53ac0b0760 2023-10-06T04:27:50.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.034+0000 7f53b0f9a700 1 --2- 172.21.15.60:0/2644170554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53ac0b49a0 0x7f53ac169aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:27:50.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.034+0000 7f53b179b700 1 --2- 172.21.15.60:0/2644170554 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53ac0b0760 0x7f53ac0aeca0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f53a800c7c0 tx=0x7f53a8007c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:50.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.034+0000 7f53a17fa700 1 -- 172.21.15.60:0/2644170554 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a80072e0 con 0x7f53ac0b0760 2023-10-06T04:27:50.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.034+0000 7f53a17fa700 1 -- 172.21.15.60:0/2644170554 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a8007440 con 0x7f53ac0b0760 2023-10-06T04:27:50.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.034+0000 7f53a17fa700 1 -- 172.21.15.60:0/2644170554 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a80057f0 con 0x7f53ac0b0760 2023-10-06T04:27:50.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.034+0000 7f53b39ff700 1 -- 172.21.15.60:0/2644170554 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f539c009420 con 0x7f53ac0b0760 2023-10-06T04:27:50.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.035+0000 7f53b39ff700 1 -- 172.21.15.60:0/2644170554 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ac0ab680 con 0x7f53ac0b0760 2023-10-06T04:27:50.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.035+0000 7f53a17fa700 1 -- 172.21.15.60:0/2644170554 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f53a8012400 con 0x7f53ac0b0760 2023-10-06T04:27:50.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.035+0000 7f53a17fa700 1 -- 172.21.15.60:0/2644170554 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f53a801ba90 con 0x7f53ac0b0760 2023-10-06T04:27:50.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.036+0000 7f53b39ff700 1 -- 172.21.15.60:0/2644170554 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ac159130 con 0x7f53ac0b0760 2023-10-06T04:27:50.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.039+0000 7f53a17fa700 1 -- 172.21.15.60:0/2644170554 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f53a8021060 con 0x7f53ac0b0760 2023-10-06T04:27:50.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.140+0000 7f53b39ff700 1 -- 172.21.15.60:0/2644170554 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53ac064a90 con 0x7f53ac0b0760 2023-10-06T04:27:50.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.141+0000 7f53a17fa700 1 -- 172.21.15.60:0/2644170554 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f53a8017070 con 0x7f53ac0b0760 2023-10-06T04:27:50.143 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:27:50.143 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":10,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:27:49.708805+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:27:50.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.142+0000 7f53b39ff700 1 -- 172.21.15.60:0/2644170554 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53ac0b0760 msgr2=0x7f53ac0aeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:50.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.142+0000 7f53b39ff700 1 --2- 172.21.15.60:0/2644170554 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53ac0b0760 0x7f53ac0aeca0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f53a800c7c0 tx=0x7f53a8007c80 comp rx=0 tx=0).stop 2023-10-06T04:27:50.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.142+0000 7f53b39ff700 1 -- 172.21.15.60:0/2644170554 shutdown_connections 2023-10-06T04:27:50.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.142+0000 7f53b39ff700 1 --2- 172.21.15.60:0/2644170554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53ac159560 0x7f53ac15c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:50.145 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.142+0000 7f53b39ff700 1 --2- 172.21.15.60:0/2644170554 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53ac0b0760 0x7f53ac0aeca0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:50.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.142+0000 7f53b39ff700 1 --2- 172.21.15.60:0/2644170554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53ac0b49a0 0x7f53ac169aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:50.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.142+0000 7f53b39ff700 1 -- 172.21.15.60:0/2644170554 >> 172.21.15.60:0/2644170554 conn(0x7f53ac0997f0 msgr2=0x7f53ac158a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:50.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.142+0000 7f53b39ff700 1 -- 172.21.15.60:0/2644170554 shutdown_connections 2023-10-06T04:27:50.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:50.142+0000 7f53b39ff700 1 -- 172.21.15.60:0/2644170554 wait complete. 2023-10-06T04:27:50.160 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T04:27:50.161 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T04:27:50.433 INFO:tasks.ceph.osd.1.smithi060.stderr:2023-10-06T04:27:50.432+0000 7fc77cd54540 -1 Falling back to public interface 2023-10-06T04:27:50.435 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-10-06T04:27:50.433+0000 7fe0b2c34540 -1 Falling back to public interface 2023-10-06T04:27:50.435 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-10-06T04:27:50.433+0000 7f98f7a16540 -1 Falling back to public interface 2023-10-06T04:27:50.436 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-10-06T04:27:50.433+0000 7fe0a9ffd700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2023-10-06T04:27:50.436 INFO:tasks.ceph.osd.0.smithi060.stderr:2023-10-06T04:27:50.434+0000 7f775c57a540 -1 Falling back to public interface 2023-10-06T04:27:50.454 INFO:tasks.ceph.osd.2.smithi060.stderr:2023-10-06T04:27:50.452+0000 7fa1add5d540 -1 Falling back to public interface 2023-10-06T04:27:50.461 INFO:tasks.ceph.osd.3.smithi060.stderr:2023-10-06T04:27:50.460+0000 7f80da921540 -1 Falling back to public interface 2023-10-06T04:27:50.468 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-10-06T04:27:50.465+0000 7fddbb1bd540 -1 Falling back to public interface 2023-10-06T04:27:50.483 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-10-06T04:27:50.481+0000 7fd4d5b22540 -1 Falling back to public interface 2023-10-06T04:27:50.567 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:50.566+0000 7f07e1726180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T04:27:50.654 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:50.652+0000 7fb29649b180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T04:27:50.744 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:50.743+0000 7f07e1726180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:27:50.825 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:50.823+0000 7fb29649b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T04:27:50.854 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:50.853+0000 7f07e1726180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T04:27:50.939 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:50.937+0000 7fb29649b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T04:27:50.966 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T04:27:51.132 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.131+0000 7f76e0f9d700 1 Processor -- start 2023-10-06T04:27:51.132 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.131+0000 7f76e0f9d700 1 -- start start 2023-10-06T04:27:51.134 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.132+0000 7f76e0f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76dc1537d0 0x7f76dc153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:51.134 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.132+0000 7f76e0f9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f76dc15d130 0x7f76dc15a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:51.134 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.132+0000 7f76e0f9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76dc15d5a0 con 0x7f76dc0cc950 2023-10-06T04:27:51.134 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.132+0000 7f76e0f9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76dc0cbd80 con 0x7f76dc15d130 2023-10-06T04:27:51.134 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.132+0000 7f76e0f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc15aa90 con 0x7f76dc1537d0 2023-10-06T04:27:51.135 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.133+0000 7f76daffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f76dc15d130 0x7f76dc15a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:51.135 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.133+0000 7f76dbfff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f76dc0cc950 0x7f76dc0ccdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55648/0 (socket says 172.21.15.60:55648) 2023-10-06T04:27:51.135 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.133+0000 7f76dbfff700 1 -- 172.21.15.60:0/2894113504 learned_addr learned my addr 172.21.15.60:0/2894113504 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:27:51.135 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.133+0000 7f76db7fe700 1 --2- 172.21.15.60:0/2894113504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76dc1537d0 0x7f76dc153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:51.136 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.133+0000 7f76da7fc700 1 -- 172.21.15.60:0/2894113504 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009537720 0 0) 0x7f76dc15d5a0 con 0x7f76dc0cc950 2023-10-06T04:27:51.137 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.133+0000 7f76da7fc700 1 -- 172.21.15.60:0/2894113504 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76c4003570 con 0x7f76dc0cc950 2023-10-06T04:27:51.137 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.133+0000 7f76daffd700 1 -- 172.21.15.60:0/2894113504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76dc1537d0 msgr2=0x7f76dc153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:27:51.137 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.133+0000 7f76daffd700 1 --2- 172.21.15.60:0/2894113504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76dc1537d0 0x7f76dc153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:51.137 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.133+0000 7f76daffd700 1 -- 172.21.15.60:0/2894113504 >> v1:172.21.15.60:6789/0 conn(0x7f76dc0cc950 legacy=0x7f76dc0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:51.137 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.133+0000 7f76daffd700 1 -- 172.21.15.60:0/2894113504 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76dc0ce8b0 con 0x7f76dc15d130 2023-10-06T04:27:51.137 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.133+0000 7f76db7fe700 1 --2- 172.21.15.60:0/2894113504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76dc1537d0 0x7f76dc153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:27:51.137 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.134+0000 7f76daffd700 1 --2- 172.21.15.60:0/2894113504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76dc15d130 0x7f76dc15a550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f76d00098e0 tx=0x7f76d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b84be2121aada89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:51.137 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.134+0000 7f76da7fc700 1 -- 172.21.15.60:0/2894113504 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d0011630 con 0x7f76dc15d130 2023-10-06T04:27:51.137 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.134+0000 7f76da7fc700 1 -- 172.21.15.60:0/2894113504 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d0011790 con 0x7f76dc15d130 2023-10-06T04:27:51.137 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.134+0000 7f76da7fc700 1 -- 172.21.15.60:0/2894113504 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d0011b30 con 0x7f76dc15d130 2023-10-06T04:27:51.138 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.135+0000 7f76e0f9d700 1 -- 172.21.15.60:0/2894113504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76dc15d130 msgr2=0x7f76dc15a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:51.138 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.135+0000 7f76e0f9d700 1 --2- 172.21.15.60:0/2894113504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76dc15d130 0x7f76dc15a550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f76d00098e0 tx=0x7f76d00091a0 comp rx=0 tx=0).stop 2023-10-06T04:27:51.138 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.135+0000 7f76e0f9d700 1 -- 172.21.15.60:0/2894113504 shutdown_connections 2023-10-06T04:27:51.138 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.135+0000 7f76e0f9d700 1 --2- 172.21.15.60:0/2894113504 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76dc1537d0 0x7f76dc153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:51.138 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.135+0000 7f76e0f9d700 1 --2- 172.21.15.60:0/2894113504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76dc15d130 0x7f76dc15a550 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:51.138 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.135+0000 7f76e0f9d700 1 -- 172.21.15.60:0/2894113504 >> 172.21.15.60:0/2894113504 conn(0x7f76dc06ed40 msgr2=0x7f76dc06f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:51.138 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.135+0000 7f76e0f9d700 1 -- 172.21.15.60:0/2894113504 shutdown_connections 2023-10-06T04:27:51.138 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.135+0000 7f76e0f9d700 1 -- 172.21.15.60:0/2894113504 wait complete. 2023-10-06T04:27:51.141 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.136+0000 7f76e0f9d700 1 Processor -- start 2023-10-06T04:27:51.141 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.136+0000 7f76e0f9d700 1 -- start start 2023-10-06T04:27:51.141 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.137+0000 7f76e0f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76dc0cc950 0x7f76dc16d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:51.141 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.137+0000 7f76e0f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76dc1537d0 0x7f76dc0b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:51.141 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.137+0000 7f76e0f9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76dc15d130 0x7f76dc156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:51.141 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.137+0000 7f76e0f9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc151b80 con 0x7f76dc15d130 2023-10-06T04:27:51.141 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.137+0000 7f76e0f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc16e1f0 con 0x7f76dc1537d0 2023-10-06T04:27:51.141 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.137+0000 7f76e0f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc169ef0 con 0x7f76dc0cc950 2023-10-06T04:27:51.142 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.138+0000 7f76dbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76dc15d130 0x7f76dc156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:51.142 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.138+0000 7f76db7fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76dc0cc950 0x7f76dc16d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:51.142 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.138+0000 7f76daffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76dc1537d0 0x7f76dc0b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:51.142 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.138+0000 7f76dbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76dc15d130 0x7f76dc156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44662/0 (socket says 172.21.15.60:44662) 2023-10-06T04:27:51.142 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.138+0000 7f76dbfff700 1 -- 172.21.15.60:0/697581618 learned_addr learned my addr 172.21.15.60:0/697581618 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:27:51.142 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.138+0000 7f76dbfff700 1 -- 172.21.15.60:0/697581618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76dc0cc950 msgr2=0x7f76dc16d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:51.142 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.138+0000 7f76dbfff700 1 --2- 172.21.15.60:0/697581618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76dc0cc950 0x7f76dc16d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:51.143 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.138+0000 7f76dbfff700 1 -- 172.21.15.60:0/697581618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76dc1537d0 msgr2=0x7f76dc0b56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:51.143 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.138+0000 7f76dbfff700 1 --2- 172.21.15.60:0/697581618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76dc1537d0 0x7f76dc0b56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:51.143 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.138+0000 7f76dbfff700 1 -- 172.21.15.60:0/697581618 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc009420 con 0x7f76dc15d130 2023-10-06T04:27:51.144 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.138+0000 7f76dbfff700 1 --2- 172.21.15.60:0/697581618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76dc15d130 0x7f76dc156780 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f76d4001460 tx=0x7f76d4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:51.144 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.139+0000 7f76c37fe700 1 -- 172.21.15.60:0/697581618 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d400a890 con 0x7f76dc15d130 2023-10-06T04:27:51.144 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.139+0000 7f76c37fe700 1 -- 172.21.15.60:0/697581618 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d400a9f0 con 0x7f76dc15d130 2023-10-06T04:27:51.144 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.139+0000 7f76e0f9d700 1 -- 172.21.15.60:0/697581618 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d0009420 con 0x7f76dc15d130 2023-10-06T04:27:51.144 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.139+0000 7f76c37fe700 1 -- 172.21.15.60:0/697581618 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d400ad70 con 0x7f76dc15d130 2023-10-06T04:27:51.144 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.139+0000 7f76e0f9d700 1 -- 172.21.15.60:0/697581618 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76dc16dcb0 con 0x7f76dc15d130 2023-10-06T04:27:51.144 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.139+0000 7f76c37fe700 1 -- 172.21.15.60:0/697581618 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f76d4007300 con 0x7f76dc15d130 2023-10-06T04:27:51.144 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.139+0000 7f76c37fe700 1 -- 172.21.15.60:0/697581618 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f76d4012ae0 con 0x7f76dc15d130 2023-10-06T04:27:51.144 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.140+0000 7f76e0f9d700 1 -- 172.21.15.60:0/697581618 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76dc071700 con 0x7f76dc15d130 2023-10-06T04:27:51.145 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.142+0000 7f76c37fe700 1 -- 172.21.15.60:0/697581618 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f76d4012dc0 con 0x7f76dc15d130 2023-10-06T04:27:51.163 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:51.162+0000 7f07e1726180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T04:27:51.216 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.215+0000 7f76e0f9d700 1 -- 172.21.15.60:0/697581618 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76dc064a90 con 0x7f76dc15d130 2023-10-06T04:27:51.217 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.216+0000 7f76c37fe700 1 -- 172.21.15.60:0/697581618 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f76d4007670 con 0x7f76dc15d130 2023-10-06T04:27:51.217 INFO:teuthology.misc.health.smithi060.stdout: 2023-10-06T04:27:51.217 INFO:teuthology.misc.health.smithi060.stdout:{"epoch":10,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:27:49.708805+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:27:51.218 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.217+0000 7f76e0f9d700 1 -- 172.21.15.60:0/697581618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76dc15d130 msgr2=0x7f76dc156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:51.218 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.217+0000 7f76e0f9d700 1 --2- 172.21.15.60:0/697581618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76dc15d130 0x7f76dc156780 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f76d4001460 tx=0x7f76d4001ae0 comp rx=0 tx=0).stop 2023-10-06T04:27:51.218 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.217+0000 7f76e0f9d700 1 -- 172.21.15.60:0/697581618 shutdown_connections 2023-10-06T04:27:51.219 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.217+0000 7f76e0f9d700 1 --2- 172.21.15.60:0/697581618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76dc15d130 0x7f76dc156780 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:51.219 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.217+0000 7f76e0f9d700 1 --2- 172.21.15.60:0/697581618 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76dc0cc950 0x7f76dc16d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:51.220 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.217+0000 7f76e0f9d700 1 --2- 172.21.15.60:0/697581618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76dc1537d0 0x7f76dc0b56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:51.220 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.217+0000 7f76e0f9d700 1 -- 172.21.15.60:0/697581618 >> 172.21.15.60:0/697581618 conn(0x7f76dc06ed40 msgr2=0x7f76dc0cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:51.220 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.217+0000 7f76e0f9d700 1 -- 172.21.15.60:0/697581618 shutdown_connections 2023-10-06T04:27:51.220 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:51.217+0000 7f76e0f9d700 1 -- 172.21.15.60:0/697581618 wait complete. 2023-10-06T04:27:51.233 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T04:27:51.244 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:51.242+0000 7fb29649b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T04:27:51.265 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:51.264+0000 7f07e1726180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T04:27:51.342 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:51.340+0000 7fb29649b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T04:27:52.294 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:52.293+0000 7f07e1726180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T04:27:52.328 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:52.326+0000 7fb29649b180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T04:27:52.391 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:52.389+0000 7f07e1726180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T04:27:52.420 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:52.418+0000 7fb29649b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T04:27:52.486 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:52.485+0000 7f07e1726180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T04:27:52.512 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:52.510+0000 7fb29649b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T04:27:52.655 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:52.654+0000 7f07e1726180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T04:27:52.676 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:52.674+0000 7fb29649b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T04:27:52.764 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:52.763+0000 7f07e1726180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T04:27:52.798 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:52.796+0000 7fb29649b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T04:27:52.966 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:52.965+0000 7f07e1726180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T04:27:52.999 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:52.997+0000 7fb29649b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T04:27:53.066 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:53.065+0000 7f07e1726180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T04:27:53.104 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:53.103+0000 7fb29649b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T04:27:53.164 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:53.162+0000 7f07e1726180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T04:27:53.211 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:53.210+0000 7fb29649b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T04:27:53.291 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:53.290+0000 7f07e1726180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T04:27:53.313 INFO:tasks.ceph.mgr.x.smithi135.stderr:2023-10-06T04:27:53.312+0000 7fb29649b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T04:27:53.745 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-10-06T04:27:53.743+0000 7f98f7a16540 -1 osd.6 0 log_to_monitors true 2023-10-06T04:27:53.778 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-10-06T04:27:53.776+0000 7fe0b2c34540 -1 osd.5 0 log_to_monitors true 2023-10-06T04:27:54.029 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-10-06T04:27:54.028+0000 7fddbb1bd540 -1 osd.4 0 log_to_monitors true 2023-10-06T04:27:54.037 INFO:tasks.ceph.osd.3.smithi060.stderr:2023-10-06T04:27:54.036+0000 7f80da921540 -1 osd.3 0 log_to_monitors true 2023-10-06T04:27:54.071 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-10-06T04:27:54.069+0000 7fd4d5b22540 -1 osd.7 0 log_to_monitors true 2023-10-06T04:27:54.236 INFO:tasks.ceph.osd.1.smithi060.stderr:2023-10-06T04:27:54.235+0000 7fc77cd54540 -1 osd.1 0 log_to_monitors true 2023-10-06T04:27:54.275 INFO:tasks.ceph.osd.0.smithi060.stderr:2023-10-06T04:27:54.274+0000 7f775c57a540 -1 osd.0 0 log_to_monitors true 2023-10-06T04:27:54.293 INFO:tasks.ceph.osd.2.smithi060.stderr:2023-10-06T04:27:54.292+0000 7fa1add5d540 -1 osd.2 0 log_to_monitors true 2023-10-06T04:27:54.313 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:54.312+0000 7f07997fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T04:27:54.313 INFO:tasks.ceph.mgr.y.smithi060.stderr:2023-10-06T04:27:54.312+0000 7f07997fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T04:27:57.157 INFO:tasks.ceph.osd.1.smithi060.stderr:2023-10-06T04:27:57.153+0000 7fc771ff9700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T04:27:57.161 INFO:tasks.ceph.osd.3.smithi060.stderr:2023-10-06T04:27:57.159+0000 7f80cfbf9700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T04:27:57.164 INFO:tasks.ceph.osd.2.smithi060.stderr:2023-10-06T04:27:57.163+0000 7fa1a17f6700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T04:27:57.165 INFO:tasks.ceph.osd.1.smithi060.stderr:2023-10-06T04:27:57.161+0000 7fc7697e8700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:27:57.171 INFO:tasks.ceph.osd.3.smithi060.stderr:2023-10-06T04:27:57.169+0000 7f80c73e8700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:27:57.172 INFO:tasks.ceph.osd.2.smithi060.stderr:2023-10-06T04:27:57.171+0000 7fa19a7e8700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:27:57.280 INFO:tasks.ceph.osd.0.smithi060.stderr:2023-10-06T04:27:57.278+0000 7f774fff6700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T04:27:57.285 INFO:tasks.ceph.osd.0.smithi060.stderr:2023-10-06T04:27:57.284+0000 7f7748fe8700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:27:57.677 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-10-06T04:27:57.675+0000 7f98eb3f6700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T04:27:57.684 INFO:tasks.ceph.osd.6.smithi135.stderr:2023-10-06T04:27:57.683+0000 7f98e43e8700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:27:57.753 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-10-06T04:27:57.751+0000 7fddb03f9700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T04:27:57.760 INFO:tasks.ceph.osd.4.smithi135.stderr:2023-10-06T04:27:57.759+0000 7fdda7be8700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:27:57.770 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-10-06T04:27:57.768+0000 7fe0a67f6700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T04:27:57.780 INFO:tasks.ceph.osd.5.smithi135.stderr:2023-10-06T04:27:57.778+0000 7fe09f7e8700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:27:57.793 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-10-06T04:27:57.791+0000 7fd4c95f6700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T04:27:57.800 INFO:tasks.ceph.osd.7.smithi135.stderr:2023-10-06T04:27:57.799+0000 7fd4c25e8700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T04:27:58.039 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T04:27:58.220 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.219+0000 7f8eb7fff700 1 Processor -- start 2023-10-06T04:27:58.220 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.219+0000 7f8eb7fff700 1 -- start start 2023-10-06T04:27:58.222 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.220+0000 7f8eb7fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8eb81537d0 0x7f8eb8153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:58.222 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.220+0000 7f8eb7fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8eb815d130 0x7f8eb815a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:58.222 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.220+0000 7f8eb7fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb815d5b0 con 0x7f8eb80cc950 2023-10-06T04:27:58.222 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.220+0000 7f8eb7fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb80cbd80 con 0x7f8eb81537d0 2023-10-06T04:27:58.222 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.220+0000 7f8eb7fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb815aa90 con 0x7f8eb815d130 2023-10-06T04:27:58.222 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.221+0000 7f8eb6ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8eb81537d0 0x7f8eb8153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:58.222 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.221+0000 7f8eb77fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8eb80cc950 0x7f8eb80ccdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55384/0 (socket says 172.21.15.60:55384) 2023-10-06T04:27:58.223 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.221+0000 7f8eb77fe700 1 -- 172.21.15.60:0/3949264883 learned_addr learned my addr 172.21.15.60:0/3949264883 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:27:58.223 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.221+0000 7f8eb67fc700 1 --2- 172.21.15.60:0/3949264883 >> v2:172.21.15.135:3300/0 conn(0x7f8eb815d130 0x7f8eb815a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:58.224 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.221+0000 7f8eb5ffb700 1 -- 172.21.15.60:0/3949264883 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276050675 0 0) 0x7f8eb815d5b0 con 0x7f8eb80cc950 2023-10-06T04:27:58.224 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.221+0000 7f8eb5ffb700 1 -- 172.21.15.60:0/3949264883 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ea0003570 con 0x7f8eb80cc950 2023-10-06T04:27:58.224 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.221+0000 7f8eb6ffd700 1 -- 172.21.15.60:0/3949264883 >> v2:172.21.15.135:3300/0 conn(0x7f8eb815d130 msgr2=0x7f8eb815a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:27:58.225 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.221+0000 7f8eb6ffd700 1 --2- 172.21.15.60:0/3949264883 >> v2:172.21.15.135:3300/0 conn(0x7f8eb815d130 0x7f8eb815a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:58.225 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.221+0000 7f8eb6ffd700 1 -- 172.21.15.60:0/3949264883 >> v1:172.21.15.60:6789/0 conn(0x7f8eb80cc950 legacy=0x7f8eb80ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:58.225 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.221+0000 7f8eb6ffd700 1 -- 172.21.15.60:0/3949264883 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb80ce8b0 con 0x7f8eb81537d0 2023-10-06T04:27:58.225 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.222+0000 7f8eb6ffd700 1 --2- 172.21.15.60:0/3949264883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8eb81537d0 0x7f8eb8153ba0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80b2e00 tx=0x7f8ea80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5a8ae15340a817 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:58.225 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.222+0000 7f8eb5ffb700 1 -- 172.21.15.60:0/3949264883 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8011630 con 0x7f8eb81537d0 2023-10-06T04:27:58.225 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.222+0000 7f8eb5ffb700 1 -- 172.21.15.60:0/3949264883 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea80117b0 con 0x7f8eb81537d0 2023-10-06T04:27:58.225 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.222+0000 7f8eb5ffb700 1 -- 172.21.15.60:0/3949264883 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8011b70 con 0x7f8eb81537d0 2023-10-06T04:27:58.225 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.222+0000 7f8eb7fff700 1 -- 172.21.15.60:0/3949264883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8eb81537d0 msgr2=0x7f8eb8153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:58.225 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.222+0000 7f8eb7fff700 1 --2- 172.21.15.60:0/3949264883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8eb81537d0 0x7f8eb8153ba0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80b2e00 tx=0x7f8ea80091a0 comp rx=0 tx=0).stop 2023-10-06T04:27:58.225 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.222+0000 7f8eb7fff700 1 -- 172.21.15.60:0/3949264883 shutdown_connections 2023-10-06T04:27:58.225 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.222+0000 7f8eb7fff700 1 --2- 172.21.15.60:0/3949264883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8eb81537d0 0x7f8eb8153ba0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:58.225 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.222+0000 7f8eb7fff700 1 --2- 172.21.15.60:0/3949264883 >> v2:172.21.15.135:3300/0 conn(0x7f8eb815d130 0x7f8eb815a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:58.226 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.222+0000 7f8eb7fff700 1 -- 172.21.15.60:0/3949264883 >> 172.21.15.60:0/3949264883 conn(0x7f8eb806ed40 msgr2=0x7f8eb806f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:58.226 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.223+0000 7f8eb7fff700 1 -- 172.21.15.60:0/3949264883 shutdown_connections 2023-10-06T04:27:58.226 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.223+0000 7f8eb7fff700 1 -- 172.21.15.60:0/3949264883 wait complete. 2023-10-06T04:27:58.228 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.224+0000 7f8eb7fff700 1 Processor -- start 2023-10-06T04:27:58.228 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.224+0000 7f8eb7fff700 1 -- start start 2023-10-06T04:27:58.228 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.225+0000 7f8eb7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb80cc950 0x7f8eb816a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:58.228 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.225+0000 7f8eb7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8eb81537d0 0x7f8eb8156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:58.228 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.225+0000 7f8eb7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8eb815d130 0x7f8eb8144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:58.228 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.225+0000 7f8eb7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb816abd0 con 0x7f8eb815d130 2023-10-06T04:27:58.228 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.225+0000 7f8eb7fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb8157010 con 0x7f8eb80cc950 2023-10-06T04:27:58.228 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.225+0000 7f8eb7fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb8158460 con 0x7f8eb81537d0 2023-10-06T04:27:58.229 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.225+0000 7f8eb77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8eb815d130 0x7f8eb8144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:58.229 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.225+0000 7f8eb77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8eb815d130 0x7f8eb8144e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52414/0 (socket says 172.21.15.60:52414) 2023-10-06T04:27:58.229 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.225+0000 7f8eb77fe700 1 -- 172.21.15.60:0/1989647882 learned_addr learned my addr 172.21.15.60:0/1989647882 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:27:58.229 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.225+0000 7f8eb6ffd700 1 --2- 172.21.15.60:0/1989647882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb80cc950 0x7f8eb816a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:58.229 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.225+0000 7f8eb67fc700 1 --2- 172.21.15.60:0/1989647882 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8eb81537d0 0x7f8eb8156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:58.229 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.226+0000 7f8eb77fe700 1 -- 172.21.15.60:0/1989647882 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8eb81537d0 msgr2=0x7f8eb8156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:58.229 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.226+0000 7f8eb77fe700 1 --2- 172.21.15.60:0/1989647882 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8eb81537d0 0x7f8eb8156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:58.229 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.226+0000 7f8eb77fe700 1 -- 172.21.15.60:0/1989647882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb80cc950 msgr2=0x7f8eb816a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:58.229 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.226+0000 7f8eb77fe700 1 --2- 172.21.15.60:0/1989647882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb80cc950 0x7f8eb816a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:58.229 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.226+0000 7f8eb77fe700 1 -- 172.21.15.60:0/1989647882 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea8009420 con 0x7f8eb815d130 2023-10-06T04:27:58.229 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.226+0000 7f8eb77fe700 1 --2- 172.21.15.60:0/1989647882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8eb815d130 0x7f8eb8144e00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0001460 tx=0x7f8eb0001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:58.229 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.226+0000 7f8e9effd700 1 -- 172.21.15.60:0/1989647882 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb000a890 con 0x7f8eb815d130 2023-10-06T04:27:58.230 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.226+0000 7f8e9effd700 1 -- 172.21.15.60:0/1989647882 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb000a9f0 con 0x7f8eb815d130 2023-10-06T04:27:58.230 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.226+0000 7f8e9effd700 1 -- 172.21.15.60:0/1989647882 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb000ad70 con 0x7f8eb815d130 2023-10-06T04:27:58.230 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.226+0000 7f8eb7fff700 1 -- 172.21.15.60:0/1989647882 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb8145340 con 0x7f8eb815d130 2023-10-06T04:27:58.230 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.226+0000 7f8eb7fff700 1 -- 172.21.15.60:0/1989647882 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb8157aa0 con 0x7f8eb815d130 2023-10-06T04:27:58.231 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.227+0000 7f8eb7fff700 1 -- 172.21.15.60:0/1989647882 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb8157cc0 con 0x7f8eb815d130 2023-10-06T04:27:58.231 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.228+0000 7f8e9effd700 1 -- 172.21.15.60:0/1989647882 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f8eb0007300 con 0x7f8eb815d130 2023-10-06T04:27:58.231 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.229+0000 7f8e9effd700 1 --2- 172.21.15.60:0/1989647882 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8ea4066ea0 0x7f8ea4069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:58.231 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.229+0000 7f8e9effd700 1 -- 172.21.15.60:0/1989647882 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f8eb0084320 con 0x7f8eb815d130 2023-10-06T04:27:58.231 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.230+0000 7f8eb6ffd700 1 --2- 172.21.15.60:0/1989647882 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8ea4066ea0 0x7f8ea4069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:58.232 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.230+0000 7f8eb6ffd700 1 --2- 172.21.15.60:0/1989647882 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8ea4066ea0 0x7f8ea4069350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80b2e00 tx=0x7f8ea8017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:58.235 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.234+0000 7f8e9effd700 1 -- 172.21.15.60:0/1989647882 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8eb0051b20 con 0x7f8eb815d130 2023-10-06T04:27:58.443 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.441+0000 7f8eb7fff700 1 -- 172.21.15.60:0/1989647882 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8eb8071700 con 0x7f8eb815d130 2023-10-06T04:27:58.443 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.442+0000 7f8e9effd700 1 -- 172.21.15.60:0/1989647882 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10396 (secure 0 0 0) 0x7f8eb0055140 con 0x7f8eb815d130 2023-10-06T04:27:58.444 INFO:teuthology.misc.health.smithi060.stdout: 2023-10-06T04:27:58.444 INFO:teuthology.misc.health.smithi060.stdout:{"epoch":13,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:27:58.156069+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:27:58.446 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.445+0000 7f8eb7fff700 1 -- 172.21.15.60:0/1989647882 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8ea4066ea0 msgr2=0x7f8ea4069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:58.447 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.445+0000 7f8eb7fff700 1 --2- 172.21.15.60:0/1989647882 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8ea4066ea0 0x7f8ea4069350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80b2e00 tx=0x7f8ea8017000 comp rx=0 tx=0).stop 2023-10-06T04:27:58.447 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.445+0000 7f8eb7fff700 1 -- 172.21.15.60:0/1989647882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8eb815d130 msgr2=0x7f8eb8144e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:58.447 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.445+0000 7f8eb7fff700 1 --2- 172.21.15.60:0/1989647882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8eb815d130 0x7f8eb8144e00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0001460 tx=0x7f8eb0001ae0 comp rx=0 tx=0).stop 2023-10-06T04:27:58.447 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.445+0000 7f8eb7fff700 1 -- 172.21.15.60:0/1989647882 shutdown_connections 2023-10-06T04:27:58.447 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.445+0000 7f8eb7fff700 1 --2- 172.21.15.60:0/1989647882 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8ea4066ea0 0x7f8ea4069350 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:58.447 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.445+0000 7f8eb7fff700 1 --2- 172.21.15.60:0/1989647882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8eb815d130 0x7f8eb8144e00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:58.447 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.445+0000 7f8eb7fff700 1 --2- 172.21.15.60:0/1989647882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb80cc950 0x7f8eb816a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:58.447 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.445+0000 7f8eb7fff700 1 --2- 172.21.15.60:0/1989647882 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8eb81537d0 0x7f8eb8156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:58.447 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.445+0000 7f8eb7fff700 1 -- 172.21.15.60:0/1989647882 >> 172.21.15.60:0/1989647882 conn(0x7f8eb806ed40 msgr2=0x7f8eb8150aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:58.447 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.445+0000 7f8eb7fff700 1 -- 172.21.15.60:0/1989647882 shutdown_connections 2023-10-06T04:27:58.447 INFO:teuthology.misc.health.smithi060.stderr:2023-10-06T04:27:58.445+0000 7f8eb7fff700 1 -- 172.21.15.60:0/1989647882 wait complete. 2023-10-06T04:27:58.461 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T04:27:58.461 INFO:tasks.ceph:Creating RBD pool 2023-10-06T04:27:58.461 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T04:27:58.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.641+0000 7f26f219d700 1 Processor -- start 2023-10-06T04:27:58.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.641+0000 7f26f219d700 1 -- start start 2023-10-06T04:27:58.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.642+0000 7f26f219d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f26ec0b2620 0x7f26ec0cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:58.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.642+0000 7f26f219d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f26ec0b29f0 0x7f26ec0cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:58.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.642+0000 7f26f219d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26ec0cc970 con 0x7f26ec0ceaa0 2023-10-06T04:27:58.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.642+0000 7f26f219d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ec0cbd60 con 0x7f26ec0b2620 2023-10-06T04:27:58.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.642+0000 7f26f219d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ec0cc040 con 0x7f26ec0b29f0 2023-10-06T04:27:58.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.643+0000 7f26f199c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f26ec0ceaa0 0x7f26ec0cef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55388/0 (socket says 172.21.15.60:55388) 2023-10-06T04:27:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.643+0000 7f26f199c700 1 -- 172.21.15.60:0/3238736990 learned_addr learned my addr 172.21.15.60:0/3238736990 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:27:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.643+0000 7f26f119b700 1 --2- 172.21.15.60:0/3238736990 >> v2:172.21.15.60:3300/0 conn(0x7f26ec0b2620 0x7f26ec0cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.643+0000 7f26f099a700 1 --2- 172.21.15.60:0/3238736990 >> v2:172.21.15.135:3300/0 conn(0x7f26ec0b29f0 0x7f26ec0cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.643+0000 7f26e3fff700 1 -- 172.21.15.60:0/3238736990 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414323156 0 0) 0x7f26ec0cc970 con 0x7f26ec0ceaa0 2023-10-06T04:27:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.643+0000 7f26e3fff700 1 -- 172.21.15.60:0/3238736990 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26d8003570 con 0x7f26ec0ceaa0 2023-10-06T04:27:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.643+0000 7f26f119b700 1 -- 172.21.15.60:0/3238736990 >> v2:172.21.15.135:3300/0 conn(0x7f26ec0b29f0 msgr2=0x7f26ec0cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:27:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.643+0000 7f26f119b700 1 --2- 172.21.15.60:0/3238736990 >> v2:172.21.15.135:3300/0 conn(0x7f26ec0b29f0 0x7f26ec0cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.643+0000 7f26f119b700 1 -- 172.21.15.60:0/3238736990 >> v1:172.21.15.60:6789/0 conn(0x7f26ec0ceaa0 legacy=0x7f26ec0cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.643+0000 7f26f119b700 1 -- 172.21.15.60:0/3238736990 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ec0cc320 con 0x7f26ec0b2620 2023-10-06T04:27:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.643+0000 7f26f099a700 1 --2- 172.21.15.60:0/3238736990 >> v2:172.21.15.135:3300/0 conn(0x7f26ec0b29f0 0x7f26ec0cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:27:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.643+0000 7f26f119b700 1 --2- 172.21.15.60:0/3238736990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26ec0b2620 0x7f26ec0cccb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f26ec0b62d0 tx=0x7f26e8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73870564fccbfcf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.644+0000 7f26e3fff700 1 -- 172.21.15.60:0/3238736990 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e8005c10 con 0x7f26ec0b2620 2023-10-06T04:27:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.644+0000 7f26e3fff700 1 -- 172.21.15.60:0/3238736990 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e8005d70 con 0x7f26ec0b2620 2023-10-06T04:27:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.644+0000 7f26e3fff700 1 -- 172.21.15.60:0/3238736990 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e8006260 con 0x7f26ec0b2620 2023-10-06T04:27:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.644+0000 7f26f219d700 1 -- 172.21.15.60:0/3238736990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26ec0b2620 msgr2=0x7f26ec0cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.644+0000 7f26f219d700 1 --2- 172.21.15.60:0/3238736990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26ec0b2620 0x7f26ec0cccb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f26ec0b62d0 tx=0x7f26e8009120 comp rx=0 tx=0).stop 2023-10-06T04:27:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.644+0000 7f26f219d700 1 -- 172.21.15.60:0/3238736990 shutdown_connections 2023-10-06T04:27:58.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.644+0000 7f26f219d700 1 --2- 172.21.15.60:0/3238736990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26ec0b2620 0x7f26ec0cccb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:58.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.644+0000 7f26f219d700 1 --2- 172.21.15.60:0/3238736990 >> v2:172.21.15.135:3300/0 conn(0x7f26ec0b29f0 0x7f26ec0cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:58.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.644+0000 7f26f219d700 1 -- 172.21.15.60:0/3238736990 >> 172.21.15.60:0/3238736990 conn(0x7f26ec099520 msgr2=0x7f26ec06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:58.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.644+0000 7f26f219d700 1 -- 172.21.15.60:0/3238736990 shutdown_connections 2023-10-06T04:27:58.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.644+0000 7f26f219d700 1 -- 172.21.15.60:0/3238736990 wait complete. 2023-10-06T04:27:58.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.646+0000 7f26f219d700 1 Processor -- start 2023-10-06T04:27:58.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.646+0000 7f26f219d700 1 -- start start 2023-10-06T04:27:58.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.647+0000 7f26f219d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26ec0b2620 0x7f26ec152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:58.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.647+0000 7f26f219d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec0b29f0 0x7f26ec0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.647+0000 7f26f219d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26ec0ceaa0 0x7f26ec1515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.647+0000 7f26f219d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec151440 con 0x7f26ec0ceaa0 2023-10-06T04:27:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.647+0000 7f26f219d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec0b3790 con 0x7f26ec0b29f0 2023-10-06T04:27:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.647+0000 7f26f219d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec0c7b40 con 0x7f26ec0b2620 2023-10-06T04:27:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.647+0000 7f26f199c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26ec0ceaa0 0x7f26ec1515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.647+0000 7f26f199c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26ec0ceaa0 0x7f26ec1515c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52430/0 (socket says 172.21.15.60:52430) 2023-10-06T04:27:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.647+0000 7f26f199c700 1 -- 172.21.15.60:0/2724303386 learned_addr learned my addr 172.21.15.60:0/2724303386 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:27:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.647+0000 7f26f099a700 1 --2- 172.21.15.60:0/2724303386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec0b29f0 0x7f26ec0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.647+0000 7f26f119b700 1 --2- 172.21.15.60:0/2724303386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26ec0b2620 0x7f26ec152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.647+0000 7f26f199c700 1 -- 172.21.15.60:0/2724303386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26ec0b2620 msgr2=0x7f26ec152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.647+0000 7f26f199c700 1 --2- 172.21.15.60:0/2724303386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26ec0b2620 0x7f26ec152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.647+0000 7f26f199c700 1 -- 172.21.15.60:0/2724303386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec0b29f0 msgr2=0x7f26ec0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.647+0000 7f26f199c700 1 --2- 172.21.15.60:0/2724303386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec0b29f0 0x7f26ec0b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.647+0000 7f26f199c700 1 -- 172.21.15.60:0/2724303386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e80093c0 con 0x7f26ec0ceaa0 2023-10-06T04:27:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.647+0000 7f26f099a700 1 --2- 172.21.15.60:0/2724303386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec0b29f0 0x7f26ec0b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:27:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.648+0000 7f26f199c700 1 --2- 172.21.15.60:0/2724303386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26ec0ceaa0 0x7f26ec1515c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f26e4001460 tx=0x7f26e4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.648+0000 7f26e17fa700 1 -- 172.21.15.60:0/2724303386 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e400ce80 con 0x7f26ec0ceaa0 2023-10-06T04:27:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.648+0000 7f26e17fa700 1 -- 172.21.15.60:0/2724303386 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e400ab70 con 0x7f26ec0ceaa0 2023-10-06T04:27:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.648+0000 7f26e17fa700 1 -- 172.21.15.60:0/2724303386 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e40070f0 con 0x7f26ec0ceaa0 2023-10-06T04:27:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.648+0000 7f26f219d700 1 -- 172.21.15.60:0/2724303386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ec0c7e20 con 0x7f26ec0ceaa0 2023-10-06T04:27:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.648+0000 7f26f219d700 1 -- 172.21.15.60:0/2724303386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ec0c83e0 con 0x7f26ec0ceaa0 2023-10-06T04:27:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.649+0000 7f26f219d700 1 -- 172.21.15.60:0/2724303386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ec05f230 con 0x7f26ec0ceaa0 2023-10-06T04:27:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.650+0000 7f26e17fa700 1 -- 172.21.15.60:0/2724303386 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f26e4007520 con 0x7f26ec0ceaa0 2023-10-06T04:27:58.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.651+0000 7f26e17fa700 1 --2- 172.21.15.60:0/2724303386 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f26d0066ea0 0x7f26d0069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:58.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.651+0000 7f26e17fa700 1 -- 172.21.15.60:0/2724303386 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f26e4084500 con 0x7f26ec0ceaa0 2023-10-06T04:27:58.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.652+0000 7f26f119b700 1 --2- 172.21.15.60:0/2724303386 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f26d0066ea0 0x7f26d0069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:58.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.652+0000 7f26f119b700 1 --2- 172.21.15.60:0/2724303386 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f26d0066ea0 0x7f26d0069350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f26e8009160 tx=0x7f26e8016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:58.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.656+0000 7f26e17fa700 1 -- 172.21.15.60:0/2724303386 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26e4051c70 con 0x7f26ec0ceaa0 2023-10-06T04:27:58.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:58.860+0000 7f26f219d700 1 -- 172.21.15.60:0/2724303386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f26ec0cc600 con 0x7f26ec0ceaa0 2023-10-06T04:27:59.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.162+0000 7f26e17fa700 1 -- 172.21.15.60:0/2724303386 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f26e4055290 con 0x7f26ec0ceaa0 2023-10-06T04:27:59.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.165+0000 7f26f219d700 1 -- 172.21.15.60:0/2724303386 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f26d0066ea0 msgr2=0x7f26d0069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:59.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.165+0000 7f26f219d700 1 --2- 172.21.15.60:0/2724303386 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f26d0066ea0 0x7f26d0069350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f26e8009160 tx=0x7f26e8016000 comp rx=0 tx=0).stop 2023-10-06T04:27:59.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.165+0000 7f26f219d700 1 -- 172.21.15.60:0/2724303386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26ec0ceaa0 msgr2=0x7f26ec1515c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:59.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.165+0000 7f26f219d700 1 --2- 172.21.15.60:0/2724303386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26ec0ceaa0 0x7f26ec1515c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f26e4001460 tx=0x7f26e4001ae0 comp rx=0 tx=0).stop 2023-10-06T04:27:59.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.166+0000 7f26f219d700 1 -- 172.21.15.60:0/2724303386 shutdown_connections 2023-10-06T04:27:59.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.166+0000 7f26f219d700 1 --2- 172.21.15.60:0/2724303386 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f26d0066ea0 0x7f26d0069350 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:59.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.166+0000 7f26f219d700 1 --2- 172.21.15.60:0/2724303386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26ec0ceaa0 0x7f26ec1515c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:59.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.166+0000 7f26f219d700 1 --2- 172.21.15.60:0/2724303386 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f26ec0b2620 0x7f26ec152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:59.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.166+0000 7f26f219d700 1 --2- 172.21.15.60:0/2724303386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26ec0b29f0 0x7f26ec0b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:59.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.166+0000 7f26f219d700 1 -- 172.21.15.60:0/2724303386 >> 172.21.15.60:0/2724303386 conn(0x7f26ec099520 msgr2=0x7f26ec1540a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:59.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.166+0000 7f26f219d700 1 -- 172.21.15.60:0/2724303386 shutdown_connections 2023-10-06T04:27:59.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.166+0000 7f26f219d700 1 -- 172.21.15.60:0/2724303386 wait complete. 2023-10-06T04:27:59.169 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'rbd' created 2023-10-06T04:27:59.185 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T04:27:59.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.369+0000 7f79b659d700 1 Processor -- start 2023-10-06T04:27:59.371 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.369+0000 7f79b659d700 1 -- start start 2023-10-06T04:27:59.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.371+0000 7f79b659d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79b0153990 0x7f79b015a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:59.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.371+0000 7f79b659d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f79b00cca70 0x7f79b00d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:59.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.371+0000 7f79b659d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b00d0c50 con 0x7f79b00d07f0 2023-10-06T04:27:59.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.371+0000 7f79b659d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b00cdbf0 con 0x7f79b00cca70 2023-10-06T04:27:59.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.371+0000 7f79b659d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b00cb4c0 con 0x7f79b0153990 2023-10-06T04:27:59.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.371+0000 7f79b4d9a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f79b00cca70 0x7f79b00d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:59.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.371+0000 7f79b559b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79b0153990 0x7f79b015a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:59.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.371+0000 7f79b4d9a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f79b00cca70 0x7f79b00d02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:52330/0 (socket says 172.21.15.60:52330) 2023-10-06T04:27:59.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.371+0000 7f79b4d9a700 1 -- 172.21.15.60:0/2405391378 learned_addr learned my addr 172.21.15.60:0/2405391378 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:27:59.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.372+0000 7f79b4d9a700 1 -- 172.21.15.60:0/2405391378 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79b0153990 msgr2=0x7f79b015a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:27:59.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.372+0000 7f79b4d9a700 1 --2- 172.21.15.60:0/2405391378 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79b0153990 0x7f79b015a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:59.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.372+0000 7f79b4d9a700 1 -- 172.21.15.60:0/2405391378 >> v1:172.21.15.135:6789/0 conn(0x7f79b00d07f0 legacy=0x7f79b015cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:59.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.372+0000 7f79b4d9a700 1 -- 172.21.15.60:0/2405391378 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b015a8b0 con 0x7f79b00cca70 2023-10-06T04:27:59.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.372+0000 7f79b559b700 1 --2- 172.21.15.60:0/2405391378 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79b0153990 0x7f79b015a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:27:59.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.372+0000 7f79a7fff700 1 -- 172.21.15.60:0/2405391378 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382937416 0 0) 0x7f79a8001490 con 0x7f79b00d07f0 2023-10-06T04:27:59.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.372+0000 7f79b4d9a700 1 --2- 172.21.15.60:0/2405391378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79b00cca70 0x7f79b00d02b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f79a00099b0 tx=0x7f79a0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10bc170b16299cff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:59.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.372+0000 7f79a7fff700 1 -- 172.21.15.60:0/2405391378 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a0009ea0 con 0x7f79b00cca70 2023-10-06T04:27:59.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.372+0000 7f79a7fff700 1 -- 172.21.15.60:0/2405391378 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a000b860 con 0x7f79b00cca70 2023-10-06T04:27:59.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.372+0000 7f79a7fff700 1 -- 172.21.15.60:0/2405391378 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a000bc00 con 0x7f79b00cca70 2023-10-06T04:27:59.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.373+0000 7f79b659d700 1 -- 172.21.15.60:0/2405391378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79b00cca70 msgr2=0x7f79b00d02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:59.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.373+0000 7f79b659d700 1 --2- 172.21.15.60:0/2405391378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79b00cca70 0x7f79b00d02b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f79a00099b0 tx=0x7f79a0009250 comp rx=0 tx=0).stop 2023-10-06T04:27:59.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.373+0000 7f79b659d700 1 -- 172.21.15.60:0/2405391378 shutdown_connections 2023-10-06T04:27:59.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.373+0000 7f79b659d700 1 --2- 172.21.15.60:0/2405391378 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79b0153990 0x7f79b015a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:59.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.373+0000 7f79b659d700 1 --2- 172.21.15.60:0/2405391378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79b00cca70 0x7f79b00d02b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:59.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.373+0000 7f79b659d700 1 -- 172.21.15.60:0/2405391378 >> 172.21.15.60:0/2405391378 conn(0x7f79b00680c0 msgr2=0x7f79b0068490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:27:59.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.373+0000 7f79b659d700 1 -- 172.21.15.60:0/2405391378 shutdown_connections 2023-10-06T04:27:59.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.373+0000 7f79b659d700 1 -- 172.21.15.60:0/2405391378 wait complete. 2023-10-06T04:27:59.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.374+0000 7f79b659d700 1 Processor -- start 2023-10-06T04:27:59.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.375+0000 7f79b659d700 1 -- start start 2023-10-06T04:27:59.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.375+0000 7f79b659d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79b00cca70 0x7f79b00b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:59.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.375+0000 7f79b659d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79b00d07f0 0x7f79b00b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:59.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.376+0000 7f79b659d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79b0153990 0x7f79b013fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:59.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.376+0000 7f79b659d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b00c8510 con 0x7f79b00cca70 2023-10-06T04:27:59.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.376+0000 7f79b659d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b00c7900 con 0x7f79b0153990 2023-10-06T04:27:59.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.376+0000 7f79b659d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b00c7be0 con 0x7f79b00d07f0 2023-10-06T04:27:59.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.376+0000 7f79b559b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79b00cca70 0x7f79b00b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:59.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.376+0000 7f79b559b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79b00cca70 0x7f79b00b5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52444/0 (socket says 172.21.15.60:52444) 2023-10-06T04:27:59.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.376+0000 7f79b559b700 1 -- 172.21.15.60:0/1289285733 learned_addr learned my addr 172.21.15.60:0/1289285733 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:27:59.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.376+0000 7f79b4d9a700 1 --2- 172.21.15.60:0/1289285733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79b00d07f0 0x7f79b00b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:59.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.376+0000 7f79b5d9c700 1 --2- 172.21.15.60:0/1289285733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79b0153990 0x7f79b013fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:59.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.376+0000 7f79b559b700 1 -- 172.21.15.60:0/1289285733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79b00d07f0 msgr2=0x7f79b00b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:59.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.376+0000 7f79b559b700 1 --2- 172.21.15.60:0/1289285733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79b00d07f0 0x7f79b00b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:59.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.376+0000 7f79b559b700 1 -- 172.21.15.60:0/1289285733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79b0153990 msgr2=0x7f79b013fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:27:59.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.376+0000 7f79b559b700 1 --2- 172.21.15.60:0/1289285733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79b0153990 0x7f79b013fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:27:59.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.376+0000 7f79b559b700 1 -- 172.21.15.60:0/1289285733 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac009420 con 0x7f79b00cca70 2023-10-06T04:27:59.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.377+0000 7f79b559b700 1 --2- 172.21.15.60:0/1289285733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79b00cca70 0x7f79b00b5b00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f79ac00ec80 tx=0x7f79ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:59.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.377+0000 7f79a57fa700 1 -- 172.21.15.60:0/1289285733 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac00c850 con 0x7f79b00cca70 2023-10-06T04:27:59.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.377+0000 7f79a57fa700 1 -- 172.21.15.60:0/1289285733 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac00c9b0 con 0x7f79b00cca70 2023-10-06T04:27:59.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.377+0000 7f79a57fa700 1 -- 172.21.15.60:0/1289285733 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac00cd30 con 0x7f79b00cca70 2023-10-06T04:27:59.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.377+0000 7f79b659d700 1 -- 172.21.15.60:0/1289285733 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a00094f0 con 0x7f79b00cca70 2023-10-06T04:27:59.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.377+0000 7f79b659d700 1 -- 172.21.15.60:0/1289285733 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b00c81a0 con 0x7f79b00cca70 2023-10-06T04:27:59.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.378+0000 7f79b659d700 1 -- 172.21.15.60:0/1289285733 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b00c87f0 con 0x7f79b00cca70 2023-10-06T04:27:59.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.379+0000 7f79a57fa700 1 -- 172.21.15.60:0/1289285733 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f79ac013680 con 0x7f79b00cca70 2023-10-06T04:27:59.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.380+0000 7f79a57fa700 1 --2- 172.21.15.60:0/1289285733 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7994066ea0 0x7f7994069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:27:59.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.380+0000 7f79a57fa700 1 -- 172.21.15.60:0/1289285733 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4809+0+0 (secure 0 0 0) 0x7f79ac084370 con 0x7f79b00cca70 2023-10-06T04:27:59.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.380+0000 7f79b4d9a700 1 --2- 172.21.15.60:0/1289285733 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7994066ea0 0x7f7994069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:27:59.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.380+0000 7f79b4d9a700 1 --2- 172.21.15.60:0/1289285733 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7994066ea0 0x7f7994069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f79a00099b0 tx=0x7f79a0017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:27:59.385 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.384+0000 7f79a57fa700 1 -- 172.21.15.60:0/1289285733 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79ac0519a0 con 0x7f79b00cca70 2023-10-06T04:27:59.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:27:59.588+0000 7f79b659d700 1 -- 172.21.15.60:0/1289285733 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f79b005f230 con 0x7f79b00cca70 2023-10-06T04:28:00.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.167+0000 7f79a57fa700 1 -- 172.21.15.60:0/1289285733 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f79ac054fc0 con 0x7f79b00cca70 2023-10-06T04:28:00.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.170+0000 7f79b659d700 1 -- 172.21.15.60:0/1289285733 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7994066ea0 msgr2=0x7f7994069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:00.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.170+0000 7f79b659d700 1 --2- 172.21.15.60:0/1289285733 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7994066ea0 0x7f7994069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f79a00099b0 tx=0x7f79a0017000 comp rx=0 tx=0).stop 2023-10-06T04:28:00.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.170+0000 7f79b659d700 1 -- 172.21.15.60:0/1289285733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79b00cca70 msgr2=0x7f79b00b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:00.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.170+0000 7f79b659d700 1 --2- 172.21.15.60:0/1289285733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79b00cca70 0x7f79b00b5b00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f79ac00ec80 tx=0x7f79ac0091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:00.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.170+0000 7f79b659d700 1 -- 172.21.15.60:0/1289285733 shutdown_connections 2023-10-06T04:28:00.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.170+0000 7f79b659d700 1 --2- 172.21.15.60:0/1289285733 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7994066ea0 0x7f7994069350 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:00.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.170+0000 7f79b659d700 1 --2- 172.21.15.60:0/1289285733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79b00cca70 0x7f79b00b5b00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:00.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.170+0000 7f79b659d700 1 --2- 172.21.15.60:0/1289285733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79b0153990 0x7f79b013fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:00.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.170+0000 7f79b659d700 1 --2- 172.21.15.60:0/1289285733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f79b00d07f0 0x7f79b00b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:00.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.170+0000 7f79b659d700 1 -- 172.21.15.60:0/1289285733 >> 172.21.15.60:0/1289285733 conn(0x7f79b00680c0 msgr2=0x7f79b00ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:00.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.170+0000 7f79b659d700 1 -- 172.21.15.60:0/1289285733 shutdown_connections 2023-10-06T04:28:00.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.170+0000 7f79b659d700 1 -- 172.21.15.60:0/1289285733 wait complete. 2023-10-06T04:28:00.173 INFO:teuthology.orchestra.run.smithi060.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T04:28:00.193 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T04:28:00.193 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T04:28:00.193 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T04:28:00.198 INFO:tasks.ceph.mds.a:Started 2023-10-06T04:28:00.198 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T04:28:00.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T04:28:00.202 INFO:tasks.ceph.mds.c:Started 2023-10-06T04:28:00.202 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T04:28:00.203 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T04:28:00.207 INFO:tasks.ceph.mds.b:Started 2023-10-06T04:28:00.207 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T04:28:00.208 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T04:28:00.212 INFO:tasks.ceph.mds.d:Started 2023-10-06T04:28:00.212 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T04:28:00.212 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:28:00.347 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-10-06T04:28:00.347 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2023-10-06T04:28:00.349 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-10-06T04:28:00.350 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-10-06T04:28:00.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.415+0000 7ff32559d700 1 Processor -- start 2023-10-06T04:28:00.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.415+0000 7ff32559d700 1 -- start start 2023-10-06T04:28:00.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.416+0000 7ff32559d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff320159440 0x7ff3200b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.416+0000 7ff32559d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3200b2100 0x7ff3200b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.416+0000 7ff32559d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3200cb7a0 con 0x7ff3200b35d0 2023-10-06T04:28:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.416+0000 7ff32559d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3200b0860 con 0x7ff320159440 2023-10-06T04:28:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.416+0000 7ff32559d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3200cb150 con 0x7ff3200b2100 2023-10-06T04:28:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.416+0000 7ff31f7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff3200b35d0 0x7ff3200cbc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55410/0 (socket says 172.21.15.60:55410) 2023-10-06T04:28:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.417+0000 7ff31f7fe700 1 -- 172.21.15.60:0/766910174 learned_addr learned my addr 172.21.15.60:0/766910174 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.417+0000 7ff31ffff700 1 --2- 172.21.15.60:0/766910174 >> v2:172.21.15.135:3300/0 conn(0x7ff320159440 0x7ff3200b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.417+0000 7ff324d9c700 1 --2- 172.21.15.60:0/766910174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3200b2100 0x7ff3200b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.417+0000 7ff31effd700 1 -- 172.21.15.60:0/766910174 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874151270 0 0) 0x7ff3200cb7a0 con 0x7ff3200b35d0 2023-10-06T04:28:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.417+0000 7ff31effd700 1 -- 172.21.15.60:0/766910174 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff308003570 con 0x7ff3200b35d0 2023-10-06T04:28:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.417+0000 7ff324d9c700 1 -- 172.21.15.60:0/766910174 >> v2:172.21.15.135:3300/0 conn(0x7ff320159440 msgr2=0x7ff3200b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.417+0000 7ff324d9c700 1 --2- 172.21.15.60:0/766910174 >> v2:172.21.15.135:3300/0 conn(0x7ff320159440 0x7ff3200b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:00.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.417+0000 7ff324d9c700 1 -- 172.21.15.60:0/766910174 >> v1:172.21.15.60:6789/0 conn(0x7ff3200b35d0 legacy=0x7ff3200cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.417+0000 7ff324d9c700 1 -- 172.21.15.60:0/766910174 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3200cb430 con 0x7ff3200b2100 2023-10-06T04:28:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.417+0000 7ff324d9c700 1 --2- 172.21.15.60:0/766910174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3200b2100 0x7ff3200b2560 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff318009e60 tx=0x7ff318009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70b78a5a00dbc7e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.418+0000 7ff31effd700 1 -- 172.21.15.60:0/766910174 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31800e070 con 0x7ff3200b2100 2023-10-06T04:28:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.418+0000 7ff31effd700 1 -- 172.21.15.60:0/766910174 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31800bab0 con 0x7ff3200b2100 2023-10-06T04:28:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.418+0000 7ff31effd700 1 -- 172.21.15.60:0/766910174 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31800be70 con 0x7ff3200b2100 2023-10-06T04:28:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.418+0000 7ff32559d700 1 -- 172.21.15.60:0/766910174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3200b2100 msgr2=0x7ff3200b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.418+0000 7ff32559d700 1 --2- 172.21.15.60:0/766910174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3200b2100 0x7ff3200b2560 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff318009e60 tx=0x7ff318009780 comp rx=0 tx=0).stop 2023-10-06T04:28:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.418+0000 7ff32559d700 1 -- 172.21.15.60:0/766910174 shutdown_connections 2023-10-06T04:28:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.418+0000 7ff32559d700 1 --2- 172.21.15.60:0/766910174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3200b2100 0x7ff3200b2560 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.418+0000 7ff32559d700 1 --2- 172.21.15.60:0/766910174 >> v2:172.21.15.135:3300/0 conn(0x7ff320159440 0x7ff3200b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.418+0000 7ff32559d700 1 -- 172.21.15.60:0/766910174 >> 172.21.15.60:0/766910174 conn(0x7ff32006ece0 msgr2=0x7ff32006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:00.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.418+0000 7ff32559d700 1 -- 172.21.15.60:0/766910174 shutdown_connections 2023-10-06T04:28:00.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.418+0000 7ff32559d700 1 -- 172.21.15.60:0/766910174 wait complete. 2023-10-06T04:28:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.420+0000 7ff32559d700 1 Processor -- start 2023-10-06T04:28:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.420+0000 7ff32559d700 1 -- start start 2023-10-06T04:28:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.421+0000 7ff32559d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3200b2100 0x7ff3200c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.421+0000 7ff32559d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3200b35d0 0x7ff3201553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.421+0000 7ff32559d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff320159440 0x7ff3201558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.421+0000 7ff32559d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff320155e20 con 0x7ff3200b35d0 2023-10-06T04:28:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.421+0000 7ff32559d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3200c6520 con 0x7ff3200b2100 2023-10-06T04:28:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.421+0000 7ff32559d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3200c6800 con 0x7ff320159440 2023-10-06T04:28:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.421+0000 7ff31f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3200b35d0 0x7ff3201553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.421+0000 7ff31ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3200b2100 0x7ff3200c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.421+0000 7ff31f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3200b35d0 0x7ff3201553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52470/0 (socket says 172.21.15.60:52470) 2023-10-06T04:28:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.421+0000 7ff31f7fe700 1 -- 172.21.15.60:0/3406525526 learned_addr learned my addr 172.21.15.60:0/3406525526 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.421+0000 7ff324d9c700 1 --2- 172.21.15.60:0/3406525526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff320159440 0x7ff3201558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.421+0000 7ff31ffff700 1 -- 172.21.15.60:0/3406525526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff320159440 msgr2=0x7ff3201558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.421+0000 7ff31ffff700 1 --2- 172.21.15.60:0/3406525526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff320159440 0x7ff3201558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.422+0000 7ff31ffff700 1 -- 172.21.15.60:0/3406525526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3200b35d0 msgr2=0x7ff3201553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.422+0000 7ff31ffff700 1 --2- 172.21.15.60:0/3406525526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3200b35d0 0x7ff3201553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.422+0000 7ff31ffff700 1 -- 172.21.15.60:0/3406525526 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff318009a20 con 0x7ff3200b2100 2023-10-06T04:28:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.422+0000 7ff31f7fe700 1 --2- 172.21.15.60:0/3406525526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3200b35d0 0x7ff3201553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.422+0000 7ff31ffff700 1 --2- 172.21.15.60:0/3406525526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3200b2100 0x7ff3200c9ca0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff31000e900 tx=0x7ff3100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.422+0000 7ff307fff700 1 -- 172.21.15.60:0/3406525526 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff310013680 con 0x7ff3200b2100 2023-10-06T04:28:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.422+0000 7ff307fff700 1 -- 172.21.15.60:0/3406525526 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3100137e0 con 0x7ff3200b2100 2023-10-06T04:28:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.422+0000 7ff307fff700 1 -- 172.21.15.60:0/3406525526 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff310013ba0 con 0x7ff3200b2100 2023-10-06T04:28:00.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.422+0000 7ff32559d700 1 -- 172.21.15.60:0/3406525526 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff320169850 con 0x7ff3200b2100 2023-10-06T04:28:00.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.422+0000 7ff32559d700 1 -- 172.21.15.60:0/3406525526 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff320169e10 con 0x7ff3200b2100 2023-10-06T04:28:00.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.423+0000 7ff32559d700 1 -- 172.21.15.60:0/3406525526 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32016a180 con 0x7ff3200b2100 2023-10-06T04:28:00.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.424+0000 7ff307fff700 1 -- 172.21.15.60:0/3406525526 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7ff310005a00 con 0x7ff3200b2100 2023-10-06T04:28:00.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.425+0000 7ff307fff700 1 --2- 172.21.15.60:0/3406525526 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff30c066e70 0x7ff30c069320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:00.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.425+0000 7ff307fff700 1 -- 172.21.15.60:0/3406525526 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5195+0+0 (secure 0 0 0) 0x7ff310084350 con 0x7ff3200b2100 2023-10-06T04:28:00.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.425+0000 7ff31f7fe700 1 --2- 172.21.15.60:0/3406525526 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff30c066e70 0x7ff30c069320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:00.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.426+0000 7ff31f7fe700 1 --2- 172.21.15.60:0/3406525526 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff30c066e70 0x7ff30c069320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff3200b04b0 tx=0x7ff314009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:00.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.429+0000 7ff307fff700 1 -- 172.21.15.60:0/3406525526 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff310051800 con 0x7ff3200b2100 2023-10-06T04:28:00.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.634+0000 7ff32559d700 1 -- 172.21.15.60:0/3406525526 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff32005f230 con 0x7ff3200b2100 2023-10-06T04:28:00.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.636+0000 7ff307fff700 1 -- 172.21.15.60:0/3406525526 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+13666 (secure 0 0 0) 0x7ff310054e20 con 0x7ff3200b2100 2023-10-06T04:28:00.637 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:00.637 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":15,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:28:00.161020+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:28:00.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.638+0000 7ff32559d700 1 -- 172.21.15.60:0/3406525526 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff30c066e70 msgr2=0x7ff30c069320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:00.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.638+0000 7ff32559d700 1 --2- 172.21.15.60:0/3406525526 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff30c066e70 0x7ff30c069320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff3200b04b0 tx=0x7ff314009040 comp rx=0 tx=0).stop 2023-10-06T04:28:00.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.638+0000 7ff32559d700 1 -- 172.21.15.60:0/3406525526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3200b2100 msgr2=0x7ff3200c9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:00.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.638+0000 7ff32559d700 1 --2- 172.21.15.60:0/3406525526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3200b2100 0x7ff3200c9ca0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff31000e900 tx=0x7ff3100091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:00.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.638+0000 7ff32559d700 1 -- 172.21.15.60:0/3406525526 shutdown_connections 2023-10-06T04:28:00.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.638+0000 7ff32559d700 1 --2- 172.21.15.60:0/3406525526 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff30c066e70 0x7ff30c069320 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:00.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.638+0000 7ff32559d700 1 --2- 172.21.15.60:0/3406525526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff320159440 0x7ff3201558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:00.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.638+0000 7ff32559d700 1 --2- 172.21.15.60:0/3406525526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3200b2100 0x7ff3200c9ca0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:00.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.638+0000 7ff32559d700 1 --2- 172.21.15.60:0/3406525526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3200b35d0 0x7ff3201553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:00.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.638+0000 7ff32559d700 1 -- 172.21.15.60:0/3406525526 >> 172.21.15.60:0/3406525526 conn(0x7ff32006ece0 msgr2=0x7ff3200cddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:00.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.638+0000 7ff32559d700 1 -- 172.21.15.60:0/3406525526 shutdown_connections 2023-10-06T04:28:00.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.639+0000 7ff32559d700 1 -- 172.21.15.60:0/3406525526 wait complete. 2023-10-06T04:28:00.657 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:27:58.899938+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:27:59.373527+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}}] 2023-10-06T04:28:00.657 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:28:00.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.845+0000 7f88fe59d700 1 Processor -- start 2023-10-06T04:28:00.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.846+0000 7f88fe59d700 1 -- start start 2023-10-06T04:28:00.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.847+0000 7f88fe59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f806e160 0x7f88f806e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:00.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.847+0000 7f88fe59d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f806eb00 con 0x7f88f8159c60 2023-10-06T04:28:00.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.847+0000 7f88fe59d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f80acad0 con 0x7f88f81560f0 2023-10-06T04:28:00.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.847+0000 7f88fe59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f815a0e0 con 0x7f88f806e160 2023-10-06T04:28:00.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.847+0000 7f88fcd9a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f88f8159c60 0x7f88f80c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55414/0 (socket says 172.21.15.60:55414) 2023-10-06T04:28:00.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.847+0000 7f88fcd9a700 1 -- 172.21.15.60:0/1368602837 learned_addr learned my addr 172.21.15.60:0/1368602837 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:00.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.847+0000 7f88fdd9c700 1 --2- 172.21.15.60:0/1368602837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f806e160 0x7f88f806e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:00.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.847+0000 7f88effff700 1 -- 172.21.15.60:0/1368602837 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744551991 0 0) 0x7f88e8001110 con 0x7f88f8159c60 2023-10-06T04:28:00.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.848+0000 7f88effff700 1 -- 172.21.15.60:0/1368602837 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88e4003570 con 0x7f88f8159c60 2023-10-06T04:28:00.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.848+0000 7f88effff700 1 -- 172.21.15.60:0/1368602837 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172889061 0 0) 0x7f88f80acad0 con 0x7f88f81560f0 2023-10-06T04:28:00.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.848+0000 7f88effff700 1 -- 172.21.15.60:0/1368602837 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88e8001110 con 0x7f88f81560f0 2023-10-06T04:28:00.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.848+0000 7f88effff700 1 -- 172.21.15.60:0/1368602837 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1494549865 0 0) 0x7f88e4003570 con 0x7f88f8159c60 2023-10-06T04:28:00.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.848+0000 7f88effff700 1 -- 172.21.15.60:0/1368602837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f806e160 msgr2=0x7f88f806e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:00.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.848+0000 7f88effff700 1 --2- 172.21.15.60:0/1368602837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f806e160 0x7f88f806e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:00.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.848+0000 7f88effff700 1 -- 172.21.15.60:0/1368602837 >> v1:172.21.15.135:6789/0 conn(0x7f88f81560f0 legacy=0x7f88f80ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:00.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.848+0000 7f88effff700 1 -- 172.21.15.60:0/1368602837 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f81564c0 con 0x7f88f8159c60 2023-10-06T04:28:00.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.848+0000 7f88effff700 1 -- 172.21.15.60:0/1368602837 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7f88e8001600 con 0x7f88f8159c60 2023-10-06T04:28:00.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.848+0000 7f88effff700 1 -- 172.21.15.60:0/1368602837 >> v1:172.21.15.60:6789/0 conn(0x7f88f8159c60 legacy=0x7f88f80c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:00.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.848+0000 7f88effff700 1 --2- 172.21.15.60:0/1368602837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88e4003c20 0x7f88e4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:00.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.848+0000 7f88effff700 1 --2- 172.21.15.60:0/1368602837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f806e160 0x7f88e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:00.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.848+0000 7f88effff700 1 --2- 172.21.15.60:0/1368602837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e4004d50 0x7f88e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:00.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.848+0000 7f88effff700 1 -- 172.21.15.60:0/1368602837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e400bb40 con 0x7f88e4004d50 2023-10-06T04:28:00.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.848+0000 7f88effff700 1 -- 172.21.15.60:0/1368602837 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e400bc80 con 0x7f88e4003c20 2023-10-06T04:28:00.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.848+0000 7f88effff700 1 -- 172.21.15.60:0/1368602837 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e400e050 con 0x7f88f806e160 2023-10-06T04:28:00.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.848+0000 7f88fdd9c700 1 --2- 172.21.15.60:0/1368602837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e4004d50 0x7f88e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:00.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.848+0000 7f88fd59b700 1 --2- 172.21.15.60:0/1368602837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88e4003c20 0x7f88e4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:00.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.849+0000 7f88fcd9a700 1 --2- 172.21.15.60:0/1368602837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f806e160 0x7f88e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:00.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.849+0000 7f88fdd9c700 1 -- 172.21.15.60:0/1368602837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f806e160 msgr2=0x7f88e4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:00.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.849+0000 7f88fdd9c700 1 --2- 172.21.15.60:0/1368602837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f806e160 0x7f88e4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:00.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.849+0000 7f88fdd9c700 1 -- 172.21.15.60:0/1368602837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88e4003c20 msgr2=0x7f88e4004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:00.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.849+0000 7f88fdd9c700 1 --2- 172.21.15.60:0/1368602837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88e4003c20 0x7f88e4004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:00.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.849+0000 7f88fdd9c700 1 -- 172.21.15.60:0/1368602837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e4003570 con 0x7f88e4004d50 2023-10-06T04:28:00.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.849+0000 7f88fdd9c700 1 --2- 172.21.15.60:0/1368602837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e4004d50 0x7f88e40051c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f88f000e210 tx=0x7f88f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32de2a1c63f2dd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:00.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.849+0000 7f88effff700 1 -- 172.21.15.60:0/1368602837 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f000eac0 con 0x7f88e4004d50 2023-10-06T04:28:00.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.849+0000 7f88effff700 1 -- 172.21.15.60:0/1368602837 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f000f040 con 0x7f88e4004d50 2023-10-06T04:28:00.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.849+0000 7f88effff700 1 -- 172.21.15.60:0/1368602837 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f000ee70 con 0x7f88e4004d50 2023-10-06T04:28:00.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.850+0000 7f88fe59d700 1 -- 172.21.15.60:0/1368602837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e4004d50 msgr2=0x7f88e40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:00.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.850+0000 7f88fe59d700 1 --2- 172.21.15.60:0/1368602837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e4004d50 0x7f88e40051c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f88f000e210 tx=0x7f88f000b040 comp rx=0 tx=0).stop 2023-10-06T04:28:00.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.850+0000 7f88fdd9c700 1 -- 172.21.15.60:0/1368602837 reap_dead start 2023-10-06T04:28:00.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.850+0000 7f88fe59d700 1 -- 172.21.15.60:0/1368602837 shutdown_connections 2023-10-06T04:28:00.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.850+0000 7f88fe59d700 1 -- 172.21.15.60:0/1368602837 >> 172.21.15.60:0/1368602837 conn(0x7f88f80cbed0 msgr2=0x7f88f80cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:00.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.850+0000 7f88fe59d700 1 -- 172.21.15.60:0/1368602837 shutdown_connections 2023-10-06T04:28:00.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.850+0000 7f88fe59d700 1 -- 172.21.15.60:0/1368602837 wait complete. 2023-10-06T04:28:00.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.851+0000 7f88fe59d700 1 Processor -- start 2023-10-06T04:28:00.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.851+0000 7f88fe59d700 1 -- start start 2023-10-06T04:28:00.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.852+0000 7f88fe59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88e4004d50 0x7f88f814cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:00.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.852+0000 7f88fe59d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88f816d850 0x7f88f81566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:00.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.852+0000 7f88fe59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f8156bf0 0x7f88f80afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:00.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.852+0000 7f88fe59d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f816d3c0 con 0x7f88f816d850 2023-10-06T04:28:00.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.852+0000 7f88fe59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f8157100 con 0x7f88e4004d50 2023-10-06T04:28:00.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.852+0000 7f88fe59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f816cd70 con 0x7f88f8156bf0 2023-10-06T04:28:00.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.853+0000 7f88fcd9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88f816d850 0x7f88f81566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:00.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.853+0000 7f88fcd9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88f816d850 0x7f88f81566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52498/0 (socket says 172.21.15.60:52498) 2023-10-06T04:28:00.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.853+0000 7f88fcd9a700 1 -- 172.21.15.60:0/2414214029 learned_addr learned my addr 172.21.15.60:0/2414214029 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:00.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.853+0000 7f88fdd9c700 1 --2- 172.21.15.60:0/2414214029 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f8156bf0 0x7f88f80afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:00.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.853+0000 7f88fd59b700 1 --2- 172.21.15.60:0/2414214029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88e4004d50 0x7f88f814cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:00.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.853+0000 7f88fcd9a700 1 -- 172.21.15.60:0/2414214029 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f8156bf0 msgr2=0x7f88f80afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:00.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.853+0000 7f88fcd9a700 1 --2- 172.21.15.60:0/2414214029 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f8156bf0 0x7f88f80afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:00.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.853+0000 7f88fcd9a700 1 -- 172.21.15.60:0/2414214029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88e4004d50 msgr2=0x7f88f814cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:00.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.853+0000 7f88fcd9a700 1 --2- 172.21.15.60:0/2414214029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88e4004d50 0x7f88f814cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:00.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.853+0000 7f88fcd9a700 1 -- 172.21.15.60:0/2414214029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f816d050 con 0x7f88f816d850 2023-10-06T04:28:00.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.853+0000 7f88fcd9a700 1 --2- 172.21.15.60:0/2414214029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88f816d850 0x7f88f81566b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f88e800eb00 tx=0x7f88e80010a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:00.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.853+0000 7f88ed7fa700 1 -- 172.21.15.60:0/2414214029 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e800ee10 con 0x7f88f816d850 2023-10-06T04:28:00.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.853+0000 7f88ed7fa700 1 -- 172.21.15.60:0/2414214029 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e8010040 con 0x7f88f816d850 2023-10-06T04:28:00.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.853+0000 7f88ed7fa700 1 -- 172.21.15.60:0/2414214029 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e800a9b0 con 0x7f88f816d850 2023-10-06T04:28:00.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.854+0000 7f88fe59d700 1 -- 172.21.15.60:0/2414214029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f80cb820 con 0x7f88f816d850 2023-10-06T04:28:00.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.854+0000 7f88fe59d700 1 -- 172.21.15.60:0/2414214029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f814d200 con 0x7f88f816d850 2023-10-06T04:28:00.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.855+0000 7f88fe59d700 1 -- 172.21.15.60:0/2414214029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f816cbd0 con 0x7f88f816d850 2023-10-06T04:28:00.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.856+0000 7f88ed7fa700 1 -- 172.21.15.60:0/2414214029 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f88e801d3b0 con 0x7f88f816d850 2023-10-06T04:28:00.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.856+0000 7f88ed7fa700 1 --2- 172.21.15.60:0/2414214029 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f88dc066ea0 0x7f88dc069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:00.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.856+0000 7f88ed7fa700 1 -- 172.21.15.60:0/2414214029 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f88e80834e0 con 0x7f88f816d850 2023-10-06T04:28:00.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.857+0000 7f88fd59b700 1 --2- 172.21.15.60:0/2414214029 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f88dc066ea0 0x7f88dc069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:00.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.857+0000 7f88fd59b700 1 --2- 172.21.15.60:0/2414214029 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f88dc066ea0 0x7f88dc069350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f88f80b0a10 tx=0x7f88f4007d30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:00.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:00.861+0000 7f88ed7fa700 1 -- 172.21.15.60:0/2414214029 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88f816cbd0 con 0x7f88f816d850 2023-10-06T04:28:01.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.063+0000 7f88fe59d700 1 -- 172.21.15.60:0/2414214029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f88f806eb00 con 0x7f88f816d850 2023-10-06T04:28:01.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.063+0000 7f88ed7fa700 1 -- 172.21.15.60:0/2414214029 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f88f806eb00 con 0x7f88f816d850 2023-10-06T04:28:01.065 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-10-06T04:28:01.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.065+0000 7f88fe59d700 1 -- 172.21.15.60:0/2414214029 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f88dc066ea0 msgr2=0x7f88dc069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:01.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.065+0000 7f88fe59d700 1 --2- 172.21.15.60:0/2414214029 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f88dc066ea0 0x7f88dc069350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f88f80b0a10 tx=0x7f88f4007d30 comp rx=0 tx=0).stop 2023-10-06T04:28:01.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.065+0000 7f88fe59d700 1 -- 172.21.15.60:0/2414214029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88f816d850 msgr2=0x7f88f81566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:01.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.065+0000 7f88fe59d700 1 --2- 172.21.15.60:0/2414214029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88f816d850 0x7f88f81566b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f88e800eb00 tx=0x7f88e80010a0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.066+0000 7f88fe59d700 1 -- 172.21.15.60:0/2414214029 shutdown_connections 2023-10-06T04:28:01.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.066+0000 7f88fe59d700 1 --2- 172.21.15.60:0/2414214029 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f88dc066ea0 0x7f88dc069350 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.066+0000 7f88fe59d700 1 --2- 172.21.15.60:0/2414214029 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88f8156bf0 0x7f88f80afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.066+0000 7f88fe59d700 1 --2- 172.21.15.60:0/2414214029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88e4004d50 0x7f88f814cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.066+0000 7f88fe59d700 1 --2- 172.21.15.60:0/2414214029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88f816d850 0x7f88f81566b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.066+0000 7f88fe59d700 1 -- 172.21.15.60:0/2414214029 >> 172.21.15.60:0/2414214029 conn(0x7f88f80cbed0 msgr2=0x7f88f814eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:01.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.066+0000 7f88fe59d700 1 -- 172.21.15.60:0/2414214029 shutdown_connections 2023-10-06T04:28:01.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.066+0000 7f88fe59d700 1 -- 172.21.15.60:0/2414214029 wait complete. 2023-10-06T04:28:01.084 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:28:01.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.280+0000 7fc6ea79d700 1 Processor -- start 2023-10-06T04:28:01.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.280+0000 7fc6ea79d700 1 -- start start 2023-10-06T04:28:01.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.281+0000 7fc6ea79d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc6e4159c60 0x7fc6e40c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:01.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.281+0000 7fc6ea79d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc6e40c8f30 0x7fc6e406e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:01.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.281+0000 7fc6ea79d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e40acad0 con 0x7fc6e41560f0 2023-10-06T04:28:01.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.281+0000 7fc6ea79d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e415a0e0 con 0x7fc6e4159c60 2023-10-06T04:28:01.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.281+0000 7fc6ea79d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e41564c0 con 0x7fc6e40c8f30 2023-10-06T04:28:01.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.282+0000 7fc6e8f9a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc6e4159c60 0x7fc6e40c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:01.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.282+0000 7fc6e979b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc6e41560f0 0x7fc6e40ae0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55422/0 (socket says 172.21.15.60:55422) 2023-10-06T04:28:01.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.282+0000 7fc6e979b700 1 -- 172.21.15.60:0/801577732 learned_addr learned my addr 172.21.15.60:0/801577732 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:01.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.282+0000 7fc6e9f9c700 1 --2- 172.21.15.60:0/801577732 >> v2:172.21.15.135:3300/0 conn(0x7fc6e40c8f30 0x7fc6e406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:01.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.282+0000 7fc6e8f9a700 1 -- 172.21.15.60:0/801577732 >> v2:172.21.15.135:3300/0 conn(0x7fc6e40c8f30 msgr2=0x7fc6e406e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:01.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.282+0000 7fc6e8f9a700 1 --2- 172.21.15.60:0/801577732 >> v2:172.21.15.135:3300/0 conn(0x7fc6e40c8f30 0x7fc6e406e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.282+0000 7fc6e8f9a700 1 -- 172.21.15.60:0/801577732 >> v1:172.21.15.60:6789/0 conn(0x7fc6e41560f0 legacy=0x7fc6e40ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:01.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.282+0000 7fc6e8f9a700 1 -- 172.21.15.60:0/801577732 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e415a2d0 con 0x7fc6e4159c60 2023-10-06T04:28:01.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.282+0000 7fc6dbfff700 1 -- 172.21.15.60:0/801577732 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074085958 0 0) 0x7fc6e40acad0 con 0x7fc6e41560f0 2023-10-06T04:28:01.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.282+0000 7fc6e8f9a700 1 --2- 172.21.15.60:0/801577732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e4159c60 0x7fc6e40c89f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc6e406fde0 tx=0x7fc6d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c377fa68e9a809 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:01.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.283+0000 7fc6dbfff700 1 -- 172.21.15.60:0/801577732 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d400b740 con 0x7fc6e4159c60 2023-10-06T04:28:01.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.283+0000 7fc6dbfff700 1 -- 172.21.15.60:0/801577732 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d400b8a0 con 0x7fc6e4159c60 2023-10-06T04:28:01.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.283+0000 7fc6dbfff700 1 -- 172.21.15.60:0/801577732 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d400bc40 con 0x7fc6e4159c60 2023-10-06T04:28:01.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.283+0000 7fc6ea79d700 1 -- 172.21.15.60:0/801577732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e4159c60 msgr2=0x7fc6e40c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:01.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.283+0000 7fc6ea79d700 1 --2- 172.21.15.60:0/801577732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e4159c60 0x7fc6e40c89f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc6e406fde0 tx=0x7fc6d40091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.283+0000 7fc6ea79d700 1 -- 172.21.15.60:0/801577732 shutdown_connections 2023-10-06T04:28:01.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.283+0000 7fc6ea79d700 1 --2- 172.21.15.60:0/801577732 >> v2:172.21.15.135:3300/0 conn(0x7fc6e40c8f30 0x7fc6e406e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.283+0000 7fc6ea79d700 1 --2- 172.21.15.60:0/801577732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e4159c60 0x7fc6e40c89f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.283+0000 7fc6ea79d700 1 -- 172.21.15.60:0/801577732 >> 172.21.15.60:0/801577732 conn(0x7fc6e40cbed0 msgr2=0x7fc6e40cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:01.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.283+0000 7fc6ea79d700 1 -- 172.21.15.60:0/801577732 shutdown_connections 2023-10-06T04:28:01.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.283+0000 7fc6ea79d700 1 -- 172.21.15.60:0/801577732 wait complete. 2023-10-06T04:28:01.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.285+0000 7fc6ea79d700 1 Processor -- start 2023-10-06T04:28:01.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.285+0000 7fc6ea79d700 1 -- start start 2023-10-06T04:28:01.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.286+0000 7fc6ea79d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6e40c8f30 0x7fc6e4150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:01.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.286+0000 7fc6ea79d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6e41560f0 0x7fc6e4157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:01.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.286+0000 7fc6ea79d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e4159c60 0x7fc6e4158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:01.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.286+0000 7fc6ea79d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e4156690 con 0x7fc6e4159c60 2023-10-06T04:28:01.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.286+0000 7fc6ea79d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e4169f50 con 0x7fc6e41560f0 2023-10-06T04:28:01.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.286+0000 7fc6ea79d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e40cad80 con 0x7fc6e40c8f30 2023-10-06T04:28:01.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.286+0000 7fc6e9f9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e4159c60 0x7fc6e4158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:01.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.286+0000 7fc6e9f9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e4159c60 0x7fc6e4158240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52512/0 (socket says 172.21.15.60:52512) 2023-10-06T04:28:01.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.286+0000 7fc6e9f9c700 1 -- 172.21.15.60:0/1972661440 learned_addr learned my addr 172.21.15.60:0/1972661440 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:01.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.286+0000 7fc6e8f9a700 1 --2- 172.21.15.60:0/1972661440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6e41560f0 0x7fc6e4157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:01.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.286+0000 7fc6e979b700 1 --2- 172.21.15.60:0/1972661440 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6e40c8f30 0x7fc6e4150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:01.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.286+0000 7fc6e9f9c700 1 -- 172.21.15.60:0/1972661440 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6e40c8f30 msgr2=0x7fc6e4150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:01.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.286+0000 7fc6e9f9c700 1 --2- 172.21.15.60:0/1972661440 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6e40c8f30 0x7fc6e4150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.286+0000 7fc6e9f9c700 1 -- 172.21.15.60:0/1972661440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6e41560f0 msgr2=0x7fc6e4157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:01.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.286+0000 7fc6e9f9c700 1 --2- 172.21.15.60:0/1972661440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6e41560f0 0x7fc6e4157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.286+0000 7fc6e9f9c700 1 -- 172.21.15.60:0/1972661440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d4009420 con 0x7fc6e4159c60 2023-10-06T04:28:01.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.286+0000 7fc6e979b700 1 --2- 172.21.15.60:0/1972661440 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6e40c8f30 0x7fc6e4150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:01.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.287+0000 7fc6e9f9c700 1 --2- 172.21.15.60:0/1972661440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e4159c60 0x7fc6e4158240 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc007f30 tx=0x7fc6dc0098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:01.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.287+0000 7fc6d97fa700 1 -- 172.21.15.60:0/1972661440 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc00ecf0 con 0x7fc6e4159c60 2023-10-06T04:28:01.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.287+0000 7fc6d97fa700 1 -- 172.21.15.60:0/1972661440 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6dc00ee50 con 0x7fc6e4159c60 2023-10-06T04:28:01.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.287+0000 7fc6ea79d700 1 -- 172.21.15.60:0/1972661440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e4169900 con 0x7fc6e4159c60 2023-10-06T04:28:01.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.287+0000 7fc6d97fa700 1 -- 172.21.15.60:0/1972661440 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc014670 con 0x7fc6e4159c60 2023-10-06T04:28:01.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.287+0000 7fc6ea79d700 1 -- 172.21.15.60:0/1972661440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e4169570 con 0x7fc6e4159c60 2023-10-06T04:28:01.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.288+0000 7fc6ea79d700 1 -- 172.21.15.60:0/1972661440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e4169760 con 0x7fc6e4159c60 2023-10-06T04:28:01.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.289+0000 7fc6d97fa700 1 -- 172.21.15.60:0/1972661440 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fc6dc0149e0 con 0x7fc6e4159c60 2023-10-06T04:28:01.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.290+0000 7fc6d97fa700 1 --2- 172.21.15.60:0/1972661440 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc6c8066ea0 0x7fc6c8069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:01.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.290+0000 7fc6d97fa700 1 -- 172.21.15.60:0/1972661440 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc6dc084a50 con 0x7fc6e4159c60 2023-10-06T04:28:01.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.290+0000 7fc6e979b700 1 --2- 172.21.15.60:0/1972661440 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc6c8066ea0 0x7fc6c8069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:01.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.291+0000 7fc6e979b700 1 --2- 172.21.15.60:0/1972661440 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc6c8066ea0 0x7fc6c8069350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00018d0 tx=0x7fc6e0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:01.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.295+0000 7fc6d97fa700 1 -- 172.21.15.60:0/1972661440 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6e4169760 con 0x7fc6e4159c60 2023-10-06T04:28:01.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.527+0000 7fc6ea79d700 1 -- 172.21.15.60:0/1972661440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc6e4169760 con 0x7fc6e4159c60 2023-10-06T04:28:01.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.528+0000 7fc6d97fa700 1 -- 172.21.15.60:0/1972661440 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc6e4169760 con 0x7fc6e4159c60 2023-10-06T04:28:01.529 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-06T04:28:01.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.530+0000 7fc6ea79d700 1 -- 172.21.15.60:0/1972661440 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc6c8066ea0 msgr2=0x7fc6c8069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:01.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.530+0000 7fc6ea79d700 1 --2- 172.21.15.60:0/1972661440 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc6c8066ea0 0x7fc6c8069350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00018d0 tx=0x7fc6e0009040 comp rx=0 tx=0).stop 2023-10-06T04:28:01.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.530+0000 7fc6ea79d700 1 -- 172.21.15.60:0/1972661440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e4159c60 msgr2=0x7fc6e4158240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:01.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.530+0000 7fc6ea79d700 1 --2- 172.21.15.60:0/1972661440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e4159c60 0x7fc6e4158240 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc007f30 tx=0x7fc6dc0098e0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.530+0000 7fc6ea79d700 1 -- 172.21.15.60:0/1972661440 shutdown_connections 2023-10-06T04:28:01.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.530+0000 7fc6ea79d700 1 --2- 172.21.15.60:0/1972661440 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc6c8066ea0 0x7fc6c8069350 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.530+0000 7fc6ea79d700 1 --2- 172.21.15.60:0/1972661440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e4159c60 0x7fc6e4158240 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.530+0000 7fc6ea79d700 1 --2- 172.21.15.60:0/1972661440 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6e40c8f30 0x7fc6e4150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.530+0000 7fc6ea79d700 1 --2- 172.21.15.60:0/1972661440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6e41560f0 0x7fc6e4157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.530+0000 7fc6ea79d700 1 -- 172.21.15.60:0/1972661440 >> 172.21.15.60:0/1972661440 conn(0x7fc6e40cbed0 msgr2=0x7fc6e40b0170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:01.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.530+0000 7fc6ea79d700 1 -- 172.21.15.60:0/1972661440 shutdown_connections 2023-10-06T04:28:01.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.530+0000 7fc6ea79d700 1 -- 172.21.15.60:0/1972661440 wait complete. 2023-10-06T04:28:01.551 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:28:01.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.747+0000 7f81ad59d700 1 Processor -- start 2023-10-06T04:28:01.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.747+0000 7f81ad59d700 1 -- start start 2023-10-06T04:28:01.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.748+0000 7f81ad59d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f81a8159440 0x7f81a80b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:01.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.748+0000 7f81ad59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81a80b35d0 0x7f81a80cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:01.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.748+0000 7f81ad59d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a80cb7a0 con 0x7f81a80cc170 2023-10-06T04:28:01.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.748+0000 7f81ad59d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a80b0860 con 0x7f81a8159440 2023-10-06T04:28:01.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.748+0000 7f81ad59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80cb150 con 0x7f81a80b35d0 2023-10-06T04:28:01.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.749+0000 7f81a7fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f81a8159440 0x7f81a80b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:01.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.749+0000 7f81a77fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81a80b35d0 0x7f81a80cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:01.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.749+0000 7f81a7fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f81a8159440 0x7f81a80b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:52450/0 (socket says 172.21.15.60:52450) 2023-10-06T04:28:01.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.749+0000 7f81a7fff700 1 -- 172.21.15.60:0/448799339 learned_addr learned my addr 172.21.15.60:0/448799339 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:01.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.749+0000 7f81acd9c700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f81a80cc170 0x7f81a80b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.60:38926/0 (socket says 172.21.15.60:38926) 2023-10-06T04:28:01.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.749+0000 7f81a6ffd700 1 -- 172.21.15.60:0/448799339 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120537900 0 0) 0x7f81a80cb7a0 con 0x7f81a80cc170 2023-10-06T04:28:01.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.749+0000 7f81a6ffd700 1 -- 172.21.15.60:0/448799339 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8190003570 con 0x7f81a80cc170 2023-10-06T04:28:01.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.749+0000 7f81a77fe700 1 -- 172.21.15.60:0/448799339 >> v2:172.21.15.135:3300/0 conn(0x7f81a8159440 msgr2=0x7f81a80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:01.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.749+0000 7f81a77fe700 1 --2- 172.21.15.60:0/448799339 >> v2:172.21.15.135:3300/0 conn(0x7f81a8159440 0x7f81a80b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.749+0000 7f81a77fe700 1 -- 172.21.15.60:0/448799339 >> v1:172.21.15.135:6789/0 conn(0x7f81a80cc170 legacy=0x7f81a80b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:01.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.749+0000 7f81a77fe700 1 -- 172.21.15.60:0/448799339 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a80cb430 con 0x7f81a80b35d0 2023-10-06T04:28:01.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.750+0000 7f81a77fe700 1 --2- 172.21.15.60:0/448799339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81a80b35d0 0x7f81a80cbc30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f819c0098e0 tx=0x7f819c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15916f2e27ef0512 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:01.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.750+0000 7f81a6ffd700 1 -- 172.21.15.60:0/448799339 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c011630 con 0x7f81a80b35d0 2023-10-06T04:28:01.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.750+0000 7f81a6ffd700 1 -- 172.21.15.60:0/448799339 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c011790 con 0x7f81a80b35d0 2023-10-06T04:28:01.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.750+0000 7f81a6ffd700 1 -- 172.21.15.60:0/448799339 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c011b30 con 0x7f81a80b35d0 2023-10-06T04:28:01.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.751+0000 7f81ad59d700 1 -- 172.21.15.60:0/448799339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81a80b35d0 msgr2=0x7f81a80cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:01.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.751+0000 7f81ad59d700 1 --2- 172.21.15.60:0/448799339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81a80b35d0 0x7f81a80cbc30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f819c0098e0 tx=0x7f819c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.751+0000 7f81ad59d700 1 -- 172.21.15.60:0/448799339 shutdown_connections 2023-10-06T04:28:01.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.751+0000 7f81ad59d700 1 --2- 172.21.15.60:0/448799339 >> v2:172.21.15.135:3300/0 conn(0x7f81a8159440 0x7f81a80b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.751+0000 7f81ad59d700 1 --2- 172.21.15.60:0/448799339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81a80b35d0 0x7f81a80cbc30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.751+0000 7f81ad59d700 1 -- 172.21.15.60:0/448799339 >> 172.21.15.60:0/448799339 conn(0x7f81a806ece0 msgr2=0x7f81a806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:01.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.751+0000 7f81ad59d700 1 -- 172.21.15.60:0/448799339 shutdown_connections 2023-10-06T04:28:01.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.751+0000 7f81ad59d700 1 -- 172.21.15.60:0/448799339 wait complete. 2023-10-06T04:28:01.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.752+0000 7f81ad59d700 1 Processor -- start 2023-10-06T04:28:01.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.752+0000 7f81ad59d700 1 -- start start 2023-10-06T04:28:01.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.753+0000 7f81ad59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81a80b35d0 0x7f81a815ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:01.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.753+0000 7f81ad59d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81a80cc170 0x7f81a80c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:01.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.753+0000 7f81ad59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81a8159440 0x7f81a816cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:01.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.753+0000 7f81ad59d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a815e470 con 0x7f81a80cc170 2023-10-06T04:28:01.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.753+0000 7f81ad59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a815d8e0 con 0x7f81a80b35d0 2023-10-06T04:28:01.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.753+0000 7f81ad59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a815db40 con 0x7f81a8159440 2023-10-06T04:28:01.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.753+0000 7f81a77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81a80cc170 0x7f81a80c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:01.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.754+0000 7f81a77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81a80cc170 0x7f81a80c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52560/0 (socket says 172.21.15.60:52560) 2023-10-06T04:28:01.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.754+0000 7f81a77fe700 1 -- 172.21.15.60:0/3987395438 learned_addr learned my addr 172.21.15.60:0/3987395438 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:01.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.754+0000 7f81a7fff700 1 --2- 172.21.15.60:0/3987395438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81a80b35d0 0x7f81a815ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:01.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.754+0000 7f81acd9c700 1 --2- 172.21.15.60:0/3987395438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81a8159440 0x7f81a816cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:01.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.754+0000 7f81a77fe700 1 -- 172.21.15.60:0/3987395438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81a8159440 msgr2=0x7f81a816cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:01.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.754+0000 7f81a77fe700 1 --2- 172.21.15.60:0/3987395438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81a8159440 0x7f81a816cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.754+0000 7f81a77fe700 1 -- 172.21.15.60:0/3987395438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81a80b35d0 msgr2=0x7f81a815ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:01.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.754+0000 7f81a77fe700 1 --2- 172.21.15.60:0/3987395438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81a80b35d0 0x7f81a815ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:01.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.754+0000 7f81a77fe700 1 -- 172.21.15.60:0/3987395438 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c009420 con 0x7f81a80cc170 2023-10-06T04:28:01.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.754+0000 7f81a7fff700 1 --2- 172.21.15.60:0/3987395438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81a80b35d0 0x7f81a815ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:01.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.754+0000 7f81a77fe700 1 --2- 172.21.15.60:0/3987395438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81a80cc170 0x7f81a80c8b60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f81a80cb290 tx=0x7f819c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:01.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.754+0000 7f818ffff700 1 -- 172.21.15.60:0/3987395438 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c011900 con 0x7f81a80cc170 2023-10-06T04:28:01.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.755+0000 7f818ffff700 1 -- 172.21.15.60:0/3987395438 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c011a60 con 0x7f81a80cc170 2023-10-06T04:28:01.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.755+0000 7f81ad59d700 1 -- 172.21.15.60:0/3987395438 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a815de20 con 0x7f81a80cc170 2023-10-06T04:28:01.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.755+0000 7f818ffff700 1 -- 172.21.15.60:0/3987395438 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c025640 con 0x7f81a80cc170 2023-10-06T04:28:01.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.755+0000 7f81ad59d700 1 -- 172.21.15.60:0/3987395438 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a815e900 con 0x7f81a80cc170 2023-10-06T04:28:01.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.756+0000 7f81ad59d700 1 -- 172.21.15.60:0/3987395438 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a805f230 con 0x7f81a80cc170 2023-10-06T04:28:01.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.757+0000 7f818ffff700 1 -- 172.21.15.60:0/3987395438 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f819c025a30 con 0x7f81a80cc170 2023-10-06T04:28:01.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.758+0000 7f818ffff700 1 --2- 172.21.15.60:0/3987395438 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8194066ea0 0x7f8194069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:01.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.758+0000 7f818ffff700 1 -- 172.21.15.60:0/3987395438 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f819c0859b0 con 0x7f81a80cc170 2023-10-06T04:28:01.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.762+0000 7f818ffff700 1 -- 172.21.15.60:0/3987395438 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f819c052e50 con 0x7f81a80cc170 2023-10-06T04:28:01.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.765+0000 7f81a7fff700 1 --2- 172.21.15.60:0/3987395438 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8194066ea0 0x7f8194069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:01.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:01.765+0000 7f81a7fff700 1 --2- 172.21.15.60:0/3987395438 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8194066ea0 0x7f8194069350 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8198006fd0 tx=0x7f8198009250 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:02.020 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.019+0000 7f81ad59d700 1 -- 172.21.15.60:0/3987395438 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81a8159810 con 0x7f81a80cc170 2023-10-06T04:28:02.021 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.020+0000 7f818ffff700 1 -- 172.21.15.60:0/3987395438 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f819c015de0 con 0x7f81a80cc170 2023-10-06T04:28:02.021 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:02.021 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3950892589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3950892589},{"type":"v1","addr":"172.21.15.60:6837","nonce":3950892589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1381681252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1381681252},{"type":"v1","addr":"172.21.15.135:6834","nonce":1381681252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1306947344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1306947344},{"type":"v1","addr":"172.21.15.135:6835","nonce":1306947344}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1424722915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1424722915},{"type":"v1","addr":"172.21.15.60:6836","nonce":1424722915}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-06T04:28:02.023 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.022+0000 7f81ad59d700 1 -- 172.21.15.60:0/3987395438 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8194066ea0 msgr2=0x7f8194069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.022+0000 7f81ad59d700 1 --2- 172.21.15.60:0/3987395438 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8194066ea0 0x7f8194069350 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8198006fd0 tx=0x7f8198009250 comp rx=0 tx=0).stop 2023-10-06T04:28:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.022+0000 7f81ad59d700 1 -- 172.21.15.60:0/3987395438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81a80cc170 msgr2=0x7f81a80c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.022+0000 7f81ad59d700 1 --2- 172.21.15.60:0/3987395438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81a80cc170 0x7f81a80c8b60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f81a80cb290 tx=0x7f819c017000 comp rx=0 tx=0).stop 2023-10-06T04:28:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.022+0000 7f81ad59d700 1 -- 172.21.15.60:0/3987395438 shutdown_connections 2023-10-06T04:28:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.022+0000 7f81ad59d700 1 --2- 172.21.15.60:0/3987395438 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8194066ea0 0x7f8194069350 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.022+0000 7f81ad59d700 1 --2- 172.21.15.60:0/3987395438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81a8159440 0x7f81a816cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.022+0000 7f81ad59d700 1 --2- 172.21.15.60:0/3987395438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81a80b35d0 0x7f81a815ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.022+0000 7f81ad59d700 1 --2- 172.21.15.60:0/3987395438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81a80cc170 0x7f81a80c8b60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.022+0000 7f81ad59d700 1 -- 172.21.15.60:0/3987395438 >> 172.21.15.60:0/3987395438 conn(0x7f81a806ece0 msgr2=0x7f81a80b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.022+0000 7f81ad59d700 1 -- 172.21.15.60:0/3987395438 shutdown_connections 2023-10-06T04:28:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.022+0000 7f81ad59d700 1 -- 172.21.15.60:0/3987395438 wait complete. 2023-10-06T04:28:02.025 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 3 2023-10-06T04:28:02.042 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:28:02.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.234+0000 7fe93ffff700 1 Processor -- start 2023-10-06T04:28:02.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.234+0000 7fe93ffff700 1 -- start start 2023-10-06T04:28:02.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.236+0000 7fe93ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe940159390 0x7fe9400b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:02.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.236+0000 7fe93ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9400ccd00 0x7fe9400cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:02.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.236+0000 7fe93ffff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe9400c62e0 0x7fe9400c6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:02.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.236+0000 7fe93ffff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9400cd6b0 con 0x7fe940159390 2023-10-06T04:28:02.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.237+0000 7fe93ffff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9400c5e50 con 0x7fe9400c62e0 2023-10-06T04:28:02.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.237+0000 7fe93ffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9400b3600 con 0x7fe9400ccd00 2023-10-06T04:28:02.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.237+0000 7fe93effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe940159390 0x7fe9400b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:02.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.237+0000 7fe93effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe940159390 0x7fe9400b30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52568/0 (socket says 172.21.15.60:52568) 2023-10-06T04:28:02.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.237+0000 7fe93effd700 1 -- 172.21.15.60:0/2487707758 learned_addr learned my addr 172.21.15.60:0/2487707758 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:02.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.237+0000 7fe93e7fc700 1 --2- 172.21.15.60:0/2487707758 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9400ccd00 0x7fe9400cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:02.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.237+0000 7fe93f7fe700 1 --2- 172.21.15.60:0/2487707758 >> v2:172.21.15.135:3300/0 conn(0x7fe9400c62e0 0x7fe9400c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:02.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.237+0000 7fe93effd700 1 -- 172.21.15.60:0/2487707758 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9400ccd00 msgr2=0x7fe9400cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:02.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.237+0000 7fe93effd700 1 --2- 172.21.15.60:0/2487707758 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9400ccd00 0x7fe9400cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:02.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.237+0000 7fe93effd700 1 -- 172.21.15.60:0/2487707758 >> v2:172.21.15.135:3300/0 conn(0x7fe9400c62e0 msgr2=0x7fe9400c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:02.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.237+0000 7fe93effd700 1 --2- 172.21.15.60:0/2487707758 >> v2:172.21.15.135:3300/0 conn(0x7fe9400c62e0 0x7fe9400c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:02.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.237+0000 7fe93effd700 1 -- 172.21.15.60:0/2487707758 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9400c5240 con 0x7fe940159390 2023-10-06T04:28:02.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.237+0000 7fe93effd700 1 --2- 172.21.15.60:0/2487707758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe940159390 0x7fe9400b30c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe940099cd0 tx=0x7fe930009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cbc7a74a1761a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:02.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.238+0000 7fe93dffb700 1 -- 172.21.15.60:0/2487707758 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe930005c10 con 0x7fe940159390 2023-10-06T04:28:02.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.238+0000 7fe93dffb700 1 -- 172.21.15.60:0/2487707758 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe930005d70 con 0x7fe940159390 2023-10-06T04:28:02.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.238+0000 7fe93dffb700 1 -- 172.21.15.60:0/2487707758 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93000b880 con 0x7fe940159390 2023-10-06T04:28:02.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.238+0000 7fe93ffff700 1 -- 172.21.15.60:0/2487707758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe940159390 msgr2=0x7fe9400b30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:02.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.238+0000 7fe93ffff700 1 --2- 172.21.15.60:0/2487707758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe940159390 0x7fe9400b30c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe940099cd0 tx=0x7fe930009220 comp rx=0 tx=0).stop 2023-10-06T04:28:02.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.238+0000 7fe93ffff700 1 -- 172.21.15.60:0/2487707758 shutdown_connections 2023-10-06T04:28:02.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.238+0000 7fe93ffff700 1 --2- 172.21.15.60:0/2487707758 >> v2:172.21.15.135:3300/0 conn(0x7fe9400c62e0 0x7fe9400c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:02.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.238+0000 7fe93ffff700 1 --2- 172.21.15.60:0/2487707758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe940159390 0x7fe9400b30c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:02.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.238+0000 7fe93ffff700 1 --2- 172.21.15.60:0/2487707758 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9400ccd00 0x7fe9400cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:02.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.238+0000 7fe93ffff700 1 -- 172.21.15.60:0/2487707758 >> 172.21.15.60:0/2487707758 conn(0x7fe9400995c0 msgr2=0x7fe94006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:02.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.238+0000 7fe93ffff700 1 -- 172.21.15.60:0/2487707758 shutdown_connections 2023-10-06T04:28:02.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.238+0000 7fe93ffff700 1 -- 172.21.15.60:0/2487707758 wait complete. 2023-10-06T04:28:02.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.240+0000 7fe93ffff700 1 Processor -- start 2023-10-06T04:28:02.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.240+0000 7fe93ffff700 1 -- start start 2023-10-06T04:28:02.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.241+0000 7fe93ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9400c62e0 0x7fe94015c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:02.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.241+0000 7fe93ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9400ccd00 0x7fe9400b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:02.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.241+0000 7fe93ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe940159390 0x7fe9400c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.241+0000 7fe93ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94015dc60 con 0x7fe9400ccd00 2023-10-06T04:28:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.241+0000 7fe93ffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9400c8070 con 0x7fe9400c62e0 2023-10-06T04:28:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.241+0000 7fe93ffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94015d0e0 con 0x7fe940159390 2023-10-06T04:28:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.241+0000 7fe93e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9400ccd00 0x7fe9400b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.241+0000 7fe93e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9400ccd00 0x7fe9400b49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52570/0 (socket says 172.21.15.60:52570) 2023-10-06T04:28:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.241+0000 7fe93e7fc700 1 -- 172.21.15.60:0/976290160 learned_addr learned my addr 172.21.15.60:0/976290160 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.241+0000 7fe93effd700 1 --2- 172.21.15.60:0/976290160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9400c62e0 0x7fe94015c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.241+0000 7fe93f7fe700 1 --2- 172.21.15.60:0/976290160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe940159390 0x7fe9400c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.241+0000 7fe93e7fc700 1 -- 172.21.15.60:0/976290160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe940159390 msgr2=0x7fe9400c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.241+0000 7fe93e7fc700 1 --2- 172.21.15.60:0/976290160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe940159390 0x7fe9400c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.241+0000 7fe93e7fc700 1 -- 172.21.15.60:0/976290160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9400c62e0 msgr2=0x7fe94015c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:02.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.241+0000 7fe93e7fc700 1 --2- 172.21.15.60:0/976290160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9400c62e0 0x7fe94015c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:02.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.241+0000 7fe93e7fc700 1 -- 172.21.15.60:0/976290160 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe930009480 con 0x7fe9400ccd00 2023-10-06T04:28:02.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.241+0000 7fe93f7fe700 1 --2- 172.21.15.60:0/976290160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe940159390 0x7fe9400c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:02.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.242+0000 7fe93e7fc700 1 --2- 172.21.15.60:0/976290160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9400ccd00 0x7fe9400b49d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe93400d890 tx=0x7fe934008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:02.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.242+0000 7fe926ffd700 1 -- 172.21.15.60:0/976290160 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9340125f0 con 0x7fe9400ccd00 2023-10-06T04:28:02.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.242+0000 7fe926ffd700 1 -- 172.21.15.60:0/976290160 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe934012750 con 0x7fe9400ccd00 2023-10-06T04:28:02.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.242+0000 7fe93ffff700 1 -- 172.21.15.60:0/976290160 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe94015d3c0 con 0x7fe9400ccd00 2023-10-06T04:28:02.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.242+0000 7fe926ffd700 1 -- 172.21.15.60:0/976290160 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934012ad0 con 0x7fe9400ccd00 2023-10-06T04:28:02.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.242+0000 7fe93ffff700 1 -- 172.21.15.60:0/976290160 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94015d750 con 0x7fe9400ccd00 2023-10-06T04:28:02.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.243+0000 7fe93ffff700 1 -- 172.21.15.60:0/976290160 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9400c8200 con 0x7fe9400ccd00 2023-10-06T04:28:02.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.244+0000 7fe926ffd700 1 -- 172.21.15.60:0/976290160 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fe93401e460 con 0x7fe9400ccd00 2023-10-06T04:28:02.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.245+0000 7fe926ffd700 1 --2- 172.21.15.60:0/976290160 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe92c066ea0 0x7fe92c069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:02.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.245+0000 7fe926ffd700 1 -- 172.21.15.60:0/976290160 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe9340848d0 con 0x7fe9400ccd00 2023-10-06T04:28:02.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.245+0000 7fe93effd700 1 --2- 172.21.15.60:0/976290160 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe92c066ea0 0x7fe92c069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:02.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.246+0000 7fe93effd700 1 --2- 172.21.15.60:0/976290160 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe92c066ea0 0x7fe92c069350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe930009260 tx=0x7fe930016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:02.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.249+0000 7fe926ffd700 1 -- 172.21.15.60:0/976290160 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9400c8200 con 0x7fe9400ccd00 2023-10-06T04:28:02.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.458+0000 7fe93ffff700 1 -- 172.21.15.60:0/976290160 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9400c81b0 con 0x7fe9400ccd00 2023-10-06T04:28:02.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.459+0000 7fe926ffd700 1 -- 172.21.15.60:0/976290160 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13648 (secure 0 0 0) 0x7fe934055800 con 0x7fe9400ccd00 2023-10-06T04:28:02.461 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:02.461 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":17,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:28:02.167748+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:28:02.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.461+0000 7fe93ffff700 1 -- 172.21.15.60:0/976290160 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe92c066ea0 msgr2=0x7fe92c069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:02.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.461+0000 7fe93ffff700 1 --2- 172.21.15.60:0/976290160 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe92c066ea0 0x7fe92c069350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe930009260 tx=0x7fe930016000 comp rx=0 tx=0).stop 2023-10-06T04:28:02.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.461+0000 7fe93ffff700 1 -- 172.21.15.60:0/976290160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9400ccd00 msgr2=0x7fe9400b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:02.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.461+0000 7fe93ffff700 1 --2- 172.21.15.60:0/976290160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9400ccd00 0x7fe9400b49d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe93400d890 tx=0x7fe934008040 comp rx=0 tx=0).stop 2023-10-06T04:28:02.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.461+0000 7fe93ffff700 1 -- 172.21.15.60:0/976290160 shutdown_connections 2023-10-06T04:28:02.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.461+0000 7fe93ffff700 1 --2- 172.21.15.60:0/976290160 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe92c066ea0 0x7fe92c069350 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:02.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.461+0000 7fe93ffff700 1 --2- 172.21.15.60:0/976290160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe940159390 0x7fe9400c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:02.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.461+0000 7fe93ffff700 1 --2- 172.21.15.60:0/976290160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9400c62e0 0x7fe94015c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:02.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.461+0000 7fe93ffff700 1 --2- 172.21.15.60:0/976290160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9400ccd00 0x7fe9400b49d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:02.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.461+0000 7fe93ffff700 1 -- 172.21.15.60:0/976290160 >> 172.21.15.60:0/976290160 conn(0x7fe9400995c0 msgr2=0x7fe9401583a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:02.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.462+0000 7fe93ffff700 1 -- 172.21.15.60:0/976290160 shutdown_connections 2023-10-06T04:28:02.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.462+0000 7fe93ffff700 1 -- 172.21.15.60:0/976290160 wait complete. 2023-10-06T04:28:02.481 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:27:58.899938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:27:59.373527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T04:28:02.481 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:28:02.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.669+0000 7f11689fe700 1 Processor -- start 2023-10-06T04:28:02.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.669+0000 7f11689fe700 1 -- start start 2023-10-06T04:28:02.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.670+0000 7f11689fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f11640b2620 0x7f11640cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:02.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.670+0000 7f11689fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11640b29f0 0x7f11640cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:02.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.670+0000 7f11689fe700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11640cc970 con 0x7f11640ceaa0 2023-10-06T04:28:02.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.670+0000 7f11689fe700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11640cbd60 con 0x7f11640b2620 2023-10-06T04:28:02.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.670+0000 7f11689fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11640cc040 con 0x7f11640b29f0 2023-10-06T04:28:02.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.670+0000 7f1162d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f11640b2620 0x7f11640cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:02.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.670+0000 7f116359e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f11640ceaa0 0x7f11640cef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55430/0 (socket says 172.21.15.60:55430) 2023-10-06T04:28:02.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.670+0000 7f116359e700 1 -- 172.21.15.60:0/892171346 learned_addr learned my addr 172.21.15.60:0/892171346 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:02.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.670+0000 7f1162d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f11640b2620 0x7f11640cccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52586/0 (socket says 172.21.15.60:52586) 2023-10-06T04:28:02.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.670+0000 7f116259c700 1 --2- 172.21.15.60:0/892171346 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11640b29f0 0x7f11640cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:02.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.671+0000 7f1162d9d700 1 -- 172.21.15.60:0/892171346 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11640b29f0 msgr2=0x7f11640cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:02.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.671+0000 7f1162d9d700 1 --2- 172.21.15.60:0/892171346 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11640b29f0 0x7f11640cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:02.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.671+0000 7f1162d9d700 1 -- 172.21.15.60:0/892171346 >> v1:172.21.15.60:6789/0 conn(0x7f11640ceaa0 legacy=0x7f11640cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:02.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.671+0000 7f1162d9d700 1 -- 172.21.15.60:0/892171346 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11640cc320 con 0x7f11640b2620 2023-10-06T04:28:02.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.671+0000 7f1161d9b700 1 -- 172.21.15.60:0/892171346 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19842929 0 0) 0x7f11640cc970 con 0x7f11640ceaa0 2023-10-06T04:28:02.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.671+0000 7f1162d9d700 1 --2- 172.21.15.60:0/892171346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11640b2620 0x7f11640cccb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f11540098d0 tx=0x7f1154009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c9a30178b39012 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:02.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.671+0000 7f1161d9b700 1 -- 172.21.15.60:0/892171346 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1154005c10 con 0x7f11640b2620 2023-10-06T04:28:02.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.671+0000 7f1161d9b700 1 -- 172.21.15.60:0/892171346 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1154005d70 con 0x7f11640b2620 2023-10-06T04:28:02.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.671+0000 7f1161d9b700 1 -- 172.21.15.60:0/892171346 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1154006280 con 0x7f11640b2620 2023-10-06T04:28:02.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.672+0000 7f11689fe700 1 -- 172.21.15.60:0/892171346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11640b2620 msgr2=0x7f11640cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:02.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.672+0000 7f11689fe700 1 --2- 172.21.15.60:0/892171346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11640b2620 0x7f11640cccb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f11540098d0 tx=0x7f1154009120 comp rx=0 tx=0).stop 2023-10-06T04:28:02.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.672+0000 7f11689fe700 1 -- 172.21.15.60:0/892171346 shutdown_connections 2023-10-06T04:28:02.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.672+0000 7f11689fe700 1 --2- 172.21.15.60:0/892171346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11640b2620 0x7f11640cccb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:02.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.672+0000 7f11689fe700 1 --2- 172.21.15.60:0/892171346 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11640b29f0 0x7f11640cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:02.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.672+0000 7f11689fe700 1 -- 172.21.15.60:0/892171346 >> 172.21.15.60:0/892171346 conn(0x7f1164099520 msgr2=0x7f116406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:02.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.672+0000 7f11689fe700 1 -- 172.21.15.60:0/892171346 shutdown_connections 2023-10-06T04:28:02.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.672+0000 7f11689fe700 1 -- 172.21.15.60:0/892171346 wait complete. 2023-10-06T04:28:02.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.673+0000 7f11689fe700 1 Processor -- start 2023-10-06T04:28:02.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.673+0000 7f11689fe700 1 -- start start 2023-10-06T04:28:02.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.674+0000 7f11689fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11640b2620 0x7f11641550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:02.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.674+0000 7f11689fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11640b29f0 0x7f11640b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:02.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.674+0000 7f11689fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11640ceaa0 0x7f11640c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:02.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.674+0000 7f11689fe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116415a970 con 0x7f11640b2620 2023-10-06T04:28:02.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.674+0000 7f11689fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11640b4480 con 0x7f11640b29f0 2023-10-06T04:28:02.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.674+0000 7f11689fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11640b4760 con 0x7f11640ceaa0 2023-10-06T04:28:02.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.675+0000 7f1162d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11640b2620 0x7f11641550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:02.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.675+0000 7f1162d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11640b2620 0x7f11641550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52598/0 (socket says 172.21.15.60:52598) 2023-10-06T04:28:02.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.675+0000 7f1162d9d700 1 -- 172.21.15.60:0/3370432341 learned_addr learned my addr 172.21.15.60:0/3370432341 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:02.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.675+0000 7f116259c700 1 --2- 172.21.15.60:0/3370432341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11640b29f0 0x7f11640b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:02.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.675+0000 7f116359e700 1 --2- 172.21.15.60:0/3370432341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11640ceaa0 0x7f11640c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:02.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.675+0000 7f1162d9d700 1 -- 172.21.15.60:0/3370432341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11640ceaa0 msgr2=0x7f11640c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:02.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.675+0000 7f1162d9d700 1 --2- 172.21.15.60:0/3370432341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11640ceaa0 0x7f11640c9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:02.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.675+0000 7f1162d9d700 1 -- 172.21.15.60:0/3370432341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11640b29f0 msgr2=0x7f11640b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:02.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.675+0000 7f1162d9d700 1 --2- 172.21.15.60:0/3370432341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11640b29f0 0x7f11640b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:02.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.675+0000 7f1162d9d700 1 -- 172.21.15.60:0/3370432341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11540093c0 con 0x7f11640b2620 2023-10-06T04:28:02.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.675+0000 7f1162d9d700 1 --2- 172.21.15.60:0/3370432341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11640b2620 0x7f11641550f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f116406fcc0 tx=0x7f1154016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:02.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.676+0000 7f114affd700 1 -- 172.21.15.60:0/3370432341 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115401d780 con 0x7f11640b2620 2023-10-06T04:28:02.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.676+0000 7f114affd700 1 -- 172.21.15.60:0/3370432341 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115401d8e0 con 0x7f11640b2620 2023-10-06T04:28:02.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.676+0000 7f11689fe700 1 -- 172.21.15.60:0/3370432341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11640b4a40 con 0x7f11640b2620 2023-10-06T04:28:02.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.676+0000 7f114affd700 1 -- 172.21.15.60:0/3370432341 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115401dca0 con 0x7f11640b2620 2023-10-06T04:28:02.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.676+0000 7f11689fe700 1 -- 172.21.15.60:0/3370432341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1164155630 con 0x7f11640b2620 2023-10-06T04:28:02.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.677+0000 7f11689fe700 1 -- 172.21.15.60:0/3370432341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f116415a740 con 0x7f11640b2620 2023-10-06T04:28:02.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.678+0000 7f114affd700 1 -- 172.21.15.60:0/3370432341 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f115401b690 con 0x7f11640b2620 2023-10-06T04:28:02.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.678+0000 7f114affd700 1 --2- 172.21.15.60:0/3370432341 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1150066ea0 0x7f1150069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:02.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.678+0000 7f114affd700 1 -- 172.21.15.60:0/3370432341 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1154085fa0 con 0x7f11640b2620 2023-10-06T04:28:02.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.679+0000 7f116259c700 1 --2- 172.21.15.60:0/3370432341 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1150066ea0 0x7f1150069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:02.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.679+0000 7f116259c700 1 --2- 172.21.15.60:0/3370432341 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1150066ea0 0x7f1150069350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f11640cf3f0 tx=0x7f11580091a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:02.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.683+0000 7f114affd700 1 -- 172.21.15.60:0/3370432341 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f116415a740 con 0x7f11640b2620 2023-10-06T04:28:02.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:02.885+0000 7f11689fe700 1 -- 172.21.15.60:0/3370432341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f116415a740 con 0x7f11640b2620 2023-10-06T04:28:03.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.027+0000 7f114affd700 1 -- 172.21.15.60:0/3370432341 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f116415a740 con 0x7f11640b2620 2023-10-06T04:28:03.029 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-10-06T04:28:03.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.030+0000 7f11689fe700 1 -- 172.21.15.60:0/3370432341 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1150066ea0 msgr2=0x7f1150069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:03.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.030+0000 7f11689fe700 1 --2- 172.21.15.60:0/3370432341 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1150066ea0 0x7f1150069350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f11640cf3f0 tx=0x7f11580091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.030+0000 7f11689fe700 1 -- 172.21.15.60:0/3370432341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11640b2620 msgr2=0x7f11641550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:03.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.030+0000 7f11689fe700 1 --2- 172.21.15.60:0/3370432341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11640b2620 0x7f11641550f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f116406fcc0 tx=0x7f1154016000 comp rx=0 tx=0).stop 2023-10-06T04:28:03.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.030+0000 7f11689fe700 1 -- 172.21.15.60:0/3370432341 shutdown_connections 2023-10-06T04:28:03.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.030+0000 7f11689fe700 1 --2- 172.21.15.60:0/3370432341 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1150066ea0 0x7f1150069350 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.030+0000 7f11689fe700 1 --2- 172.21.15.60:0/3370432341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11640b2620 0x7f11641550f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.030+0000 7f11689fe700 1 --2- 172.21.15.60:0/3370432341 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11640ceaa0 0x7f11640c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.030+0000 7f11689fe700 1 --2- 172.21.15.60:0/3370432341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11640b29f0 0x7f11640b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.030+0000 7f11689fe700 1 -- 172.21.15.60:0/3370432341 >> 172.21.15.60:0/3370432341 conn(0x7f1164099520 msgr2=0x7f11640cde00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:03.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.030+0000 7f11689fe700 1 -- 172.21.15.60:0/3370432341 shutdown_connections 2023-10-06T04:28:03.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.030+0000 7f11689fe700 1 -- 172.21.15.60:0/3370432341 wait complete. 2023-10-06T04:28:03.049 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:28:03.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.236+0000 7fe3d4d9d700 1 Processor -- start 2023-10-06T04:28:03.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.236+0000 7fe3d4d9d700 1 -- start start 2023-10-06T04:28:03.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.238+0000 7fe3d4d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3d00b2620 0x7fe3d00cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:03.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.238+0000 7fe3d4d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe3d00cf1b0 0x7fe3d00cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:03.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.238+0000 7fe3d4d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d00cc970 con 0x7fe3d00b29f0 2023-10-06T04:28:03.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.238+0000 7fe3d4d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d00cbd60 con 0x7fe3d00cf1b0 2023-10-06T04:28:03.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.238+0000 7fe3d4d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00cc040 con 0x7fe3d00b2620 2023-10-06T04:28:03.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.238+0000 7fe3cffff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe3d00cf1b0 0x7fe3d00cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:03.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.238+0000 7fe3cffff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe3d00cf1b0 0x7fe3d00cd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:60142/0 (socket says 172.21.15.60:60142) 2023-10-06T04:28:03.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.238+0000 7fe3cffff700 1 -- 172.21.15.60:0/2374491816 learned_addr learned my addr 172.21.15.60:0/2374491816 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:03.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.238+0000 7fe3cf7fe700 1 --2- 172.21.15.60:0/2374491816 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3d00b2620 0x7fe3d00cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:03.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.239+0000 7fe3ce7fc700 1 -- 172.21.15.60:0/2374491816 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276398543 0 0) 0x7fe3d00cc970 con 0x7fe3d00b29f0 2023-10-06T04:28:03.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.239+0000 7fe3ce7fc700 1 -- 172.21.15.60:0/2374491816 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3b8003570 con 0x7fe3d00b29f0 2023-10-06T04:28:03.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.239+0000 7fe3cffff700 1 -- 172.21.15.60:0/2374491816 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3d00b2620 msgr2=0x7fe3d00cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:03.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.239+0000 7fe3cffff700 1 --2- 172.21.15.60:0/2374491816 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3d00b2620 0x7fe3d00cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.239+0000 7fe3cffff700 1 -- 172.21.15.60:0/2374491816 >> v1:172.21.15.135:6789/0 conn(0x7fe3d00b29f0 legacy=0x7fe3d00ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:03.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.239+0000 7fe3cffff700 1 -- 172.21.15.60:0/2374491816 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d00cc320 con 0x7fe3d00cf1b0 2023-10-06T04:28:03.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.239+0000 7fe3cffff700 1 --2- 172.21.15.60:0/2374491816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3d00cf1b0 0x7fe3d00cd1f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009f20 tx=0x7fe3c8009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=101816f0fab446d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:03.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.239+0000 7fe3ce7fc700 1 -- 172.21.15.60:0/2374491816 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c800e070 con 0x7fe3d00cf1b0 2023-10-06T04:28:03.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.239+0000 7fe3ce7fc700 1 -- 172.21.15.60:0/2374491816 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c800b9d0 con 0x7fe3d00cf1b0 2023-10-06T04:28:03.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.239+0000 7fe3ce7fc700 1 -- 172.21.15.60:0/2374491816 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c80092e0 con 0x7fe3d00cf1b0 2023-10-06T04:28:03.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.240+0000 7fe3d4d9d700 1 -- 172.21.15.60:0/2374491816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3d00cf1b0 msgr2=0x7fe3d00cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:03.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.240+0000 7fe3d4d9d700 1 --2- 172.21.15.60:0/2374491816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3d00cf1b0 0x7fe3d00cd1f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009f20 tx=0x7fe3c8009840 comp rx=0 tx=0).stop 2023-10-06T04:28:03.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.240+0000 7fe3d4d9d700 1 -- 172.21.15.60:0/2374491816 shutdown_connections 2023-10-06T04:28:03.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.240+0000 7fe3d4d9d700 1 --2- 172.21.15.60:0/2374491816 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3d00b2620 0x7fe3d00cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.240+0000 7fe3d4d9d700 1 --2- 172.21.15.60:0/2374491816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3d00cf1b0 0x7fe3d00cd1f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.240+0000 7fe3d4d9d700 1 -- 172.21.15.60:0/2374491816 >> 172.21.15.60:0/2374491816 conn(0x7fe3d0099520 msgr2=0x7fe3d006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:03.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.240+0000 7fe3d4d9d700 1 -- 172.21.15.60:0/2374491816 shutdown_connections 2023-10-06T04:28:03.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.240+0000 7fe3d4d9d700 1 -- 172.21.15.60:0/2374491816 wait complete. 2023-10-06T04:28:03.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.241+0000 7fe3d4d9d700 1 Processor -- start 2023-10-06T04:28:03.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.241+0000 7fe3d4d9d700 1 -- start start 2023-10-06T04:28:03.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.242+0000 7fe3d4d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d00b2620 0x7fe3d0169740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:03.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.242+0000 7fe3d4d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3d00b29f0 0x7fe3d00c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:03.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.242+0000 7fe3d4d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3d00cf1b0 0x7fe3d00c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:03.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.242+0000 7fe3d4d9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00c8270 con 0x7fe3d00b2620 2023-10-06T04:28:03.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.242+0000 7fe3d4d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00c7380 con 0x7fe3d00b29f0 2023-10-06T04:28:03.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.242+0000 7fe3d4d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00c7660 con 0x7fe3d00cf1b0 2023-10-06T04:28:03.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.243+0000 7fe3cf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d00b2620 0x7fe3d0169740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:03.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.243+0000 7fe3cf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d00b2620 0x7fe3d0169740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54458/0 (socket says 172.21.15.60:54458) 2023-10-06T04:28:03.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.243+0000 7fe3cf7fe700 1 -- 172.21.15.60:0/214050535 learned_addr learned my addr 172.21.15.60:0/214050535 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:03.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.243+0000 7fe3cffff700 1 --2- 172.21.15.60:0/214050535 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3d00cf1b0 0x7fe3d00c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:03.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.243+0000 7fe3ceffd700 1 --2- 172.21.15.60:0/214050535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3d00b29f0 0x7fe3d00c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:03.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.243+0000 7fe3cf7fe700 1 -- 172.21.15.60:0/214050535 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3d00cf1b0 msgr2=0x7fe3d00c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:03.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.243+0000 7fe3cf7fe700 1 --2- 172.21.15.60:0/214050535 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3d00cf1b0 0x7fe3d00c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.243+0000 7fe3cf7fe700 1 -- 172.21.15.60:0/214050535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3d00b29f0 msgr2=0x7fe3d00c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:03.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.243+0000 7fe3cf7fe700 1 --2- 172.21.15.60:0/214050535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3d00b29f0 0x7fe3d00c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.243+0000 7fe3cf7fe700 1 -- 172.21.15.60:0/214050535 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8009ae0 con 0x7fe3d00b2620 2023-10-06T04:28:03.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.243+0000 7fe3cf7fe700 1 --2- 172.21.15.60:0/214050535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d00b2620 0x7fe3d0169740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000d840 tx=0x7fe3c0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:03.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.244+0000 7fe3b77fe700 1 -- 172.21.15.60:0/214050535 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0014620 con 0x7fe3d00b2620 2023-10-06T04:28:03.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.244+0000 7fe3b77fe700 1 -- 172.21.15.60:0/214050535 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c0014780 con 0x7fe3d00b2620 2023-10-06T04:28:03.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.244+0000 7fe3b77fe700 1 -- 172.21.15.60:0/214050535 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0014b40 con 0x7fe3d00b2620 2023-10-06T04:28:03.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.244+0000 7fe3d4d9d700 1 -- 172.21.15.60:0/214050535 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d00c7940 con 0x7fe3d00b2620 2023-10-06T04:28:03.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.244+0000 7fe3d4d9d700 1 -- 172.21.15.60:0/214050535 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d00c7f00 con 0x7fe3d00b2620 2023-10-06T04:28:03.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.245+0000 7fe3d4d9d700 1 -- 172.21.15.60:0/214050535 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d00b3150 con 0x7fe3d00b2620 2023-10-06T04:28:03.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.246+0000 7fe3b77fe700 1 -- 172.21.15.60:0/214050535 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fe3c001d400 con 0x7fe3d00b2620 2023-10-06T04:28:03.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.247+0000 7fe3b77fe700 1 --2- 172.21.15.60:0/214050535 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe3bc066ea0 0x7fe3bc069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:03.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.247+0000 7fe3b77fe700 1 -- 172.21.15.60:0/214050535 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe3c0084770 con 0x7fe3d00b2620 2023-10-06T04:28:03.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.247+0000 7fe3ceffd700 1 --2- 172.21.15.60:0/214050535 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe3bc066ea0 0x7fe3bc069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:03.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.248+0000 7fe3ceffd700 1 --2- 172.21.15.60:0/214050535 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe3bc066ea0 0x7fe3bc069350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00b5700 tx=0x7fe3c4007d50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:03.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.252+0000 7fe3b77fe700 1 -- 172.21.15.60:0/214050535 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3c0051c10 con 0x7fe3d00b2620 2023-10-06T04:28:03.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.460+0000 7fe3d4d9d700 1 -- 172.21.15.60:0/214050535 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe3d005f230 con 0x7fe3d00b2620 2023-10-06T04:28:03.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.460+0000 7fe3b77fe700 1 -- 172.21.15.60:0/214050535 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe3c0055230 con 0x7fe3d00b2620 2023-10-06T04:28:03.461 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-06T04:28:03.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.462+0000 7fe3d4d9d700 1 -- 172.21.15.60:0/214050535 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe3bc066ea0 msgr2=0x7fe3bc069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:03.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.462+0000 7fe3d4d9d700 1 --2- 172.21.15.60:0/214050535 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe3bc066ea0 0x7fe3bc069350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00b5700 tx=0x7fe3c4007d50 comp rx=0 tx=0).stop 2023-10-06T04:28:03.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.462+0000 7fe3d4d9d700 1 -- 172.21.15.60:0/214050535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d00b2620 msgr2=0x7fe3d0169740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:03.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.462+0000 7fe3d4d9d700 1 --2- 172.21.15.60:0/214050535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d00b2620 0x7fe3d0169740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000d840 tx=0x7fe3c0008040 comp rx=0 tx=0).stop 2023-10-06T04:28:03.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.462+0000 7fe3d4d9d700 1 -- 172.21.15.60:0/214050535 shutdown_connections 2023-10-06T04:28:03.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.462+0000 7fe3d4d9d700 1 --2- 172.21.15.60:0/214050535 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe3bc066ea0 0x7fe3bc069350 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.463+0000 7fe3d4d9d700 1 --2- 172.21.15.60:0/214050535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3d00b2620 0x7fe3d0169740 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.463+0000 7fe3d4d9d700 1 --2- 172.21.15.60:0/214050535 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe3d00cf1b0 0x7fe3d00c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.463+0000 7fe3d4d9d700 1 --2- 172.21.15.60:0/214050535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3d00b29f0 0x7fe3d00c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.463+0000 7fe3d4d9d700 1 -- 172.21.15.60:0/214050535 >> 172.21.15.60:0/214050535 conn(0x7fe3d0099520 msgr2=0x7fe3d0157b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:03.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.463+0000 7fe3d4d9d700 1 -- 172.21.15.60:0/214050535 shutdown_connections 2023-10-06T04:28:03.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.463+0000 7fe3d4d9d700 1 -- 172.21.15.60:0/214050535 wait complete. 2023-10-06T04:28:03.481 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T04:28:03.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.666+0000 7fa53e19d700 1 Processor -- start 2023-10-06T04:28:03.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.666+0000 7fa53e19d700 1 -- start start 2023-10-06T04:28:03.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.668+0000 7fa53e19d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa538159390 0x7fa5380ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.668+0000 7fa53e19d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5380686c0 con 0x7fa5380ab410 2023-10-06T04:28:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.668+0000 7fa53e19d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa538068c80 con 0x7fa538159760 2023-10-06T04:28:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.668+0000 7fa53e19d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5380ace20 con 0x7fa538159390 2023-10-06T04:28:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.668+0000 7fa53d19b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa538159390 0x7fa5380ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.668+0000 7fa53d99c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa5380ab410 0x7fa5380aeb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60402/0 (socket says 172.21.15.60:60402) 2023-10-06T04:28:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.668+0000 7fa53d99c700 1 -- 172.21.15.60:0/3071148482 learned_addr learned my addr 172.21.15.60:0/3071148482 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.668+0000 7fa53d19b700 1 -- 172.21.15.60:0/3071148482 >> v1:172.21.15.135:6789/0 conn(0x7fa538159760 legacy=0x7fa5380aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.668+0000 7fa53d19b700 1 -- 172.21.15.60:0/3071148482 >> v1:172.21.15.60:6789/0 conn(0x7fa5380ab410 legacy=0x7fa5380aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.668+0000 7fa53d19b700 1 -- 172.21.15.60:0/3071148482 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5380ad0f0 con 0x7fa538159390 2023-10-06T04:28:03.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.668+0000 7fa52ffff700 1 -- 172.21.15.60:0/3071148482 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115713838 0 0) 0x7fa5380686c0 con 0x7fa5380ab410 2023-10-06T04:28:03.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.669+0000 7fa53d19b700 1 --2- 172.21.15.60:0/3071148482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa538159390 0x7fa5380ac8e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5340098e0 tx=0x7fa5340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b1f463d782e775 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:03.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.669+0000 7fa52ffff700 1 -- 172.21.15.60:0/3071148482 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa534009e80 con 0x7fa538159390 2023-10-06T04:28:03.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.669+0000 7fa52ffff700 1 -- 172.21.15.60:0/3071148482 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53400b860 con 0x7fa538159390 2023-10-06T04:28:03.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.669+0000 7fa52ffff700 1 -- 172.21.15.60:0/3071148482 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53400bbe0 con 0x7fa538159390 2023-10-06T04:28:03.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.669+0000 7fa53e19d700 1 -- 172.21.15.60:0/3071148482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa538159390 msgr2=0x7fa5380ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:03.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.669+0000 7fa53e19d700 1 --2- 172.21.15.60:0/3071148482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa538159390 0x7fa5380ac8e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5340098e0 tx=0x7fa5340091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.670+0000 7fa53e19d700 1 -- 172.21.15.60:0/3071148482 shutdown_connections 2023-10-06T04:28:03.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.670+0000 7fa53e19d700 1 --2- 172.21.15.60:0/3071148482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa538159390 0x7fa5380ac8e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.670+0000 7fa53e19d700 1 -- 172.21.15.60:0/3071148482 >> 172.21.15.60:0/3071148482 conn(0x7fa538097410 msgr2=0x7fa538067d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:03.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.670+0000 7fa53e19d700 1 -- 172.21.15.60:0/3071148482 shutdown_connections 2023-10-06T04:28:03.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.670+0000 7fa53e19d700 1 -- 172.21.15.60:0/3071148482 wait complete. 2023-10-06T04:28:03.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.671+0000 7fa53e19d700 1 Processor -- start 2023-10-06T04:28:03.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.671+0000 7fa53e19d700 1 -- start start 2023-10-06T04:28:03.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.672+0000 7fa53e19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5380ab410 0x7fa538148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:03.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.672+0000 7fa53e19d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa538159390 0x7fa538099e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:03.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.672+0000 7fa53e19d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa538159760 0x7fa53809a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.672+0000 7fa53e19d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53809b5d0 con 0x7fa538159760 2023-10-06T04:28:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.672+0000 7fa53e19d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53809a9c0 con 0x7fa538159390 2023-10-06T04:28:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.672+0000 7fa53e19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53809aca0 con 0x7fa5380ab410 2023-10-06T04:28:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.672+0000 7fa53d99c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa538159760 0x7fa53809a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.672+0000 7fa53d99c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa538159760 0x7fa53809a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54476/0 (socket says 172.21.15.60:54476) 2023-10-06T04:28:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.672+0000 7fa53d99c700 1 -- 172.21.15.60:0/517787710 learned_addr learned my addr 172.21.15.60:0/517787710 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.672+0000 7fa53d19b700 1 --2- 172.21.15.60:0/517787710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5380ab410 0x7fa538148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.672+0000 7fa53c99a700 1 --2- 172.21.15.60:0/517787710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa538159390 0x7fa538099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.673+0000 7fa53d99c700 1 -- 172.21.15.60:0/517787710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5380ab410 msgr2=0x7fa538148b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.673+0000 7fa53d99c700 1 --2- 172.21.15.60:0/517787710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5380ab410 0x7fa538148b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.673+0000 7fa53d99c700 1 -- 172.21.15.60:0/517787710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa538159390 msgr2=0x7fa538099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:03.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.673+0000 7fa53d99c700 1 --2- 172.21.15.60:0/517787710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa538159390 0x7fa538099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.673+0000 7fa53d99c700 1 -- 172.21.15.60:0/517787710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa534009420 con 0x7fa538159760 2023-10-06T04:28:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.673+0000 7fa53d99c700 1 --2- 172.21.15.60:0/517787710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa538159760 0x7fa53809a3b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa53000ccc0 tx=0x7fa530001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:03.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.673+0000 7fa52d7fa700 1 -- 172.21.15.60:0/517787710 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53000a880 con 0x7fa538159760 2023-10-06T04:28:03.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.673+0000 7fa52d7fa700 1 -- 172.21.15.60:0/517787710 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53000a9e0 con 0x7fa538159760 2023-10-06T04:28:03.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.673+0000 7fa53e19d700 1 -- 172.21.15.60:0/517787710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53809af80 con 0x7fa538159760 2023-10-06T04:28:03.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.673+0000 7fa52d7fa700 1 -- 172.21.15.60:0/517787710 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53000ad80 con 0x7fa538159760 2023-10-06T04:28:03.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.673+0000 7fa53e19d700 1 -- 172.21.15.60:0/517787710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa538149050 con 0x7fa538159760 2023-10-06T04:28:03.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.674+0000 7fa53e19d700 1 -- 172.21.15.60:0/517787710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa53809b740 con 0x7fa538159760 2023-10-06T04:28:03.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.675+0000 7fa52d7fa700 1 -- 172.21.15.60:0/517787710 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fa530007300 con 0x7fa538159760 2023-10-06T04:28:03.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.676+0000 7fa52d7fa700 1 --2- 172.21.15.60:0/517787710 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa51c066ea0 0x7fa51c069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:03.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.676+0000 7fa52d7fa700 1 -- 172.21.15.60:0/517787710 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa5300845b0 con 0x7fa538159760 2023-10-06T04:28:03.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.676+0000 7fa53d19b700 1 --2- 172.21.15.60:0/517787710 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa51c066ea0 0x7fa51c069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:03.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.677+0000 7fa53d19b700 1 --2- 172.21.15.60:0/517787710 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa51c066ea0 0x7fa51c069350 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa5340093f0 tx=0x7fa534017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:03.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.680+0000 7fa52d7fa700 1 -- 172.21.15.60:0/517787710 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa530051ad0 con 0x7fa538159760 2023-10-06T04:28:03.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.721+0000 7fa52d7fa700 1 -- 172.21.15.60:0/517787710 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa530051ea0 con 0x7fa538159760 2023-10-06T04:28:03.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.890+0000 7fa53e19d700 1 -- 172.21.15.60:0/517787710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa53805f230 con 0x7fa538159760 2023-10-06T04:28:03.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.891+0000 7fa52d7fa700 1 -- 172.21.15.60:0/517787710 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7fa530055560 con 0x7fa538159760 2023-10-06T04:28:03.892 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:03.892 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2023-10-06T04:28:03.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:28:03.892 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2023-10-06T04:28:03.892 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "rbd" 2023-10-06T04:28:03.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:28:03.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:28:03.893 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 2, 2023-10-06T04:28:03.893 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2023-10-06T04:28:03.893 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:28:03.893 INFO:teuthology.orchestra.run.smithi060.stdout:] 2023-10-06T04:28:03.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.893+0000 7fa53e19d700 1 -- 172.21.15.60:0/517787710 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa51c066ea0 msgr2=0x7fa51c069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:03.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.893+0000 7fa53e19d700 1 --2- 172.21.15.60:0/517787710 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa51c066ea0 0x7fa51c069350 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa5340093f0 tx=0x7fa534017000 comp rx=0 tx=0).stop 2023-10-06T04:28:03.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.893+0000 7fa53e19d700 1 -- 172.21.15.60:0/517787710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa538159760 msgr2=0x7fa53809a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:03.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.893+0000 7fa53e19d700 1 --2- 172.21.15.60:0/517787710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa538159760 0x7fa53809a3b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa53000ccc0 tx=0x7fa530001a20 comp rx=0 tx=0).stop 2023-10-06T04:28:03.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.893+0000 7fa53e19d700 1 -- 172.21.15.60:0/517787710 shutdown_connections 2023-10-06T04:28:03.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.893+0000 7fa53e19d700 1 --2- 172.21.15.60:0/517787710 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa51c066ea0 0x7fa51c069350 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.893+0000 7fa53e19d700 1 --2- 172.21.15.60:0/517787710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa538159760 0x7fa53809a3b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.893+0000 7fa53e19d700 1 --2- 172.21.15.60:0/517787710 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa5380ab410 0x7fa538148b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.893+0000 7fa53e19d700 1 --2- 172.21.15.60:0/517787710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa538159390 0x7fa538099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:03.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.893+0000 7fa53e19d700 1 -- 172.21.15.60:0/517787710 >> 172.21.15.60:0/517787710 conn(0x7fa538097410 msgr2=0x7fa53806c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:03.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.893+0000 7fa53e19d700 1 -- 172.21.15.60:0/517787710 shutdown_connections 2023-10-06T04:28:03.895 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:03.893+0000 7fa53e19d700 1 -- 172.21.15.60:0/517787710 wait complete. 2023-10-06T04:28:03.911 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T04:28:03.912 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T04:28:04.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.100+0000 7f7e10d9d700 1 Processor -- start 2023-10-06T04:28:04.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.100+0000 7f7e10d9d700 1 -- start start 2023-10-06T04:28:04.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.101+0000 7f7e10d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7e0c13f760 0x7f7e0c06a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:04.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.101+0000 7f7e10d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e0c06e7c0 0x7f7e0c06a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:04.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.101+0000 7f7e10d9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0c06ee20 con 0x7f7e0c13fb30 2023-10-06T04:28:04.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.101+0000 7f7e10d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0c06ec20 con 0x7f7e0c13f760 2023-10-06T04:28:04.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.101+0000 7f7e10d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c0c2460 con 0x7f7e0c06e7c0 2023-10-06T04:28:04.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.101+0000 7f7e0affd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7e0c13fb30 0x7f7e0c06e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60416/0 (socket says 172.21.15.60:60416) 2023-10-06T04:28:04.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.101+0000 7f7e0affd700 1 -- 172.21.15.60:0/2259876902 learned_addr learned my addr 172.21.15.60:0/2259876902 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:04.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.102+0000 7f7e0bfff700 1 --2- 172.21.15.60:0/2259876902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e0c06e7c0 0x7f7e0c06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:04.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.102+0000 7f7e0b7fe700 1 --2- 172.21.15.60:0/2259876902 >> v2:172.21.15.135:3300/0 conn(0x7f7e0c13f760 0x7f7e0c06a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:04.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.102+0000 7f7e0a7fc700 1 -- 172.21.15.60:0/2259876902 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177170118 0 0) 0x7f7e0c06ee20 con 0x7f7e0c13fb30 2023-10-06T04:28:04.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.102+0000 7f7e0a7fc700 1 -- 172.21.15.60:0/2259876902 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df4003570 con 0x7f7e0c13fb30 2023-10-06T04:28:04.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.102+0000 7f7e0a7fc700 1 -- 172.21.15.60:0/2259876902 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2986910986 0 0) 0x7f7df4003570 con 0x7f7e0c13fb30 2023-10-06T04:28:04.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.102+0000 7f7e0bfff700 1 -- 172.21.15.60:0/2259876902 >> v2:172.21.15.135:3300/0 conn(0x7f7e0c13f760 msgr2=0x7f7e0c06a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:04.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.102+0000 7f7e0bfff700 1 --2- 172.21.15.60:0/2259876902 >> v2:172.21.15.135:3300/0 conn(0x7f7e0c13f760 0x7f7e0c06a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:04.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.102+0000 7f7e0bfff700 1 -- 172.21.15.60:0/2259876902 >> v1:172.21.15.60:6789/0 conn(0x7f7e0c13fb30 legacy=0x7f7e0c06e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:04.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.102+0000 7f7e0bfff700 1 -- 172.21.15.60:0/2259876902 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c06f100 con 0x7f7e0c06e7c0 2023-10-06T04:28:04.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.102+0000 7f7e0b7fe700 1 --2- 172.21.15.60:0/2259876902 >> v2:172.21.15.135:3300/0 conn(0x7f7e0c13f760 0x7f7e0c06a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:04.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.102+0000 7f7e0bfff700 1 --2- 172.21.15.60:0/2259876902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e0c06e7c0 0x7f7e0c06a900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009e60 tx=0x7f7e04009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3de5572e3fe8c1bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:04.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.103+0000 7f7e0a7fc700 1 -- 172.21.15.60:0/2259876902 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0400e070 con 0x7f7e0c06e7c0 2023-10-06T04:28:04.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.103+0000 7f7e0a7fc700 1 -- 172.21.15.60:0/2259876902 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0400b7a0 con 0x7f7e0c06e7c0 2023-10-06T04:28:04.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.103+0000 7f7e0a7fc700 1 -- 172.21.15.60:0/2259876902 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00001470 con 0x7f7e0c06e7c0 2023-10-06T04:28:04.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.103+0000 7f7e10d9d700 1 -- 172.21.15.60:0/2259876902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e0c06e7c0 msgr2=0x7f7e0c06a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:04.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.103+0000 7f7e10d9d700 1 --2- 172.21.15.60:0/2259876902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e0c06e7c0 0x7f7e0c06a900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009e60 tx=0x7f7e04009780 comp rx=0 tx=0).stop 2023-10-06T04:28:04.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.103+0000 7f7e10d9d700 1 -- 172.21.15.60:0/2259876902 shutdown_connections 2023-10-06T04:28:04.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.103+0000 7f7e10d9d700 1 --2- 172.21.15.60:0/2259876902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e0c06e7c0 0x7f7e0c06a900 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:04.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.103+0000 7f7e10d9d700 1 --2- 172.21.15.60:0/2259876902 >> v2:172.21.15.135:3300/0 conn(0x7f7e0c13f760 0x7f7e0c06a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:04.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.103+0000 7f7e10d9d700 1 -- 172.21.15.60:0/2259876902 >> 172.21.15.60:0/2259876902 conn(0x7f7e0c068080 msgr2=0x7f7e0c0cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:04.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.103+0000 7f7e10d9d700 1 -- 172.21.15.60:0/2259876902 shutdown_connections 2023-10-06T04:28:04.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.103+0000 7f7e10d9d700 1 -- 172.21.15.60:0/2259876902 wait complete. 2023-10-06T04:28:04.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.105+0000 7f7e10d9d700 1 Processor -- start 2023-10-06T04:28:04.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.105+0000 7f7e10d9d700 1 -- start start 2023-10-06T04:28:04.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.106+0000 7f7e10d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e0c06e7c0 0x7f7e0c156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:04.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.106+0000 7f7e10d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e0c13f760 0x7f7e0c0acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:04.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.106+0000 7f7e10d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e0c13fb30 0x7f7e0c0cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:04.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.106+0000 7f7e10d9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c0ad6c0 con 0x7f7e0c06e7c0 2023-10-06T04:28:04.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.106+0000 7f7e10d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c0ad9a0 con 0x7f7e0c13fb30 2023-10-06T04:28:04.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.106+0000 7f7e10d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c0adc80 con 0x7f7e0c13f760 2023-10-06T04:28:04.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.106+0000 7f7e0b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e0c06e7c0 0x7f7e0c156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:04.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.106+0000 7f7e0b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e0c06e7c0 0x7f7e0c156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54482/0 (socket says 172.21.15.60:54482) 2023-10-06T04:28:04.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.106+0000 7f7e0b7fe700 1 -- 172.21.15.60:0/216402593 learned_addr learned my addr 172.21.15.60:0/216402593 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:04.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.106+0000 7f7e0affd700 1 --2- 172.21.15.60:0/216402593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e0c13f760 0x7f7e0c0acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:04.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.106+0000 7f7e0bfff700 1 --2- 172.21.15.60:0/216402593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e0c13fb30 0x7f7e0c0cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:04.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.106+0000 7f7e0b7fe700 1 -- 172.21.15.60:0/216402593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e0c13f760 msgr2=0x7f7e0c0acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:04.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.106+0000 7f7e0b7fe700 1 --2- 172.21.15.60:0/216402593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e0c13f760 0x7f7e0c0acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:04.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.106+0000 7f7e0b7fe700 1 -- 172.21.15.60:0/216402593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e0c13fb30 msgr2=0x7f7e0c0cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:04.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.106+0000 7f7e0b7fe700 1 --2- 172.21.15.60:0/216402593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e0c13fb30 0x7f7e0c0cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:04.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.106+0000 7f7e0b7fe700 1 -- 172.21.15.60:0/216402593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dfc009420 con 0x7f7e0c06e7c0 2023-10-06T04:28:04.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.106+0000 7f7e0bfff700 1 --2- 172.21.15.60:0/216402593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e0c13fb30 0x7f7e0c0cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:04.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.107+0000 7f7e0b7fe700 1 --2- 172.21.15.60:0/216402593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e0c06e7c0 0x7f7e0c156430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc00ec80 tx=0x7f7dfc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:04.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.107+0000 7f7df37fe700 1 -- 172.21.15.60:0/216402593 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc00c9d0 con 0x7f7e0c06e7c0 2023-10-06T04:28:04.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.107+0000 7f7df37fe700 1 -- 172.21.15.60:0/216402593 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc00cb30 con 0x7f7e0c06e7c0 2023-10-06T04:28:04.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.107+0000 7f7df37fe700 1 -- 172.21.15.60:0/216402593 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc00ced0 con 0x7f7e0c06e7c0 2023-10-06T04:28:04.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.107+0000 7f7e10d9d700 1 -- 172.21.15.60:0/216402593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e04009a20 con 0x7f7e0c06e7c0 2023-10-06T04:28:04.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.107+0000 7f7e10d9d700 1 -- 172.21.15.60:0/216402593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0c0ae240 con 0x7f7e0c06e7c0 2023-10-06T04:28:04.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.108+0000 7f7e10d9d700 1 -- 172.21.15.60:0/216402593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0c05f230 con 0x7f7e0c06e7c0 2023-10-06T04:28:04.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.109+0000 7f7df37fe700 1 -- 172.21.15.60:0/216402593 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7dfc013680 con 0x7f7e0c06e7c0 2023-10-06T04:28:04.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.110+0000 7f7df37fe700 1 --2- 172.21.15.60:0/216402593 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7df8066f60 0x7f7df8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:04.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.110+0000 7f7df37fe700 1 -- 172.21.15.60:0/216402593 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7dfc084730 con 0x7f7e0c06e7c0 2023-10-06T04:28:04.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.110+0000 7f7e0affd700 1 --2- 172.21.15.60:0/216402593 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7df8066f60 0x7f7df8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:04.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.110+0000 7f7e0affd700 1 --2- 172.21.15.60:0/216402593 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7df8066f60 0x7f7df8069410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c168700 tx=0x7f7e00001120 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:04.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.114+0000 7f7df37fe700 1 -- 172.21.15.60:0/216402593 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7dfc051af0 con 0x7f7e0c06e7c0 2023-10-06T04:28:04.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.316+0000 7f7e10d9d700 1 -- 172.21.15.60:0/216402593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7e0c0ccbb0 con 0x7f7e0c06e7c0 2023-10-06T04:28:04.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.726+0000 7f7df37fe700 1 -- 172.21.15.60:0/216402593 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7dfc055110 con 0x7f7e0c06e7c0 2023-10-06T04:28:04.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.729+0000 7f7e10d9d700 1 -- 172.21.15.60:0/216402593 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7df8066f60 msgr2=0x7f7df8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:04.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.729+0000 7f7e10d9d700 1 --2- 172.21.15.60:0/216402593 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7df8066f60 0x7f7df8069410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c168700 tx=0x7f7e00001120 comp rx=0 tx=0).stop 2023-10-06T04:28:04.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.729+0000 7f7e10d9d700 1 -- 172.21.15.60:0/216402593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e0c06e7c0 msgr2=0x7f7e0c156430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:04.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.729+0000 7f7e10d9d700 1 --2- 172.21.15.60:0/216402593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e0c06e7c0 0x7f7e0c156430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc00ec80 tx=0x7f7dfc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:04.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.729+0000 7f7e10d9d700 1 -- 172.21.15.60:0/216402593 shutdown_connections 2023-10-06T04:28:04.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.729+0000 7f7e10d9d700 1 --2- 172.21.15.60:0/216402593 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7df8066f60 0x7f7df8069410 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:04.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.729+0000 7f7e10d9d700 1 --2- 172.21.15.60:0/216402593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e0c06e7c0 0x7f7e0c156430 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:04.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.729+0000 7f7e10d9d700 1 --2- 172.21.15.60:0/216402593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e0c13fb30 0x7f7e0c0cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:04.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.729+0000 7f7e10d9d700 1 --2- 172.21.15.60:0/216402593 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7e0c13f760 0x7f7e0c0acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:04.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.729+0000 7f7e10d9d700 1 -- 172.21.15.60:0/216402593 >> 172.21.15.60:0/216402593 conn(0x7f7e0c068080 msgr2=0x7f7e0c06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:04.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.729+0000 7f7e10d9d700 1 -- 172.21.15.60:0/216402593 shutdown_connections 2023-10-06T04:28:04.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.729+0000 7f7e10d9d700 1 -- 172.21.15.60:0/216402593 wait complete. 2023-10-06T04:28:04.732 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2023-10-06T04:28:04.756 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-06T04:28:04.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.950+0000 7f7c5c3ff700 1 Processor -- start 2023-10-06T04:28:04.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.950+0000 7f7c5c3ff700 1 -- start start 2023-10-06T04:28:04.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.951+0000 7f7c5c3ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7c54067bd0 0x7f7c540cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:04.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.951+0000 7f7c5c3ff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7c5415dcf0 0x7f7c540cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:04.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.951+0000 7f7c5c3ff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5415d860 con 0x7f7c54159ae0 2023-10-06T04:28:04.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.951+0000 7f7c5c3ff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5415aad0 con 0x7f7c5415dcf0 2023-10-06T04:28:04.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.951+0000 7f7c5c3ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5415a5f0 con 0x7f7c54067bd0 2023-10-06T04:28:04.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.951+0000 7f7c5999a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7c5415dcf0 0x7f7c540cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:04.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.951+0000 7f7c5a99c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7c54159ae0 0x7f7c54159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60424/0 (socket says 172.21.15.60:60424) 2023-10-06T04:28:04.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.951+0000 7f7c5a99c700 1 -- 172.21.15.60:0/866458830 learned_addr learned my addr 172.21.15.60:0/866458830 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:04.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.952+0000 7f7c5a19b700 1 --2- 172.21.15.60:0/866458830 >> v2:172.21.15.135:3300/0 conn(0x7f7c54067bd0 0x7f7c540cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:04.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.952+0000 7f7c5999a700 1 -- 172.21.15.60:0/866458830 >> v2:172.21.15.135:3300/0 conn(0x7f7c54067bd0 msgr2=0x7f7c540cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:04.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.952+0000 7f7c5999a700 1 --2- 172.21.15.60:0/866458830 >> v2:172.21.15.135:3300/0 conn(0x7f7c54067bd0 0x7f7c540cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:04.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.952+0000 7f7c5999a700 1 -- 172.21.15.60:0/866458830 >> v1:172.21.15.60:6789/0 conn(0x7f7c54159ae0 legacy=0x7f7c54159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:04.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.952+0000 7f7c5999a700 1 -- 172.21.15.60:0/866458830 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5415a7f0 con 0x7f7c5415dcf0 2023-10-06T04:28:04.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.952+0000 7f7c59199700 1 -- 172.21.15.60:0/866458830 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810130554 0 0) 0x7f7c5415d860 con 0x7f7c54159ae0 2023-10-06T04:28:04.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.952+0000 7f7c5999a700 1 --2- 172.21.15.60:0/866458830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5415dcf0 0x7f7c540cb2b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7c5406dbe0 tx=0x7f7c440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd993140b27f4f76 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:04.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.952+0000 7f7c59199700 1 -- 172.21.15.60:0/866458830 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44011630 con 0x7f7c5415dcf0 2023-10-06T04:28:04.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.953+0000 7f7c59199700 1 -- 172.21.15.60:0/866458830 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c44011790 con 0x7f7c5415dcf0 2023-10-06T04:28:04.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.953+0000 7f7c59199700 1 -- 172.21.15.60:0/866458830 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44011b30 con 0x7f7c5415dcf0 2023-10-06T04:28:04.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.953+0000 7f7c5c3ff700 1 -- 172.21.15.60:0/866458830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5415dcf0 msgr2=0x7f7c540cb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:04.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.953+0000 7f7c5c3ff700 1 --2- 172.21.15.60:0/866458830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5415dcf0 0x7f7c540cb2b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7c5406dbe0 tx=0x7f7c440091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:04.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.953+0000 7f7c5c3ff700 1 -- 172.21.15.60:0/866458830 shutdown_connections 2023-10-06T04:28:04.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.953+0000 7f7c5c3ff700 1 --2- 172.21.15.60:0/866458830 >> v2:172.21.15.135:3300/0 conn(0x7f7c54067bd0 0x7f7c540cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:04.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.953+0000 7f7c5c3ff700 1 --2- 172.21.15.60:0/866458830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5415dcf0 0x7f7c540cb2b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:04.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.953+0000 7f7c5c3ff700 1 -- 172.21.15.60:0/866458830 >> 172.21.15.60:0/866458830 conn(0x7f7c540cd1a0 msgr2=0x7f7c540cd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:04.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.953+0000 7f7c5c3ff700 1 -- 172.21.15.60:0/866458830 shutdown_connections 2023-10-06T04:28:04.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.953+0000 7f7c5c3ff700 1 -- 172.21.15.60:0/866458830 wait complete. 2023-10-06T04:28:04.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.955+0000 7f7c5c3ff700 1 Processor -- start 2023-10-06T04:28:04.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.955+0000 7f7c5c3ff700 1 -- start start 2023-10-06T04:28:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.956+0000 7f7c5c3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c54067bd0 0x7f7c540c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.956+0000 7f7c5c3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c54159ae0 0x7f7c5414f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.956+0000 7f7c5c3ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5415dcf0 0x7f7c540c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.956+0000 7f7c5c3ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540c70e0 con 0x7f7c5415dcf0 2023-10-06T04:28:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.956+0000 7f7c5c3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c541592e0 con 0x7f7c54159ae0 2023-10-06T04:28:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.956+0000 7f7c5c3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c541595c0 con 0x7f7c54067bd0 2023-10-06T04:28:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.956+0000 7f7c5a99c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5415dcf0 0x7f7c540c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.956+0000 7f7c5a99c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5415dcf0 0x7f7c540c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54506/0 (socket says 172.21.15.60:54506) 2023-10-06T04:28:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.956+0000 7f7c5a99c700 1 -- 172.21.15.60:0/1359045574 learned_addr learned my addr 172.21.15.60:0/1359045574 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.956+0000 7f7c5a19b700 1 --2- 172.21.15.60:0/1359045574 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c54067bd0 0x7f7c540c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.956+0000 7f7c5999a700 1 --2- 172.21.15.60:0/1359045574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c54159ae0 0x7f7c5414f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.957+0000 7f7c5a99c700 1 -- 172.21.15.60:0/1359045574 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c54067bd0 msgr2=0x7f7c540c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.957+0000 7f7c5a99c700 1 --2- 172.21.15.60:0/1359045574 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c54067bd0 0x7f7c540c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.957+0000 7f7c5a99c700 1 -- 172.21.15.60:0/1359045574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c54159ae0 msgr2=0x7f7c5414f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.957+0000 7f7c5a99c700 1 --2- 172.21.15.60:0/1359045574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c54159ae0 0x7f7c5414f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.957+0000 7f7c5a99c700 1 -- 172.21.15.60:0/1359045574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c44009420 con 0x7f7c5415dcf0 2023-10-06T04:28:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.957+0000 7f7c5a99c700 1 --2- 172.21.15.60:0/1359045574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5415dcf0 0x7f7c540c8790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00cbf0 tx=0x7f7c4c0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.957+0000 7f7c4a7fc700 1 -- 172.21.15.60:0/1359045574 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c00a8b0 con 0x7f7c5415dcf0 2023-10-06T04:28:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.957+0000 7f7c4a7fc700 1 -- 172.21.15.60:0/1359045574 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4c00aa10 con 0x7f7c5415dcf0 2023-10-06T04:28:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.957+0000 7f7c5c3ff700 1 -- 172.21.15.60:0/1359045574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c541598a0 con 0x7f7c5415dcf0 2023-10-06T04:28:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.957+0000 7f7c4a7fc700 1 -- 172.21.15.60:0/1359045574 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c00add0 con 0x7f7c5415dcf0 2023-10-06T04:28:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.957+0000 7f7c5c3ff700 1 -- 172.21.15.60:0/1359045574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c540b02c0 con 0x7f7c5415dcf0 2023-10-06T04:28:04.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.958+0000 7f7c5c3ff700 1 -- 172.21.15.60:0/1359045574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c540b04e0 con 0x7f7c5415dcf0 2023-10-06T04:28:04.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.959+0000 7f7c4a7fc700 1 -- 172.21.15.60:0/1359045574 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c4c007300 con 0x7f7c5415dcf0 2023-10-06T04:28:04.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.960+0000 7f7c4a7fc700 1 --2- 172.21.15.60:0/1359045574 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7c38066f30 0x7f7c380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:04.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.960+0000 7f7c4a7fc700 1 -- 172.21.15.60:0/1359045574 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f7c4c084820 con 0x7f7c5415dcf0 2023-10-06T04:28:04.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.960+0000 7f7c5a19b700 1 --2- 172.21.15.60:0/1359045574 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7c38066f30 0x7f7c380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:04.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.961+0000 7f7c5a19b700 1 --2- 172.21.15.60:0/1359045574 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7c38066f30 0x7f7c380693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009d10 tx=0x7f7c500091a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:04.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:04.965+0000 7f7c4a7fc700 1 -- 172.21.15.60:0/1359045574 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c4c051af0 con 0x7f7c5415dcf0 2023-10-06T04:28:05.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.169+0000 7f7c5c3ff700 1 -- 172.21.15.60:0/1359045574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f7c54064a90 con 0x7f7c5415dcf0 2023-10-06T04:28:05.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.734+0000 7f7c4a7fc700 1 -- 172.21.15.60:0/1359045574 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f7c4c055110 con 0x7f7c5415dcf0 2023-10-06T04:28:05.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.739+0000 7f7c5c3ff700 1 -- 172.21.15.60:0/1359045574 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7c38066f30 msgr2=0x7f7c380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:05.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.739+0000 7f7c5c3ff700 1 --2- 172.21.15.60:0/1359045574 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7c38066f30 0x7f7c380693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009d10 tx=0x7f7c500091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:05.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.739+0000 7f7c5c3ff700 1 -- 172.21.15.60:0/1359045574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5415dcf0 msgr2=0x7f7c540c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:05.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.739+0000 7f7c5c3ff700 1 --2- 172.21.15.60:0/1359045574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5415dcf0 0x7f7c540c8790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00cbf0 tx=0x7f7c4c0019b0 comp rx=0 tx=0).stop 2023-10-06T04:28:05.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.740+0000 7f7c5c3ff700 1 -- 172.21.15.60:0/1359045574 shutdown_connections 2023-10-06T04:28:05.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.740+0000 7f7c5c3ff700 1 --2- 172.21.15.60:0/1359045574 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7c38066f30 0x7f7c380693e0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009d10 tx=0x7f7c500091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:05.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.740+0000 7f7c5c3ff700 1 --2- 172.21.15.60:0/1359045574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5415dcf0 0x7f7c540c8790 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:05.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.740+0000 7f7c5c3ff700 1 --2- 172.21.15.60:0/1359045574 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7c54067bd0 0x7f7c540c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:05.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.740+0000 7f7c5c3ff700 1 --2- 172.21.15.60:0/1359045574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c54159ae0 0x7f7c5414f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:05.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.740+0000 7f7c5c3ff700 1 -- 172.21.15.60:0/1359045574 >> 172.21.15.60:0/1359045574 conn(0x7f7c540cd1a0 msgr2=0x7f7c5406e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.757+0000 7f7c5c3ff700 1 -- 172.21.15.60:0/1359045574 shutdown_connections 2023-10-06T04:28:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.757+0000 7f7c5c3ff700 1 -- 172.21.15.60:0/1359045574 wait complete. 2023-10-06T04:28:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2023-10-06T04:28:05.783 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T04:28:05.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.974+0000 7f987279d700 1 Processor -- start 2023-10-06T04:28:05.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.974+0000 7f987279d700 1 -- start start 2023-10-06T04:28:05.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.976+0000 7f987279d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f986c0cb060 0x7f986c159b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:05.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.976+0000 7f987279d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f986c15a080 0x7f986c0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:05.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.976+0000 7f987279d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986c0ca5b0 con 0x7f986c13c430 2023-10-06T04:28:05.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.976+0000 7f987279d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986c15a8e0 con 0x7f986c15a080 2023-10-06T04:28:05.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.976+0000 7f987279d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986c06d500 con 0x7f986c0cb060 2023-10-06T04:28:05.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.976+0000 7f9871f9c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f986c15a080 0x7f986c0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:05.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.976+0000 7f9871f9c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f986c15a080 0x7f986c0c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54510/0 (socket says 172.21.15.60:54510) 2023-10-06T04:28:05.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.976+0000 7f9871f9c700 1 -- 172.21.15.60:0/688893033 learned_addr learned my addr 172.21.15.60:0/688893033 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:05.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.976+0000 7f9870f9a700 1 --2- 172.21.15.60:0/688893033 >> v2:172.21.15.135:3300/0 conn(0x7f986c0cb060 0x7f986c159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:05.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.976+0000 7f9871f9c700 1 -- 172.21.15.60:0/688893033 >> v2:172.21.15.135:3300/0 conn(0x7f986c0cb060 msgr2=0x7f986c159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:05.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.976+0000 7f9871f9c700 1 --2- 172.21.15.60:0/688893033 >> v2:172.21.15.135:3300/0 conn(0x7f986c0cb060 0x7f986c159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:05.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.977+0000 7f9871f9c700 1 -- 172.21.15.60:0/688893033 >> v1:172.21.15.135:6789/0 conn(0x7f986c13c430 legacy=0x7f986c0ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:05.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.977+0000 7f9871f9c700 1 -- 172.21.15.60:0/688893033 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c13c800 con 0x7f986c15a080 2023-10-06T04:28:05.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.977+0000 7f9871f9c700 1 --2- 172.21.15.60:0/688893033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f986c15a080 0x7f986c0c86f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f986c0c5010 tx=0x7f9864009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280e9f680fccf873 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:05.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.977+0000 7f9863fff700 1 -- 172.21.15.60:0/688893033 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986400e070 con 0x7f986c15a080 2023-10-06T04:28:05.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.977+0000 7f9863fff700 1 -- 172.21.15.60:0/688893033 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986400ba10 con 0x7f986c15a080 2023-10-06T04:28:05.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.977+0000 7f9863fff700 1 -- 172.21.15.60:0/688893033 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640092e0 con 0x7f986c15a080 2023-10-06T04:28:05.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.977+0000 7f987279d700 1 -- 172.21.15.60:0/688893033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f986c15a080 msgr2=0x7f986c0c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:05.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.977+0000 7f987279d700 1 --2- 172.21.15.60:0/688893033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f986c15a080 0x7f986c0c86f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f986c0c5010 tx=0x7f9864009840 comp rx=0 tx=0).stop 2023-10-06T04:28:05.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.978+0000 7f987279d700 1 -- 172.21.15.60:0/688893033 shutdown_connections 2023-10-06T04:28:05.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.978+0000 7f987279d700 1 --2- 172.21.15.60:0/688893033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f986c15a080 0x7f986c0c86f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:05.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.978+0000 7f987279d700 1 --2- 172.21.15.60:0/688893033 >> v2:172.21.15.135:3300/0 conn(0x7f986c0cb060 0x7f986c159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:05.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.978+0000 7f987279d700 1 -- 172.21.15.60:0/688893033 >> 172.21.15.60:0/688893033 conn(0x7f986c06b330 msgr2=0x7f986c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:05.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.978+0000 7f987279d700 1 -- 172.21.15.60:0/688893033 shutdown_connections 2023-10-06T04:28:05.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.978+0000 7f987279d700 1 -- 172.21.15.60:0/688893033 wait complete. 2023-10-06T04:28:05.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.979+0000 7f987279d700 1 Processor -- start 2023-10-06T04:28:05.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.979+0000 7f987279d700 1 -- start start 2023-10-06T04:28:05.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.980+0000 7f987279d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f986c0cb060 0x7f986c158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:05.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.980+0000 7f987279d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f986c13c430 0x7f986c13ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:05.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.980+0000 7f987279d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f986c15a080 0x7f986c13ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:05.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.980+0000 7f987279d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c13cf70 con 0x7f986c13c430 2023-10-06T04:28:05.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.980+0000 7f987279d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c1695e0 con 0x7f986c15a080 2023-10-06T04:28:05.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.980+0000 7f987279d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c13da20 con 0x7f986c0cb060 2023-10-06T04:28:05.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.980+0000 7f9870f9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f986c13c430 0x7f986c13ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:05.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.980+0000 7f9870f9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f986c13c430 0x7f986c13ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54524/0 (socket says 172.21.15.60:54524) 2023-10-06T04:28:05.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.980+0000 7f9870f9a700 1 -- 172.21.15.60:0/719427358 learned_addr learned my addr 172.21.15.60:0/719427358 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:05.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.981+0000 7f9871f9c700 1 --2- 172.21.15.60:0/719427358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f986c15a080 0x7f986c13ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:05.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.981+0000 7f987179b700 1 --2- 172.21.15.60:0/719427358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f986c0cb060 0x7f986c158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:05.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.981+0000 7f9870f9a700 1 -- 172.21.15.60:0/719427358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f986c0cb060 msgr2=0x7f986c158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:05.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.981+0000 7f9870f9a700 1 --2- 172.21.15.60:0/719427358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f986c0cb060 0x7f986c158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:05.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.981+0000 7f9870f9a700 1 -- 172.21.15.60:0/719427358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f986c15a080 msgr2=0x7f986c13ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:05.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.981+0000 7f9870f9a700 1 --2- 172.21.15.60:0/719427358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f986c15a080 0x7f986c13ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:05.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.981+0000 7f9870f9a700 1 -- 172.21.15.60:0/719427358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9864009ae0 con 0x7f986c13c430 2023-10-06T04:28:05.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.981+0000 7f987179b700 1 --2- 172.21.15.60:0/719427358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f986c0cb060 0x7f986c158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:05.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.981+0000 7f9870f9a700 1 --2- 172.21.15.60:0/719427358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f986c13c430 0x7f986c13ca30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f985c00d890 tx=0x7f985c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:05.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.981+0000 7f98617fa700 1 -- 172.21.15.60:0/719427358 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c0125f0 con 0x7f986c13c430 2023-10-06T04:28:05.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.981+0000 7f98617fa700 1 -- 172.21.15.60:0/719427358 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c012770 con 0x7f986c13c430 2023-10-06T04:28:05.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.981+0000 7f987279d700 1 -- 172.21.15.60:0/719427358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986c13d180 con 0x7f986c13c430 2023-10-06T04:28:05.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.981+0000 7f98617fa700 1 -- 172.21.15.60:0/719427358 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c012b30 con 0x7f986c13c430 2023-10-06T04:28:05.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.982+0000 7f987279d700 1 -- 172.21.15.60:0/719427358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986c13d740 con 0x7f986c13c430 2023-10-06T04:28:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.982+0000 7f987279d700 1 -- 172.21.15.60:0/719427358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f986c05f230 con 0x7f986c13c430 2023-10-06T04:28:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.983+0000 7f98617fa700 1 -- 172.21.15.60:0/719427358 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f985c01e460 con 0x7f986c13c430 2023-10-06T04:28:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.984+0000 7f98617fa700 1 --2- 172.21.15.60:0/719427358 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f9850066f30 0x7f98500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.984+0000 7f98617fa700 1 -- 172.21.15.60:0/719427358 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f985c084d60 con 0x7f986c13c430 2023-10-06T04:28:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.984+0000 7f987179b700 1 --2- 172.21.15.60:0/719427358 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f9850066f30 0x7f98500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.985+0000 7f987179b700 1 --2- 172.21.15.60:0/719427358 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f9850066f30 0x7f98500693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9868002880 tx=0x7f9868009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:05.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:05.989+0000 7f98617fa700 1 -- 172.21.15.60:0/719427358 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f985c051e30 con 0x7f986c13c430 2023-10-06T04:28:06.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.241+0000 7f987279d700 1 -- 172.21.15.60:0/719427358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f986c169720 con 0x7f986c13c430 2023-10-06T04:28:06.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.735+0000 7f98617fa700 1 -- 172.21.15.60:0/719427358 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f985c055450 con 0x7f986c13c430 2023-10-06T04:28:06.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.739+0000 7f987279d700 1 -- 172.21.15.60:0/719427358 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f9850066f30 msgr2=0x7f98500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:06.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.739+0000 7f987279d700 1 --2- 172.21.15.60:0/719427358 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f9850066f30 0x7f98500693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9868002880 tx=0x7f9868009040 comp rx=0 tx=0).stop 2023-10-06T04:28:06.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.739+0000 7f987279d700 1 -- 172.21.15.60:0/719427358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f986c13c430 msgr2=0x7f986c13ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:06.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.739+0000 7f987279d700 1 --2- 172.21.15.60:0/719427358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f986c13c430 0x7f986c13ca30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f985c00d890 tx=0x7f985c008040 comp rx=0 tx=0).stop 2023-10-06T04:28:06.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.739+0000 7f987279d700 1 -- 172.21.15.60:0/719427358 shutdown_connections 2023-10-06T04:28:06.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.739+0000 7f987279d700 1 --2- 172.21.15.60:0/719427358 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f9850066f30 0x7f98500693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:06.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.739+0000 7f987279d700 1 --2- 172.21.15.60:0/719427358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f986c15a080 0x7f986c13ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:06.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.739+0000 7f987279d700 1 --2- 172.21.15.60:0/719427358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f986c0cb060 0x7f986c158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:06.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.739+0000 7f987279d700 1 --2- 172.21.15.60:0/719427358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f986c13c430 0x7f986c13ca30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:06.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.739+0000 7f987279d700 1 -- 172.21.15.60:0/719427358 >> 172.21.15.60:0/719427358 conn(0x7f986c06b330 msgr2=0x7f986c1557a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:06.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.740+0000 7f987279d700 1 -- 172.21.15.60:0/719427358 shutdown_connections 2023-10-06T04:28:06.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.740+0000 7f987279d700 1 -- 172.21.15.60:0/719427358 wait complete. 2023-10-06T04:28:06.744 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T04:28:06.763 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-06T04:28:06.763 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-06T04:28:06.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.955+0000 7f9601d9d700 1 Processor -- start 2023-10-06T04:28:06.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.955+0000 7f9601d9d700 1 -- start start 2023-10-06T04:28:06.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.956+0000 7f9601d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f95fc0b05c0 0x7f95fc0686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:06.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.956+0000 7f9601d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95fc0cc5e0 0x7f95fc0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:06.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.956+0000 7f9601d9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95fc1599f0 con 0x7f95fc0c3580 2023-10-06T04:28:06.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.956+0000 7f9601d9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95fc0c93b0 con 0x7f95fc0b05c0 2023-10-06T04:28:06.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.956+0000 7f9601d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0c87e0 con 0x7f95fc0cc5e0 2023-10-06T04:28:06.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.957+0000 7f9600d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f95fc0b05c0 0x7f95fc0686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:06.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.957+0000 7f9600d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f95fc0b05c0 0x7f95fc0686c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54530/0 (socket says 172.21.15.60:54530) 2023-10-06T04:28:06.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.957+0000 7f9600d9b700 1 -- 172.21.15.60:0/2145411837 learned_addr learned my addr 172.21.15.60:0/2145411837 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:06.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.957+0000 7f95fbfff700 1 --2- 172.21.15.60:0/2145411837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95fc0cc5e0 0x7f95fc0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:06.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.957+0000 7f9600d9b700 1 -- 172.21.15.60:0/2145411837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95fc0cc5e0 msgr2=0x7f95fc0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:06.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.957+0000 7f9600d9b700 1 --2- 172.21.15.60:0/2145411837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95fc0cc5e0 0x7f95fc0cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:06.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.957+0000 7f9600d9b700 1 -- 172.21.15.60:0/2145411837 >> v1:172.21.15.60:6789/0 conn(0x7f95fc0c3580 legacy=0x7f95fc0c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:06.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.957+0000 7f95fb7fe700 1 -- 172.21.15.60:0/2145411837 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005722229 0 0) 0x7f95fc1599f0 con 0x7f95fc0c3580 2023-10-06T04:28:06.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.957+0000 7f9600d9b700 1 -- 172.21.15.60:0/2145411837 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc0c8a80 con 0x7f95fc0b05c0 2023-10-06T04:28:06.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.958+0000 7f9600d9b700 1 --2- 172.21.15.60:0/2145411837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95fc0b05c0 0x7f95fc0686c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009990 tx=0x7f95f0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec57228967e01ccf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:06.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.958+0000 7f95fb7fe700 1 -- 172.21.15.60:0/2145411837 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0005c10 con 0x7f95fc0b05c0 2023-10-06T04:28:06.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.958+0000 7f95fb7fe700 1 -- 172.21.15.60:0/2145411837 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f0005d70 con 0x7f95fc0b05c0 2023-10-06T04:28:06.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.958+0000 7f95fb7fe700 1 -- 172.21.15.60:0/2145411837 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f000b880 con 0x7f95fc0b05c0 2023-10-06T04:28:06.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.958+0000 7f9601d9d700 1 -- 172.21.15.60:0/2145411837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95fc0b05c0 msgr2=0x7f95fc0686c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:06.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.958+0000 7f9601d9d700 1 --2- 172.21.15.60:0/2145411837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95fc0b05c0 0x7f95fc0686c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009990 tx=0x7f95f0009220 comp rx=0 tx=0).stop 2023-10-06T04:28:06.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.958+0000 7f9601d9d700 1 -- 172.21.15.60:0/2145411837 shutdown_connections 2023-10-06T04:28:06.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.958+0000 7f9601d9d700 1 --2- 172.21.15.60:0/2145411837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95fc0b05c0 0x7f95fc0686c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:06.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.958+0000 7f9601d9d700 1 --2- 172.21.15.60:0/2145411837 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95fc0cc5e0 0x7f95fc0cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:06.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.958+0000 7f9601d9d700 1 -- 172.21.15.60:0/2145411837 >> 172.21.15.60:0/2145411837 conn(0x7f95fc097340 msgr2=0x7f95fc067d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:06.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.958+0000 7f9601d9d700 1 -- 172.21.15.60:0/2145411837 shutdown_connections 2023-10-06T04:28:06.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.958+0000 7f9601d9d700 1 -- 172.21.15.60:0/2145411837 wait complete. 2023-10-06T04:28:06.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.960+0000 7f9601d9d700 1 Processor -- start 2023-10-06T04:28:06.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.960+0000 7f9601d9d700 1 -- start start 2023-10-06T04:28:06.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.961+0000 7f9601d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95fc0b05c0 0x7f95fc1574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:06.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.961+0000 7f9601d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95fc0c3580 0x7f95fc15a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:06.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.961+0000 7f9601d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95fc0cc5e0 0x7f95fc0b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:06.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.961+0000 7f9601d9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc1579f0 con 0x7f95fc0cc5e0 2023-10-06T04:28:06.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.961+0000 7f9601d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0b1d90 con 0x7f95fc0c3580 2023-10-06T04:28:06.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.961+0000 7f9601d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0b0ea0 con 0x7f95fc0b05c0 2023-10-06T04:28:06.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.961+0000 7f960159c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95fc0cc5e0 0x7f95fc0b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.961+0000 7f960159c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95fc0cc5e0 0x7f95fc0b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54534/0 (socket says 172.21.15.60:54534) 2023-10-06T04:28:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.961+0000 7f960159c700 1 -- 172.21.15.60:0/1774277757 learned_addr learned my addr 172.21.15.60:0/1774277757 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.961+0000 7f9600d9b700 1 --2- 172.21.15.60:0/1774277757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95fc0b05c0 0x7f95fc1574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.961+0000 7f95fbfff700 1 --2- 172.21.15.60:0/1774277757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95fc0c3580 0x7f95fc15a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.962+0000 7f960159c700 1 -- 172.21.15.60:0/1774277757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95fc0b05c0 msgr2=0x7f95fc1574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.962+0000 7f960159c700 1 --2- 172.21.15.60:0/1774277757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95fc0b05c0 0x7f95fc1574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.962+0000 7f960159c700 1 -- 172.21.15.60:0/1774277757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95fc0c3580 msgr2=0x7f95fc15a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.962+0000 7f960159c700 1 --2- 172.21.15.60:0/1774277757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95fc0c3580 0x7f95fc15a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.962+0000 7f960159c700 1 -- 172.21.15.60:0/1774277757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f0009480 con 0x7f95fc0cc5e0 2023-10-06T04:28:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.962+0000 7f960159c700 1 --2- 172.21.15.60:0/1774277757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95fc0cc5e0 0x7f95fc0b2220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f95f4001560 tx=0x7f95f4001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.962+0000 7f95f8ff9700 1 -- 172.21.15.60:0/1774277757 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f4004160 con 0x7f95fc0cc5e0 2023-10-06T04:28:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.962+0000 7f95f8ff9700 1 -- 172.21.15.60:0/1774277757 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f400a7e0 con 0x7f95fc0cc5e0 2023-10-06T04:28:06.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.962+0000 7f9601d9d700 1 -- 172.21.15.60:0/1774277757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95fc0b1180 con 0x7f95fc0cc5e0 2023-10-06T04:28:06.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.962+0000 7f95f8ff9700 1 -- 172.21.15.60:0/1774277757 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f400aba0 con 0x7f95fc0cc5e0 2023-10-06T04:28:06.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.962+0000 7f9601d9d700 1 -- 172.21.15.60:0/1774277757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95fc0b1740 con 0x7f95fc0cc5e0 2023-10-06T04:28:06.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.963+0000 7f9601d9d700 1 -- 172.21.15.60:0/1774277757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95fc0b1f40 con 0x7f95fc0cc5e0 2023-10-06T04:28:06.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.964+0000 7f95f8ff9700 1 -- 172.21.15.60:0/1774277757 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f95f4012420 con 0x7f95fc0cc5e0 2023-10-06T04:28:06.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.965+0000 7f95f8ff9700 1 --2- 172.21.15.60:0/1774277757 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f95e0066f60 0x7f95e0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:06.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.965+0000 7f95f8ff9700 1 -- 172.21.15.60:0/1774277757 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f95f4084490 con 0x7f95fc0cc5e0 2023-10-06T04:28:06.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.965+0000 7f9600d9b700 1 --2- 172.21.15.60:0/1774277757 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f95e0066f60 0x7f95e0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:06.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.966+0000 7f9600d9b700 1 --2- 172.21.15.60:0/1774277757 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f95e0066f60 0x7f95e0069410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009260 tx=0x7f95f0016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:06.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:06.970+0000 7f95f8ff9700 1 -- 172.21.15.60:0/1774277757 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95fc0b1f40 con 0x7f95fc0cc5e0 2023-10-06T04:28:07.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.187+0000 7f9601d9d700 1 -- 172.21.15.60:0/1774277757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f95fc0b1f00 con 0x7f95fc0cc5e0 2023-10-06T04:28:07.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.324+0000 7f95f8ff9700 1 -- 172.21.15.60:0/1774277757 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f95f4051500 con 0x7f95fc0cc5e0 2023-10-06T04:28:07.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.326+0000 7f9601d9d700 1 -- 172.21.15.60:0/1774277757 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f95e0066f60 msgr2=0x7f95e0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:07.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.326+0000 7f9601d9d700 1 --2- 172.21.15.60:0/1774277757 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f95e0066f60 0x7f95e0069410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009260 tx=0x7f95f0016000 comp rx=0 tx=0).stop 2023-10-06T04:28:07.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.326+0000 7f9601d9d700 1 -- 172.21.15.60:0/1774277757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95fc0cc5e0 msgr2=0x7f95fc0b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:07.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.326+0000 7f9601d9d700 1 --2- 172.21.15.60:0/1774277757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95fc0cc5e0 0x7f95fc0b2220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f95f4001560 tx=0x7f95f4001770 comp rx=0 tx=0).stop 2023-10-06T04:28:07.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.326+0000 7f9601d9d700 1 -- 172.21.15.60:0/1774277757 shutdown_connections 2023-10-06T04:28:07.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.326+0000 7f9601d9d700 1 --2- 172.21.15.60:0/1774277757 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f95e0066f60 0x7f95e0069410 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:07.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.326+0000 7f9601d9d700 1 --2- 172.21.15.60:0/1774277757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95fc0cc5e0 0x7f95fc0b2220 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:07.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.326+0000 7f9601d9d700 1 --2- 172.21.15.60:0/1774277757 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95fc0b05c0 0x7f95fc1574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:07.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.326+0000 7f9601d9d700 1 --2- 172.21.15.60:0/1774277757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95fc0c3580 0x7f95fc15a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:07.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.326+0000 7f9601d9d700 1 -- 172.21.15.60:0/1774277757 >> 172.21.15.60:0/1774277757 conn(0x7f95fc097340 msgr2=0x7f95fc06c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:07.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.326+0000 7f9601d9d700 1 -- 172.21.15.60:0/1774277757 shutdown_connections 2023-10-06T04:28:07.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.326+0000 7f9601d9d700 1 -- 172.21.15.60:0/1774277757 wait complete. 2023-10-06T04:28:07.347 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T04:28:07.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.541+0000 7f5344b9d700 1 Processor -- start 2023-10-06T04:28:07.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.541+0000 7f5344b9d700 1 -- start start 2023-10-06T04:28:07.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.543+0000 7f5344b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53400cb770 0x7f5340156f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:07.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.543+0000 7f5344b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f53401564c0 0x7f534006ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:07.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.543+0000 7f5344b9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53400ad7f0 con 0x7f534006e9f0 2023-10-06T04:28:07.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.543+0000 7f5344b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5340150320 con 0x7f53401564c0 2023-10-06T04:28:07.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.543+0000 7f5344b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534006f3d0 con 0x7f53400cb770 2023-10-06T04:28:07.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.543+0000 7f533effd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f534006e9f0 0x7f5340155db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60442/0 (socket says 172.21.15.60:60442) 2023-10-06T04:28:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.543+0000 7f533effd700 1 -- 172.21.15.60:0/3832957380 learned_addr learned my addr 172.21.15.60:0/3832957380 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.543+0000 7f533ffff700 1 --2- 172.21.15.60:0/3832957380 >> v2:172.21.15.135:3300/0 conn(0x7f53401564c0 0x7f534006ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.543+0000 7f533f7fe700 1 --2- 172.21.15.60:0/3832957380 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53400cb770 0x7f5340156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.543+0000 7f533e7fc700 1 -- 172.21.15.60:0/3832957380 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2386863485 0 0) 0x7f53400ad7f0 con 0x7f534006e9f0 2023-10-06T04:28:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.543+0000 7f533e7fc700 1 -- 172.21.15.60:0/3832957380 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5328003570 con 0x7f534006e9f0 2023-10-06T04:28:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.544+0000 7f533f7fe700 1 -- 172.21.15.60:0/3832957380 >> v2:172.21.15.135:3300/0 conn(0x7f53401564c0 msgr2=0x7f534006ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.544+0000 7f533f7fe700 1 --2- 172.21.15.60:0/3832957380 >> v2:172.21.15.135:3300/0 conn(0x7f53401564c0 0x7f534006ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.544+0000 7f533f7fe700 1 -- 172.21.15.60:0/3832957380 >> v1:172.21.15.60:6789/0 conn(0x7f534006e9f0 legacy=0x7f5340155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.544+0000 7f533f7fe700 1 -- 172.21.15.60:0/3832957380 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5340156900 con 0x7f53400cb770 2023-10-06T04:28:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.544+0000 7f533ffff700 1 --2- 172.21.15.60:0/3832957380 >> v2:172.21.15.135:3300/0 conn(0x7f53401564c0 0x7f534006ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:07.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.544+0000 7f533f7fe700 1 --2- 172.21.15.60:0/3832957380 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53400cb770 0x7f5340156f80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f53300098e0 tx=0x7f53300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=359bf16dcb9fce16 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:07.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.544+0000 7f533e7fc700 1 -- 172.21.15.60:0/3832957380 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330011630 con 0x7f53400cb770 2023-10-06T04:28:07.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.544+0000 7f533e7fc700 1 -- 172.21.15.60:0/3832957380 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5330011790 con 0x7f53400cb770 2023-10-06T04:28:07.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.544+0000 7f533e7fc700 1 -- 172.21.15.60:0/3832957380 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330011b30 con 0x7f53400cb770 2023-10-06T04:28:07.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.545+0000 7f5344b9d700 1 -- 172.21.15.60:0/3832957380 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53400cb770 msgr2=0x7f5340156f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:07.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.545+0000 7f5344b9d700 1 --2- 172.21.15.60:0/3832957380 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53400cb770 0x7f5340156f80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f53300098e0 tx=0x7f53300091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:07.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.545+0000 7f5344b9d700 1 -- 172.21.15.60:0/3832957380 shutdown_connections 2023-10-06T04:28:07.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.545+0000 7f5344b9d700 1 --2- 172.21.15.60:0/3832957380 >> v2:172.21.15.135:3300/0 conn(0x7f53401564c0 0x7f534006ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:07.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.545+0000 7f5344b9d700 1 --2- 172.21.15.60:0/3832957380 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53400cb770 0x7f5340156f80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:07.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.545+0000 7f5344b9d700 1 -- 172.21.15.60:0/3832957380 >> 172.21.15.60:0/3832957380 conn(0x7f53400cbed0 msgr2=0x7f53400cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:07.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.545+0000 7f5344b9d700 1 -- 172.21.15.60:0/3832957380 shutdown_connections 2023-10-06T04:28:07.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.545+0000 7f5344b9d700 1 -- 172.21.15.60:0/3832957380 wait complete. 2023-10-06T04:28:07.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.546+0000 7f5344b9d700 1 Processor -- start 2023-10-06T04:28:07.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.547+0000 7f5344b9d700 1 -- start start 2023-10-06T04:28:07.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.547+0000 7f5344b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534006e9f0 0x7f53400ab380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:07.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.547+0000 7f5344b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53400cb770 0x7f53401577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:07.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.547+0000 7f5344b9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53401564c0 0x7f5340157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:07.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.547+0000 7f5344b9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5340159a40 con 0x7f53401564c0 2023-10-06T04:28:07.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.547+0000 7f5344b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53400ac2e0 con 0x7f534006e9f0 2023-10-06T04:28:07.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.547+0000 7f5344b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53400aba40 con 0x7f53400cb770 2023-10-06T04:28:07.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.548+0000 7f533ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53401564c0 0x7f5340157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:07.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.548+0000 7f533ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53401564c0 0x7f5340157d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54538/0 (socket says 172.21.15.60:54538) 2023-10-06T04:28:07.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.548+0000 7f533ffff700 1 -- 172.21.15.60:0/2211667280 learned_addr learned my addr 172.21.15.60:0/2211667280 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:07.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.548+0000 7f533effd700 1 --2- 172.21.15.60:0/2211667280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53400cb770 0x7f53401577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:07.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.548+0000 7f533f7fe700 1 --2- 172.21.15.60:0/2211667280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534006e9f0 0x7f53400ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:07.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.548+0000 7f533ffff700 1 -- 172.21.15.60:0/2211667280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53400cb770 msgr2=0x7f53401577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:07.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.548+0000 7f533ffff700 1 --2- 172.21.15.60:0/2211667280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53400cb770 0x7f53401577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:07.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.548+0000 7f533ffff700 1 -- 172.21.15.60:0/2211667280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534006e9f0 msgr2=0x7f53400ab380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:07.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.548+0000 7f533ffff700 1 --2- 172.21.15.60:0/2211667280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534006e9f0 0x7f53400ab380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:07.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.548+0000 7f533ffff700 1 -- 172.21.15.60:0/2211667280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533800ab30 con 0x7f53401564c0 2023-10-06T04:28:07.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.548+0000 7f533effd700 1 --2- 172.21.15.60:0/2211667280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53400cb770 0x7f53401577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:07.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.548+0000 7f533ffff700 1 --2- 172.21.15.60:0/2211667280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53401564c0 0x7f5340157d30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5338009f20 tx=0x7f533800a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:07.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.548+0000 7f53277fe700 1 -- 172.21.15.60:0/2211667280 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5338018070 con 0x7f53401564c0 2023-10-06T04:28:07.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.549+0000 7f53277fe700 1 -- 172.21.15.60:0/2211667280 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5338010040 con 0x7f53401564c0 2023-10-06T04:28:07.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.549+0000 7f53277fe700 1 -- 172.21.15.60:0/2211667280 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5338007e50 con 0x7f53401564c0 2023-10-06T04:28:07.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.549+0000 7f5344b9d700 1 -- 172.21.15.60:0/2211667280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5330009420 con 0x7f53401564c0 2023-10-06T04:28:07.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.549+0000 7f5344b9d700 1 -- 172.21.15.60:0/2211667280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53400ac000 con 0x7f53401564c0 2023-10-06T04:28:07.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.550+0000 7f5344b9d700 1 -- 172.21.15.60:0/2211667280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5340159810 con 0x7f53401564c0 2023-10-06T04:28:07.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.550+0000 7f53277fe700 1 -- 172.21.15.60:0/2211667280 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5338003020 con 0x7f53401564c0 2023-10-06T04:28:07.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.551+0000 7f53277fe700 1 --2- 172.21.15.60:0/2211667280 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f532c066f30 0x7f532c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:07.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.551+0000 7f53277fe700 1 -- 172.21.15.60:0/2211667280 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6284+0+0 (secure 0 0 0) 0x7f5338084ba0 con 0x7f53401564c0 2023-10-06T04:28:07.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.552+0000 7f533f7fe700 1 --2- 172.21.15.60:0/2211667280 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f532c066f30 0x7f532c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:07.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.552+0000 7f533f7fe700 1 --2- 172.21.15.60:0/2211667280 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f532c066f30 0x7f532c0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f53300091e0 tx=0x7f5330017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:07.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.556+0000 7f53277fe700 1 -- 172.21.15.60:0/2211667280 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5340159810 con 0x7f53401564c0 2023-10-06T04:28:07.764 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:07.763+0000 7f5344b9d700 1 -- 172.21.15.60:0/2211667280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5340159810 con 0x7f53401564c0 2023-10-06T04:28:08.579 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:28:08.584 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:28:09.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.761+0000 7f53277fe700 1 -- 172.21.15.60:0/2211667280 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f5340159810 con 0x7f53401564c0 2023-10-06T04:28:09.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.771+0000 7f5344b9d700 1 -- 172.21.15.60:0/2211667280 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f532c066f30 msgr2=0x7f532c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:09.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.771+0000 7f5344b9d700 1 --2- 172.21.15.60:0/2211667280 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f532c066f30 0x7f532c0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f53300091e0 tx=0x7f5330017000 comp rx=0 tx=0).stop 2023-10-06T04:28:09.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.771+0000 7f5344b9d700 1 -- 172.21.15.60:0/2211667280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53401564c0 msgr2=0x7f5340157d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:09.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.771+0000 7f5344b9d700 1 --2- 172.21.15.60:0/2211667280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53401564c0 0x7f5340157d30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5338009f20 tx=0x7f533800a890 comp rx=0 tx=0).stop 2023-10-06T04:28:09.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.772+0000 7f5344b9d700 1 -- 172.21.15.60:0/2211667280 shutdown_connections 2023-10-06T04:28:09.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.772+0000 7f5344b9d700 1 --2- 172.21.15.60:0/2211667280 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f532c066f30 0x7f532c0693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:09.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.772+0000 7f5344b9d700 1 --2- 172.21.15.60:0/2211667280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53401564c0 0x7f5340157d30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:09.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.772+0000 7f5344b9d700 1 --2- 172.21.15.60:0/2211667280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534006e9f0 0x7f53400ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:09.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.772+0000 7f5344b9d700 1 --2- 172.21.15.60:0/2211667280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53400cb770 0x7f53401577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:09.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.772+0000 7f5344b9d700 1 -- 172.21.15.60:0/2211667280 >> 172.21.15.60:0/2211667280 conn(0x7f53400cbed0 msgr2=0x7f534014f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:09.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.772+0000 7f5344b9d700 1 -- 172.21.15.60:0/2211667280 shutdown_connections 2023-10-06T04:28:09.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.774+0000 7f5344b9d700 1 -- 172.21.15.60:0/2211667280 wait complete. 2023-10-06T04:28:09.778 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data_ec' created 2023-10-06T04:28:09.797 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-06T04:28:09.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.991+0000 7f3298b9d700 1 Processor -- start 2023-10-06T04:28:09.993 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.991+0000 7f3298b9d700 1 -- start start 2023-10-06T04:28:09.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.992+0000 7f3298b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f329406aad0 0x7f329406e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:09.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.992+0000 7f3298b9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32940c2460 con 0x7f329413f760 2023-10-06T04:28:09.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.993+0000 7f3298b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329406ee20 con 0x7f329413fb30 2023-10-06T04:28:09.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.993+0000 7f3298b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329406f100 con 0x7f329406aad0 2023-10-06T04:28:09.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.993+0000 7f32937fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f329413f760 0x7f329406a3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60448/0 (socket says 172.21.15.60:60448) 2023-10-06T04:28:09.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.993+0000 7f32937fe700 1 -- 172.21.15.60:0/818831142 learned_addr learned my addr 172.21.15.60:0/818831142 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:09.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.993+0000 7f3292ffd700 1 --2- 172.21.15.60:0/818831142 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f329406aad0 0x7f329406e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:09.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.993+0000 7f32927fc700 1 -- 172.21.15.60:0/818831142 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3839975488 0 0) 0x7f32940c2460 con 0x7f329413f760 2023-10-06T04:28:09.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.993+0000 7f32927fc700 1 -- 172.21.15.60:0/818831142 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f327c003570 con 0x7f329413f760 2023-10-06T04:28:09.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.993+0000 7f32927fc700 1 -- 172.21.15.60:0/818831142 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4288050312 0 0) 0x7f327c003570 con 0x7f329413f760 2023-10-06T04:28:09.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.993+0000 7f32927fc700 1 -- 172.21.15.60:0/818831142 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f329406aad0 msgr2=0x7f329406e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:09.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.994+0000 7f32927fc700 1 --2- 172.21.15.60:0/818831142 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f329406aad0 0x7f329406e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:09.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.994+0000 7f32927fc700 1 -- 172.21.15.60:0/818831142 >> v1:172.21.15.135:6789/0 conn(0x7f329413fb30 legacy=0x7f329406e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:09.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.994+0000 7f32927fc700 1 -- 172.21.15.60:0/818831142 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329406f3e0 con 0x7f329413f760 2023-10-06T04:28:09.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.994+0000 7f32927fc700 1 -- 172.21.15.60:0/818831142 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7f3284001470 con 0x7f329413f760 2023-10-06T04:28:09.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.994+0000 7f3292ffd700 1 --2- 172.21.15.60:0/818831142 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f329406aad0 0x7f329406e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:09.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.994+0000 7f32927fc700 1 -- 172.21.15.60:0/818831142 >> v1:172.21.15.60:6789/0 conn(0x7f329413f760 legacy=0x7f329406a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:09.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.994+0000 7f32927fc700 1 --2- 172.21.15.60:0/818831142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f327c003a90 0x7f327c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:09.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.994+0000 7f32927fc700 1 --2- 172.21.15.60:0/818831142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f327c004810 0x7f327c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:09.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.994+0000 7f32927fc700 1 --2- 172.21.15.60:0/818831142 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f329406aad0 0x7f327c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:09.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.994+0000 7f32927fc700 1 -- 172.21.15.60:0/818831142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329406f100 con 0x7f327c004810 2023-10-06T04:28:09.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.994+0000 7f32927fc700 1 -- 172.21.15.60:0/818831142 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c00bb10 con 0x7f327c003a90 2023-10-06T04:28:09.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.994+0000 7f32927fc700 1 -- 172.21.15.60:0/818831142 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327c00bc80 con 0x7f329406aad0 2023-10-06T04:28:09.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.994+0000 7f3292ffd700 1 --2- 172.21.15.60:0/818831142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f327c004810 0x7f327c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:09.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.994+0000 7f32937fe700 1 --2- 172.21.15.60:0/818831142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f327c003a90 0x7f327c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:09.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.994+0000 7f3293fff700 1 --2- 172.21.15.60:0/818831142 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f329406aad0 0x7f327c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:09.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.994+0000 7f3292ffd700 1 -- 172.21.15.60:0/818831142 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f329406aad0 msgr2=0x7f327c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:09.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.994+0000 7f3292ffd700 1 --2- 172.21.15.60:0/818831142 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f329406aad0 0x7f327c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:09.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.994+0000 7f3292ffd700 1 -- 172.21.15.60:0/818831142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f327c003a90 msgr2=0x7f327c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:09.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.994+0000 7f3292ffd700 1 --2- 172.21.15.60:0/818831142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f327c003a90 0x7f327c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:09.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.994+0000 7f3292ffd700 1 -- 172.21.15.60:0/818831142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3288009420 con 0x7f327c004810 2023-10-06T04:28:09.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.995+0000 7f3292ffd700 1 --2- 172.21.15.60:0/818831142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f327c004810 0x7f327c004c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3288009df0 tx=0x7f32880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf637076554e8af9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:09.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.995+0000 7f32927fc700 1 -- 172.21.15.60:0/818831142 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3288009740 con 0x7f327c004810 2023-10-06T04:28:09.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.995+0000 7f32927fc700 1 -- 172.21.15.60:0/818831142 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328800e8c0 con 0x7f327c004810 2023-10-06T04:28:09.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.995+0000 7f32927fc700 1 -- 172.21.15.60:0/818831142 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328800ec60 con 0x7f327c004810 2023-10-06T04:28:10.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.995+0000 7f3298b9d700 1 -- 172.21.15.60:0/818831142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f327c004810 msgr2=0x7f327c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:10.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.995+0000 7f3298b9d700 1 --2- 172.21.15.60:0/818831142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f327c004810 0x7f327c004c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3288009df0 tx=0x7f32880091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:10.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.995+0000 7f3293fff700 1 -- 172.21.15.60:0/818831142 reap_dead start 2023-10-06T04:28:10.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.995+0000 7f3298b9d700 1 -- 172.21.15.60:0/818831142 shutdown_connections 2023-10-06T04:28:10.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.995+0000 7f3298b9d700 1 -- 172.21.15.60:0/818831142 >> 172.21.15.60:0/818831142 conn(0x7f3294068080 msgr2=0x7f32940cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:10.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.995+0000 7f3298b9d700 1 -- 172.21.15.60:0/818831142 shutdown_connections 2023-10-06T04:28:10.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.995+0000 7f3298b9d700 1 -- 172.21.15.60:0/818831142 wait complete. 2023-10-06T04:28:10.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.997+0000 7f3298b9d700 1 Processor -- start 2023-10-06T04:28:10.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.997+0000 7f3298b9d700 1 -- start start 2023-10-06T04:28:10.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.998+0000 7f3298b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3294165820 0x7f32940b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:10.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.998+0000 7f3298b9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32940aec50 0x7f3294165bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:10.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.998+0000 7f3298b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3294166130 0x7f32940ac830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:10.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.998+0000 7f3298b9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32940b1170 con 0x7f32940aec50 2023-10-06T04:28:10.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.998+0000 7f3298b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32940b01d0 con 0x7f3294166130 2023-10-06T04:28:10.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.998+0000 7f3298b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32940af130 con 0x7f3294165820 2023-10-06T04:28:10.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.998+0000 7f3292ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32940aec50 0x7f3294165bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:10.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.998+0000 7f3292ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32940aec50 0x7f3294165bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54568/0 (socket says 172.21.15.60:54568) 2023-10-06T04:28:10.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.998+0000 7f3292ffd700 1 -- 172.21.15.60:0/502056401 learned_addr learned my addr 172.21.15.60:0/502056401 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:10.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.998+0000 7f32937fe700 1 --2- 172.21.15.60:0/502056401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3294165820 0x7f32940b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:10.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.998+0000 7f3293fff700 1 --2- 172.21.15.60:0/502056401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3294166130 0x7f32940ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:10.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.999+0000 7f32937fe700 1 -- 172.21.15.60:0/502056401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3294166130 msgr2=0x7f32940ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:10.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.999+0000 7f32937fe700 1 --2- 172.21.15.60:0/502056401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3294166130 0x7f32940ac830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:10.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.999+0000 7f32937fe700 1 -- 172.21.15.60:0/502056401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32940aec50 msgr2=0x7f3294165bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:10.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.999+0000 7f32937fe700 1 --2- 172.21.15.60:0/502056401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32940aec50 0x7f3294165bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:10.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.999+0000 7f32937fe700 1 -- 172.21.15.60:0/502056401 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32940af410 con 0x7f3294165820 2023-10-06T04:28:10.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.999+0000 7f3292ffd700 1 --2- 172.21.15.60:0/502056401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32940aec50 0x7f3294165bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:10.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.999+0000 7f32937fe700 1 --2- 172.21.15.60:0/502056401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3294165820 0x7f32940b1690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f32840073c0 tx=0x7f3284001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:10.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.999+0000 7f327b7fe700 1 -- 172.21.15.60:0/502056401 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3284018030 con 0x7f3294165820 2023-10-06T04:28:10.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.999+0000 7f327b7fe700 1 -- 172.21.15.60:0/502056401 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328400f660 con 0x7f3294165820 2023-10-06T04:28:10.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.999+0000 7f327b7fe700 1 -- 172.21.15.60:0/502056401 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328400fa40 con 0x7f3294165820 2023-10-06T04:28:10.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.999+0000 7f3298b9d700 1 -- 172.21.15.60:0/502056401 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32940af6f0 con 0x7f3294165820 2023-10-06T04:28:10.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:09.999+0000 7f3298b9d700 1 -- 172.21.15.60:0/502056401 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32940afcb0 con 0x7f3294165820 2023-10-06T04:28:10.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.000+0000 7f3298b9d700 1 -- 172.21.15.60:0/502056401 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32940afea0 con 0x7f3294165820 2023-10-06T04:28:10.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.001+0000 7f327b7fe700 1 -- 172.21.15.60:0/502056401 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f328401b070 con 0x7f3294165820 2023-10-06T04:28:10.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.002+0000 7f327b7fe700 1 --2- 172.21.15.60:0/502056401 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3280066f30 0x7f32800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:10.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.002+0000 7f327b7fe700 1 -- 172.21.15.60:0/502056401 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f3284019070 con 0x7f3294165820 2023-10-06T04:28:10.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.002+0000 7f3292ffd700 1 --2- 172.21.15.60:0/502056401 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3280066f30 0x7f32800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:10.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.003+0000 7f3292ffd700 1 --2- 172.21.15.60:0/502056401 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3280066f30 0x7f32800693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f32880091e0 tx=0x7f328801a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:10.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.008+0000 7f327b7fe700 1 -- 172.21.15.60:0/502056401 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3284051500 con 0x7f3294165820 2023-10-06T04:28:10.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.208+0000 7f3298b9d700 1 -- 172.21.15.60:0/502056401 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f329405f230 con 0x7f3294165820 2023-10-06T04:28:10.365 INFO:tasks.ceph.mds.c.smithi060.stderr:2023-10-06T04:28:10.363+0000 7fbec93f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:28:10.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.768+0000 7f327b7fe700 1 -- 172.21.15.60:0/502056401 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3284054b20 con 0x7f3294165820 2023-10-06T04:28:10.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.777+0000 7f3298b9d700 1 -- 172.21.15.60:0/502056401 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3280066f30 msgr2=0x7f32800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:10.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.777+0000 7f3298b9d700 1 --2- 172.21.15.60:0/502056401 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3280066f30 0x7f32800693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f32880091e0 tx=0x7f328801a000 comp rx=0 tx=0).stop 2023-10-06T04:28:10.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.777+0000 7f3298b9d700 1 -- 172.21.15.60:0/502056401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3294165820 msgr2=0x7f32940b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:10.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.777+0000 7f3298b9d700 1 --2- 172.21.15.60:0/502056401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3294165820 0x7f32940b1690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f32840073c0 tx=0x7f3284001e70 comp rx=0 tx=0).stop 2023-10-06T04:28:10.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.782+0000 7f3298b9d700 1 -- 172.21.15.60:0/502056401 shutdown_connections 2023-10-06T04:28:10.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.782+0000 7f3298b9d700 1 --2- 172.21.15.60:0/502056401 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3280066f30 0x7f32800693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:10.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.782+0000 7f3298b9d700 1 --2- 172.21.15.60:0/502056401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3294166130 0x7f32940ac830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:10.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.782+0000 7f3298b9d700 1 --2- 172.21.15.60:0/502056401 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3294165820 0x7f32940b1690 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:10.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.782+0000 7f3298b9d700 1 --2- 172.21.15.60:0/502056401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32940aec50 0x7f3294165bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:10.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.782+0000 7f3298b9d700 1 -- 172.21.15.60:0/502056401 >> 172.21.15.60:0/502056401 conn(0x7f3294068080 msgr2=0x7f3294155a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:10.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.783+0000 7f3298b9d700 1 -- 172.21.15.60:0/502056401 shutdown_connections 2023-10-06T04:28:10.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:10.784+0000 7f3298b9d700 1 -- 172.21.15.60:0/502056401 wait complete. 2023-10-06T04:28:10.837 INFO:teuthology.orchestra.run.smithi060.stderr:set pool 5 allow_ec_overwrites to true 2023-10-06T04:28:10.837 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-06T04:28:11.025 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.024+0000 7f64d699d700 1 Processor -- start 2023-10-06T04:28:11.026 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.024+0000 7f64d699d700 1 -- start start 2023-10-06T04:28:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.025+0000 7f64d699d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f64d00b2620 0x7f64d00cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.025+0000 7f64d699d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d00b29f0 0x7f64d00cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.025+0000 7f64d699d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f64d00ceaa0 0x7f64d00cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.025+0000 7f64d699d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d00cc970 con 0x7f64d00b2620 2023-10-06T04:28:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.025+0000 7f64d699d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d00cf480 con 0x7f64d00ceaa0 2023-10-06T04:28:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.025+0000 7f64d699d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00cbd60 con 0x7f64d00b29f0 2023-10-06T04:28:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.026+0000 7f64d599b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f64d00b2620 0x7f64d00cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.026+0000 7f64d599b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f64d00b2620 0x7f64d00cccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54574/0 (socket says 172.21.15.60:54574) 2023-10-06T04:28:11.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.026+0000 7f64d599b700 1 -- 172.21.15.60:0/2476519404 learned_addr learned my addr 172.21.15.60:0/2476519404 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:11.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.026+0000 7f64d599b700 1 -- 172.21.15.60:0/2476519404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d00b29f0 msgr2=0x7f64d00cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:11.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.026+0000 7f64d619c700 1 --2- 172.21.15.60:0/2476519404 >> v2:172.21.15.135:3300/0 conn(0x7f64d00ceaa0 0x7f64d00cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:11.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.026+0000 7f64d519a700 1 --2- 172.21.15.60:0/2476519404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d00b29f0 0x7f64d00cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:11.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.026+0000 7f64d599b700 1 --2- 172.21.15.60:0/2476519404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d00b29f0 0x7f64d00cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:11.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.026+0000 7f64d599b700 1 -- 172.21.15.60:0/2476519404 >> v2:172.21.15.135:3300/0 conn(0x7f64d00ceaa0 msgr2=0x7f64d00cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:11.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.026+0000 7f64d599b700 1 --2- 172.21.15.60:0/2476519404 >> v2:172.21.15.135:3300/0 conn(0x7f64d00ceaa0 0x7f64d00cef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:11.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.026+0000 7f64d599b700 1 -- 172.21.15.60:0/2476519404 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d00cc040 con 0x7f64d00b2620 2023-10-06T04:28:11.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.026+0000 7f64d619c700 1 --2- 172.21.15.60:0/2476519404 >> v2:172.21.15.135:3300/0 conn(0x7f64d00ceaa0 0x7f64d00cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:11.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.026+0000 7f64d519a700 1 --2- 172.21.15.60:0/2476519404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d00b29f0 0x7f64d00cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:11.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.026+0000 7f64d599b700 1 --2- 172.21.15.60:0/2476519404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d00b2620 0x7f64d00cccb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f64d0089650 tx=0x7f64cc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb79739e7748e885 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:11.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.027+0000 7f64d4999700 1 -- 172.21.15.60:0/2476519404 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc005c10 con 0x7f64d00b2620 2023-10-06T04:28:11.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.027+0000 7f64d4999700 1 -- 172.21.15.60:0/2476519404 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64cc005d70 con 0x7f64d00b2620 2023-10-06T04:28:11.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.027+0000 7f64d4999700 1 -- 172.21.15.60:0/2476519404 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc00b880 con 0x7f64d00b2620 2023-10-06T04:28:11.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.027+0000 7f64d699d700 1 -- 172.21.15.60:0/2476519404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d00b2620 msgr2=0x7f64d00cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:11.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.027+0000 7f64d699d700 1 --2- 172.21.15.60:0/2476519404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d00b2620 0x7f64d00cccb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f64d0089650 tx=0x7f64cc009220 comp rx=0 tx=0).stop 2023-10-06T04:28:11.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.027+0000 7f64d699d700 1 -- 172.21.15.60:0/2476519404 shutdown_connections 2023-10-06T04:28:11.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.027+0000 7f64d699d700 1 --2- 172.21.15.60:0/2476519404 >> v2:172.21.15.135:3300/0 conn(0x7f64d00ceaa0 0x7f64d00cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:11.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.027+0000 7f64d699d700 1 --2- 172.21.15.60:0/2476519404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d00b2620 0x7f64d00cccb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:11.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.027+0000 7f64d699d700 1 --2- 172.21.15.60:0/2476519404 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d00b29f0 0x7f64d00cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:11.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.027+0000 7f64d699d700 1 -- 172.21.15.60:0/2476519404 >> 172.21.15.60:0/2476519404 conn(0x7f64d0099520 msgr2=0x7f64d006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:11.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.027+0000 7f64d699d700 1 -- 172.21.15.60:0/2476519404 shutdown_connections 2023-10-06T04:28:11.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.027+0000 7f64d699d700 1 -- 172.21.15.60:0/2476519404 wait complete. 2023-10-06T04:28:11.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.029+0000 7f64d699d700 1 Processor -- start 2023-10-06T04:28:11.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.029+0000 7f64d699d700 1 -- start start 2023-10-06T04:28:11.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.030+0000 7f64d699d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d00b2620 0x7f64d00b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:11.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.030+0000 7f64d699d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64d00b29f0 0x7f64d00c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:11.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.030+0000 7f64d699d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d00ceaa0 0x7f64d00c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:11.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.030+0000 7f64d699d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00b5f80 con 0x7f64d00ceaa0 2023-10-06T04:28:11.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.030+0000 7f64d699d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d01561e0 con 0x7f64d00b29f0 2023-10-06T04:28:11.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.030+0000 7f64d699d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00c7bd0 con 0x7f64d00b2620 2023-10-06T04:28:11.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.030+0000 7f64d619c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d00ceaa0 0x7f64d00c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:11.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.030+0000 7f64d619c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d00ceaa0 0x7f64d00c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54586/0 (socket says 172.21.15.60:54586) 2023-10-06T04:28:11.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.030+0000 7f64d619c700 1 -- 172.21.15.60:0/3442839664 learned_addr learned my addr 172.21.15.60:0/3442839664 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:11.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.030+0000 7f64d519a700 1 --2- 172.21.15.60:0/3442839664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64d00b29f0 0x7f64d00c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:11.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.030+0000 7f64d599b700 1 --2- 172.21.15.60:0/3442839664 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d00b2620 0x7f64d00b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:11.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.030+0000 7f64d619c700 1 -- 172.21.15.60:0/3442839664 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d00b2620 msgr2=0x7f64d00b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:11.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.030+0000 7f64d619c700 1 --2- 172.21.15.60:0/3442839664 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d00b2620 0x7f64d00b5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:11.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.030+0000 7f64d619c700 1 -- 172.21.15.60:0/3442839664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64d00b29f0 msgr2=0x7f64d00c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:11.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.030+0000 7f64d619c700 1 --2- 172.21.15.60:0/3442839664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64d00b29f0 0x7f64d00c7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:11.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.031+0000 7f64d619c700 1 -- 172.21.15.60:0/3442839664 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc009480 con 0x7f64d00ceaa0 2023-10-06T04:28:11.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.031+0000 7f64d619c700 1 --2- 172.21.15.60:0/3442839664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d00ceaa0 0x7f64d00c9180 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f64c800a380 tx=0x7f64c8007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:11.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.031+0000 7f64c5ffb700 1 -- 172.21.15.60:0/3442839664 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8015440 con 0x7f64d00ceaa0 2023-10-06T04:28:11.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.031+0000 7f64c5ffb700 1 -- 172.21.15.60:0/3442839664 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c80155a0 con 0x7f64d00ceaa0 2023-10-06T04:28:11.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.031+0000 7f64c5ffb700 1 -- 172.21.15.60:0/3442839664 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8015960 con 0x7f64d00ceaa0 2023-10-06T04:28:11.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.031+0000 7f64d699d700 1 -- 172.21.15.60:0/3442839664 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d01558b0 con 0x7f64d00ceaa0 2023-10-06T04:28:11.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.031+0000 7f64d699d700 1 -- 172.21.15.60:0/3442839664 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d0155e70 con 0x7f64d00ceaa0 2023-10-06T04:28:11.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.032+0000 7f64d699d700 1 -- 172.21.15.60:0/3442839664 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d005f230 con 0x7f64d00ceaa0 2023-10-06T04:28:11.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.033+0000 7f64c5ffb700 1 -- 172.21.15.60:0/3442839664 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64c800d440 con 0x7f64d00ceaa0 2023-10-06T04:28:11.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.034+0000 7f64c5ffb700 1 --2- 172.21.15.60:0/3442839664 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f64b4066f30 0x7f64b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:11.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.034+0000 7f64c5ffb700 1 -- 172.21.15.60:0/3442839664 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f64c80854c0 con 0x7f64d00ceaa0 2023-10-06T04:28:11.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.034+0000 7f64d599b700 1 --2- 172.21.15.60:0/3442839664 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f64b4066f30 0x7f64b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:11.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.035+0000 7f64d599b700 1 --2- 172.21.15.60:0/3442839664 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f64b4066f30 0x7f64b40693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009260 tx=0x7f64cc016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:11.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.039+0000 7f64c5ffb700 1 -- 172.21.15.60:0/3442839664 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64c8052260 con 0x7f64d00ceaa0 2023-10-06T04:28:11.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.289+0000 7f64d699d700 1 -- 172.21.15.60:0/3442839664 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f64d00cc320 con 0x7f64d00ceaa0 2023-10-06T04:28:11.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.771+0000 7f64c5ffb700 1 -- 172.21.15.60:0/3442839664 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f64c8055880 con 0x7f64d00ceaa0 2023-10-06T04:28:11.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.774+0000 7f64d699d700 1 -- 172.21.15.60:0/3442839664 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f64b4066f30 msgr2=0x7f64b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:11.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.774+0000 7f64d699d700 1 --2- 172.21.15.60:0/3442839664 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f64b4066f30 0x7f64b40693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009260 tx=0x7f64cc016000 comp rx=0 tx=0).stop 2023-10-06T04:28:11.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.774+0000 7f64d699d700 1 -- 172.21.15.60:0/3442839664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d00ceaa0 msgr2=0x7f64d00c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:11.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.774+0000 7f64d699d700 1 --2- 172.21.15.60:0/3442839664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d00ceaa0 0x7f64d00c9180 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f64c800a380 tx=0x7f64c8007900 comp rx=0 tx=0).stop 2023-10-06T04:28:11.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.774+0000 7f64d699d700 1 -- 172.21.15.60:0/3442839664 shutdown_connections 2023-10-06T04:28:11.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.774+0000 7f64d699d700 1 --2- 172.21.15.60:0/3442839664 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f64b4066f30 0x7f64b40693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:11.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.774+0000 7f64d699d700 1 --2- 172.21.15.60:0/3442839664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d00ceaa0 0x7f64d00c9180 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:11.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.774+0000 7f64d699d700 1 --2- 172.21.15.60:0/3442839664 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64d00b2620 0x7f64d00b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:11.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.774+0000 7f64d699d700 1 --2- 172.21.15.60:0/3442839664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64d00b29f0 0x7f64d00c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:11.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.774+0000 7f64d699d700 1 -- 172.21.15.60:0/3442839664 >> 172.21.15.60:0/3442839664 conn(0x7f64d0099520 msgr2=0x7f64d0068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:11.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.774+0000 7f64d699d700 1 -- 172.21.15.60:0/3442839664 shutdown_connections 2023-10-06T04:28:11.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.774+0000 7f64d699d700 1 -- 172.21.15.60:0/3442839664 wait complete. 2023-10-06T04:28:11.777 INFO:teuthology.orchestra.run.smithi060.stderr:added data pool 5 to fsmap 2023-10-06T04:28:11.795 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:28:11.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.982+0000 7f98b6b9d700 1 Processor -- start 2023-10-06T04:28:11.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.982+0000 7f98b6b9d700 1 -- start start 2023-10-06T04:28:11.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.983+0000 7f98b6b9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f98b0161610 0x7f98b00c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:11.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.983+0000 7f98b6b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b01619e0 0x7f98b0161e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:11.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.983+0000 7f98b6b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b00caed0 con 0x7f98b00c6500 2023-10-06T04:28:11.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.983+0000 7f98b6b9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b00ca2c0 con 0x7f98b0161610 2023-10-06T04:28:11.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.984+0000 7f98b6b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b00ca5a0 con 0x7f98b01619e0 2023-10-06T04:28:11.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.984+0000 7f98b5b9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f98b0161610 0x7f98b00c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:11.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.984+0000 7f98b5b9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f98b0161610 0x7f98b00c9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54598/0 (socket says 172.21.15.60:54598) 2023-10-06T04:28:11.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.984+0000 7f98b5b9b700 1 -- 172.21.15.60:0/385432150 learned_addr learned my addr 172.21.15.60:0/385432150 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:11.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.984+0000 7f98b539a700 1 --2- 172.21.15.60:0/385432150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b01619e0 0x7f98b0161e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:11.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.984+0000 7f98b5b9b700 1 -- 172.21.15.60:0/385432150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b01619e0 msgr2=0x7f98b0161e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:11.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.984+0000 7f98b5b9b700 1 --2- 172.21.15.60:0/385432150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b01619e0 0x7f98b0161e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:11.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.984+0000 7f98b5b9b700 1 -- 172.21.15.60:0/385432150 >> v1:172.21.15.135:6789/0 conn(0x7f98b00c6500 legacy=0x7f98b015ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:11.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.984+0000 7f98b5b9b700 1 -- 172.21.15.60:0/385432150 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b00ca880 con 0x7f98b0161610 2023-10-06T04:28:11.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.984+0000 7f98b539a700 1 --2- 172.21.15.60:0/385432150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b01619e0 0x7f98b0161e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:11.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.985+0000 7f98b5b9b700 1 --2- 172.21.15.60:0/385432150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b0161610 0x7f98b00c9a90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0099b0 tx=0x7f98ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f68c1fd8f8e23d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:11.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.985+0000 7f98b4b99700 1 -- 172.21.15.60:0/385432150 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac00b820 con 0x7f98b0161610 2023-10-06T04:28:11.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.985+0000 7f98b4b99700 1 -- 172.21.15.60:0/385432150 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac00b980 con 0x7f98b0161610 2023-10-06T04:28:11.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.985+0000 7f98b4b99700 1 -- 172.21.15.60:0/385432150 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac00bd20 con 0x7f98b0161610 2023-10-06T04:28:11.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.985+0000 7f98b6b9d700 1 -- 172.21.15.60:0/385432150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b0161610 msgr2=0x7f98b00c9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:11.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.985+0000 7f98b6b9d700 1 --2- 172.21.15.60:0/385432150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b0161610 0x7f98b00c9a90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0099b0 tx=0x7f98ac009250 comp rx=0 tx=0).stop 2023-10-06T04:28:11.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.985+0000 7f98b6b9d700 1 -- 172.21.15.60:0/385432150 shutdown_connections 2023-10-06T04:28:11.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.985+0000 7f98b6b9d700 1 --2- 172.21.15.60:0/385432150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b0161610 0x7f98b00c9a90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:11.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.985+0000 7f98b6b9d700 1 --2- 172.21.15.60:0/385432150 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b01619e0 0x7f98b0161e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:11.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.985+0000 7f98b6b9d700 1 -- 172.21.15.60:0/385432150 >> 172.21.15.60:0/385432150 conn(0x7f98b0068080 msgr2=0x7f98b00cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:11.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.985+0000 7f98b6b9d700 1 -- 172.21.15.60:0/385432150 shutdown_connections 2023-10-06T04:28:11.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.986+0000 7f98b6b9d700 1 -- 172.21.15.60:0/385432150 wait complete. 2023-10-06T04:28:11.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.987+0000 7f98b6b9d700 1 Processor -- start 2023-10-06T04:28:11.989 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.987+0000 7f98b6b9d700 1 -- start start 2023-10-06T04:28:11.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.988+0000 7f98b6b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b00c6500 0x7f98b00aaca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:11.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.988+0000 7f98b6b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98b0161610 0x7f98b00c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:11.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.988+0000 7f98b6b9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b01619e0 0x7f98b0171430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:11.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.988+0000 7f98b6b9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b016ef40 con 0x7f98b01619e0 2023-10-06T04:28:11.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.988+0000 7f98b6b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b00c43d0 con 0x7f98b0161610 2023-10-06T04:28:11.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.988+0000 7f98b6b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b00c46b0 con 0x7f98b00c6500 2023-10-06T04:28:11.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.988+0000 7f98b639c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b01619e0 0x7f98b0171430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:11.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.988+0000 7f98b639c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b01619e0 0x7f98b0171430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54606/0 (socket says 172.21.15.60:54606) 2023-10-06T04:28:11.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.988+0000 7f98b639c700 1 -- 172.21.15.60:0/939868661 learned_addr learned my addr 172.21.15.60:0/939868661 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:11.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.988+0000 7f98b539a700 1 --2- 172.21.15.60:0/939868661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98b0161610 0x7f98b00c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:11.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.988+0000 7f98b5b9b700 1 --2- 172.21.15.60:0/939868661 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b00c6500 0x7f98b00aaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:11.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.989+0000 7f98b639c700 1 -- 172.21.15.60:0/939868661 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b00c6500 msgr2=0x7f98b00aaca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:11.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.989+0000 7f98b639c700 1 --2- 172.21.15.60:0/939868661 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b00c6500 0x7f98b00aaca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:11.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.989+0000 7f98b639c700 1 -- 172.21.15.60:0/939868661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98b0161610 msgr2=0x7f98b00c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:11.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.989+0000 7f98b639c700 1 --2- 172.21.15.60:0/939868661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98b0161610 0x7f98b00c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:11.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.989+0000 7f98b639c700 1 -- 172.21.15.60:0/939868661 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac0094f0 con 0x7f98b01619e0 2023-10-06T04:28:11.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.989+0000 7f98b639c700 1 --2- 172.21.15.60:0/939868661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b01619e0 0x7f98b0171430 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f98a800bc30 tx=0x7f98a8009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:11.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.989+0000 7f98a5ffb700 1 -- 172.21.15.60:0/939868661 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a800c9b0 con 0x7f98b01619e0 2023-10-06T04:28:11.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.989+0000 7f98a5ffb700 1 -- 172.21.15.60:0/939868661 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a800cb50 con 0x7f98b01619e0 2023-10-06T04:28:11.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.989+0000 7f98b6b9d700 1 -- 172.21.15.60:0/939868661 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b00c4990 con 0x7f98b01619e0 2023-10-06T04:28:11.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.989+0000 7f98a5ffb700 1 -- 172.21.15.60:0/939868661 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a8014410 con 0x7f98b01619e0 2023-10-06T04:28:11.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.989+0000 7f98b6b9d700 1 -- 172.21.15.60:0/939868661 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b00ab1e0 con 0x7f98b01619e0 2023-10-06T04:28:11.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.990+0000 7f98b6b9d700 1 -- 172.21.15.60:0/939868661 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b005f230 con 0x7f98b01619e0 2023-10-06T04:28:11.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.991+0000 7f98a5ffb700 1 -- 172.21.15.60:0/939868661 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98a8014800 con 0x7f98b01619e0 2023-10-06T04:28:11.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.992+0000 7f98a5ffb700 1 --2- 172.21.15.60:0/939868661 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f9894066f30 0x7f98940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:11.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.992+0000 7f98a5ffb700 1 -- 172.21.15.60:0/939868661 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f98a8084b10 con 0x7f98b01619e0 2023-10-06T04:28:11.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.992+0000 7f98b5b9b700 1 --2- 172.21.15.60:0/939868661 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f9894066f30 0x7f98940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:11.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.993+0000 7f98b5b9b700 1 --2- 172.21.15.60:0/939868661 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f9894066f30 0x7f98940693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0099b0 tx=0x7f98ac016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:11.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:11.996+0000 7f98a5ffb700 1 -- 172.21.15.60:0/939868661 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98a8051890 con 0x7f98b01619e0 2023-10-06T04:28:12.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.242+0000 7f98b6b9d700 1 -- 172.21.15.60:0/939868661 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98b00cc460 con 0x7f98b01619e0 2023-10-06T04:28:12.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.242+0000 7f98a5ffb700 1 -- 172.21.15.60:0/939868661 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f98a8054eb0 con 0x7f98b01619e0 2023-10-06T04:28:12.244 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:12.244 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3950892589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3950892589},{"type":"v1","addr":"172.21.15.60:6837","nonce":3950892589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1381681252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1381681252},{"type":"v1","addr":"172.21.15.135:6834","nonce":1381681252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1306947344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1306947344},{"type":"v1","addr":"172.21.15.135:6835","nonce":1306947344}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:28:06.242656+0000","modified":"2023-10-06T04:28:11.764847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/1424722915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1424722915},{"type":"v1","addr":"172.21.15.60:6836","nonce":1424722915}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T04:28:12.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.244+0000 7f98b6b9d700 1 -- 172.21.15.60:0/939868661 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f9894066f30 msgr2=0x7f98940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:12.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.244+0000 7f98b6b9d700 1 --2- 172.21.15.60:0/939868661 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f9894066f30 0x7f98940693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0099b0 tx=0x7f98ac016000 comp rx=0 tx=0).stop 2023-10-06T04:28:12.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.244+0000 7f98b6b9d700 1 -- 172.21.15.60:0/939868661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b01619e0 msgr2=0x7f98b0171430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:12.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.244+0000 7f98b6b9d700 1 --2- 172.21.15.60:0/939868661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b01619e0 0x7f98b0171430 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f98a800bc30 tx=0x7f98a8009820 comp rx=0 tx=0).stop 2023-10-06T04:28:12.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.245+0000 7f98b6b9d700 1 -- 172.21.15.60:0/939868661 shutdown_connections 2023-10-06T04:28:12.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.245+0000 7f98b6b9d700 1 --2- 172.21.15.60:0/939868661 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f9894066f30 0x7f98940693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:12.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.245+0000 7f98b6b9d700 1 --2- 172.21.15.60:0/939868661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b01619e0 0x7f98b0171430 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:12.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.245+0000 7f98b6b9d700 1 --2- 172.21.15.60:0/939868661 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98b00c6500 0x7f98b00aaca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:12.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.245+0000 7f98b6b9d700 1 --2- 172.21.15.60:0/939868661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98b0161610 0x7f98b00c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:12.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.245+0000 7f98b6b9d700 1 -- 172.21.15.60:0/939868661 >> 172.21.15.60:0/939868661 conn(0x7f98b0068080 msgr2=0x7f98b00c1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:12.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.245+0000 7f98b6b9d700 1 -- 172.21.15.60:0/939868661 shutdown_connections 2023-10-06T04:28:12.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.245+0000 7f98b6b9d700 1 -- 172.21.15.60:0/939868661 wait complete. 2023-10-06T04:28:12.248 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2023-10-06T04:28:12.264 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:28:12.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.450+0000 7f6d071ff700 1 Processor -- start 2023-10-06T04:28:12.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.450+0000 7f6d071ff700 1 -- start start 2023-10-06T04:28:12.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.451+0000 7f6d071ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6d000adf20 0x7f6d000ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:12.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.451+0000 7f6d071ff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6d0006e240 0x7f6d0006e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:12.454 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.451+0000 7f6d071ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d000cc7f0 0x7f6d00069520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:12.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.451+0000 7f6d071ff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d00156110 con 0x7f6d0006e240 2023-10-06T04:28:12.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.451+0000 7f6d071ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d000c7330 con 0x7f6d000adf20 2023-10-06T04:28:12.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.451+0000 7f6d071ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d000ac540 con 0x7f6d000cc7f0 2023-10-06T04:28:12.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.451+0000 7f6cfffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6d0006e240 0x7f6d0006e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:12.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.451+0000 7f6cfffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6d0006e240 0x7f6d0006e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54622/0 (socket says 172.21.15.60:54622) 2023-10-06T04:28:12.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.451+0000 7f6cfffff700 1 -- 172.21.15.60:0/2929470021 learned_addr learned my addr 172.21.15.60:0/2929470021 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:12.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.451+0000 7f6d04f9b700 1 --2- 172.21.15.60:0/2929470021 >> v2:172.21.15.135:3300/0 conn(0x7f6d000adf20 0x7f6d000ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:12.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.451+0000 7f6d0579c700 1 --2- 172.21.15.60:0/2929470021 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d000cc7f0 0x7f6d00069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:12.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.452+0000 7f6cfffff700 1 -- 172.21.15.60:0/2929470021 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d000cc7f0 msgr2=0x7f6d00069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:12.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.452+0000 7f6cfffff700 1 --2- 172.21.15.60:0/2929470021 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d000cc7f0 0x7f6d00069520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:12.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.452+0000 7f6cfffff700 1 -- 172.21.15.60:0/2929470021 >> v2:172.21.15.135:3300/0 conn(0x7f6d000adf20 msgr2=0x7f6d000ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:12.455 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.452+0000 7f6cfffff700 1 --2- 172.21.15.60:0/2929470021 >> v2:172.21.15.135:3300/0 conn(0x7f6d000adf20 0x7f6d000ac000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.452+0000 7f6cfffff700 1 -- 172.21.15.60:0/2929470021 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d000c6720 con 0x7f6d0006e240 2023-10-06T04:28:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.452+0000 7f6d0579c700 1 --2- 172.21.15.60:0/2929470021 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d000cc7f0 0x7f6d00069520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.452+0000 7f6cfffff700 1 --2- 172.21.15.60:0/2929470021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d0006e240 0x7f6d0006e6b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6d00064f70 tx=0x7f6cec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1748ca157a73c440 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.452+0000 7f6cff7fe700 1 -- 172.21.15.60:0/2929470021 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec00b820 con 0x7f6d0006e240 2023-10-06T04:28:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.452+0000 7f6cff7fe700 1 -- 172.21.15.60:0/2929470021 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cec00b980 con 0x7f6d0006e240 2023-10-06T04:28:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.452+0000 7f6cff7fe700 1 -- 172.21.15.60:0/2929470021 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec00bd20 con 0x7f6d0006e240 2023-10-06T04:28:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.453+0000 7f6d071ff700 1 -- 172.21.15.60:0/2929470021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d0006e240 msgr2=0x7f6d0006e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.453+0000 7f6d071ff700 1 --2- 172.21.15.60:0/2929470021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d0006e240 0x7f6d0006e6b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6d00064f70 tx=0x7f6cec009250 comp rx=0 tx=0).stop 2023-10-06T04:28:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.453+0000 7f6d071ff700 1 -- 172.21.15.60:0/2929470021 shutdown_connections 2023-10-06T04:28:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.453+0000 7f6d071ff700 1 --2- 172.21.15.60:0/2929470021 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d000cc7f0 0x7f6d00069520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.453+0000 7f6d071ff700 1 --2- 172.21.15.60:0/2929470021 >> v2:172.21.15.135:3300/0 conn(0x7f6d000adf20 0x7f6d000ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.453+0000 7f6d071ff700 1 --2- 172.21.15.60:0/2929470021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d0006e240 0x7f6d0006e6b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:12.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.453+0000 7f6d071ff700 1 -- 172.21.15.60:0/2929470021 >> 172.21.15.60:0/2929470021 conn(0x7f6d00068080 msgr2=0x7f6d000cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:12.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.453+0000 7f6d071ff700 1 -- 172.21.15.60:0/2929470021 shutdown_connections 2023-10-06T04:28:12.457 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.453+0000 7f6d071ff700 1 -- 172.21.15.60:0/2929470021 wait complete. 2023-10-06T04:28:12.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.454+0000 7f6d071ff700 1 Processor -- start 2023-10-06T04:28:12.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.455+0000 7f6d071ff700 1 -- start start 2023-10-06T04:28:12.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.456+0000 7f6d071ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d0006e240 0x7f6d0014f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:12.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.456+0000 7f6d071ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d000adf20 0x7f6d0014fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:12.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.456+0000 7f6d071ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d000cc7f0 0x7f6d0016aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:12.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.456+0000 7f6d071ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0014c0c0 con 0x7f6d000adf20 2023-10-06T04:28:12.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.456+0000 7f6d071ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d000c2ae0 con 0x7f6d0006e240 2023-10-06T04:28:12.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.456+0000 7f6d071ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d000c2dc0 con 0x7f6d000cc7f0 2023-10-06T04:28:12.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.456+0000 7f6cfffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d000adf20 0x7f6d0014fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:12.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.456+0000 7f6cfffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d000adf20 0x7f6d0014fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54624/0 (socket says 172.21.15.60:54624) 2023-10-06T04:28:12.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.456+0000 7f6cfffff700 1 -- 172.21.15.60:0/2371691425 learned_addr learned my addr 172.21.15.60:0/2371691425 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:12.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.456+0000 7f6d04f9b700 1 --2- 172.21.15.60:0/2371691425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d0006e240 0x7f6d0014f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:12.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.456+0000 7f6d0579c700 1 --2- 172.21.15.60:0/2371691425 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d000cc7f0 0x7f6d0016aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:12.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.456+0000 7f6cfffff700 1 -- 172.21.15.60:0/2371691425 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d000cc7f0 msgr2=0x7f6d0016aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:12.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.456+0000 7f6cfffff700 1 --2- 172.21.15.60:0/2371691425 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d000cc7f0 0x7f6d0016aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:12.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.456+0000 7f6cfffff700 1 -- 172.21.15.60:0/2371691425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d0006e240 msgr2=0x7f6d0014f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:12.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.456+0000 7f6cfffff700 1 --2- 172.21.15.60:0/2371691425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d0006e240 0x7f6d0014f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:12.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.456+0000 7f6cfffff700 1 -- 172.21.15.60:0/2371691425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec0094f0 con 0x7f6d000adf20 2023-10-06T04:28:12.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.456+0000 7f6cfffff700 1 --2- 172.21.15.60:0/2371691425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d000adf20 0x7f6d0014fdb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009fd0 tx=0x7f6cec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:12.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.457+0000 7f6cfcff9700 1 -- 172.21.15.60:0/2371691425 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec011e20 con 0x7f6d000adf20 2023-10-06T04:28:12.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.457+0000 7f6cfcff9700 1 -- 172.21.15.60:0/2371691425 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cec024440 con 0x7f6d000adf20 2023-10-06T04:28:12.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.457+0000 7f6d071ff700 1 -- 172.21.15.60:0/2371691425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0014ba00 con 0x7f6d000adf20 2023-10-06T04:28:12.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.457+0000 7f6cfcff9700 1 -- 172.21.15.60:0/2371691425 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec024800 con 0x7f6d000adf20 2023-10-06T04:28:12.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.457+0000 7f6d071ff700 1 -- 172.21.15.60:0/2371691425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d001502f0 con 0x7f6d000adf20 2023-10-06T04:28:12.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.458+0000 7f6d071ff700 1 -- 172.21.15.60:0/2371691425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d00064a90 con 0x7f6d000adf20 2023-10-06T04:28:12.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.459+0000 7f6cfcff9700 1 -- 172.21.15.60:0/2371691425 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6cec02d440 con 0x7f6d000adf20 2023-10-06T04:28:12.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.460+0000 7f6cfcff9700 1 --2- 172.21.15.60:0/2371691425 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6ce4066f30 0x7f6ce40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:12.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.460+0000 7f6cfcff9700 1 -- 172.21.15.60:0/2371691425 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6cec0863b0 con 0x7f6d000adf20 2023-10-06T04:28:12.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.460+0000 7f6d04f9b700 1 --2- 172.21.15.60:0/2371691425 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6ce4066f30 0x7f6ce40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:12.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.460+0000 7f6d04f9b700 1 --2- 172.21.15.60:0/2371691425 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6ce4066f30 0x7f6ce40693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4006fd0 tx=0x7f6cf4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:12.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.464+0000 7f6cfcff9700 1 -- 172.21.15.60:0/2371691425 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cec0531b0 con 0x7f6d000adf20 2023-10-06T04:28:12.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.669+0000 7f6d071ff700 1 -- 172.21.15.60:0/2371691425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d000c6a00 con 0x7f6d000adf20 2023-10-06T04:28:12.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.670+0000 7f6cfcff9700 1 -- 172.21.15.60:0/2371691425 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f6cec0567d0 con 0x7f6d000adf20 2023-10-06T04:28:12.672 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:12.672 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:28:11.290557+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:28:04.355358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:28:05.208550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:28:08.791979+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:28:12.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.672+0000 7f6d071ff700 1 -- 172.21.15.60:0/2371691425 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6ce4066f30 msgr2=0x7f6ce40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:12.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.672+0000 7f6d071ff700 1 --2- 172.21.15.60:0/2371691425 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6ce4066f30 0x7f6ce40693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4006fd0 tx=0x7f6cf4008040 comp rx=0 tx=0).stop 2023-10-06T04:28:12.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.672+0000 7f6d071ff700 1 -- 172.21.15.60:0/2371691425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d000adf20 msgr2=0x7f6d0014fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:12.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.672+0000 7f6d071ff700 1 --2- 172.21.15.60:0/2371691425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d000adf20 0x7f6d0014fdb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009fd0 tx=0x7f6cec017000 comp rx=0 tx=0).stop 2023-10-06T04:28:12.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.672+0000 7f6d071ff700 1 -- 172.21.15.60:0/2371691425 shutdown_connections 2023-10-06T04:28:12.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.672+0000 7f6d071ff700 1 --2- 172.21.15.60:0/2371691425 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6ce4066f30 0x7f6ce40693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:12.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.672+0000 7f6d071ff700 1 --2- 172.21.15.60:0/2371691425 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6d000cc7f0 0x7f6d0016aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:12.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.672+0000 7f6d071ff700 1 --2- 172.21.15.60:0/2371691425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d0006e240 0x7f6d0014f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:12.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.672+0000 7f6d071ff700 1 --2- 172.21.15.60:0/2371691425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d000adf20 0x7f6d0014fdb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:12.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.672+0000 7f6d071ff700 1 -- 172.21.15.60:0/2371691425 >> 172.21.15.60:0/2371691425 conn(0x7f6d00068080 msgr2=0x7f6d000cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:12.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.672+0000 7f6d071ff700 1 -- 172.21.15.60:0/2371691425 shutdown_connections 2023-10-06T04:28:12.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.672+0000 7f6d071ff700 1 -- 172.21.15.60:0/2371691425 wait complete. 2023-10-06T04:28:12.691 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:28:12.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.877+0000 7f4ef2d9d700 1 Processor -- start 2023-10-06T04:28:12.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.878+0000 7f4ef2d9d700 1 -- start start 2023-10-06T04:28:12.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.879+0000 7f4ef2d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4eec0ab410 0x7f4eec0afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:12.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.879+0000 7f4ef2d9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eec0686c0 con 0x7f4eec159390 2023-10-06T04:28:12.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.879+0000 7f4ef2d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eec068c80 con 0x7f4eec159760 2023-10-06T04:28:12.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.879+0000 7f4ef2d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eec0ad0f0 con 0x7f4eec0ab410 2023-10-06T04:28:12.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.879+0000 7f4ef1d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4eec159390 0x7f4eec0ac8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60464/0 (socket says 172.21.15.60:60464) 2023-10-06T04:28:12.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.879+0000 7f4ef1d9b700 1 -- 172.21.15.60:0/309403463 learned_addr learned my addr 172.21.15.60:0/309403463 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:12.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.879+0000 7f4ef259c700 1 --2- 172.21.15.60:0/309403463 >> v2:172.21.15.135:3300/0 conn(0x7f4eec0ab410 0x7f4eec0afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:12.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.879+0000 7f4ef0d99700 1 -- 172.21.15.60:0/309403463 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608282508 0 0) 0x7f4eec0686c0 con 0x7f4eec159390 2023-10-06T04:28:12.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.880+0000 7f4ef0d99700 1 -- 172.21.15.60:0/309403463 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ed8003570 con 0x7f4eec159390 2023-10-06T04:28:12.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.880+0000 7f4ef259c700 1 -- 172.21.15.60:0/309403463 >> v1:172.21.15.135:6789/0 conn(0x7f4eec159760 legacy=0x7f4eec0aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:12.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.880+0000 7f4ef0d99700 1 -- 172.21.15.60:0/309403463 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503849117 0 0) 0x7f4eec068c80 con 0x7f4eec159760 2023-10-06T04:28:12.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.880+0000 7f4ef259c700 1 -- 172.21.15.60:0/309403463 >> v1:172.21.15.60:6789/0 conn(0x7f4eec159390 legacy=0x7f4eec0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:12.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.880+0000 7f4ef259c700 1 -- 172.21.15.60:0/309403463 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec0ad3d0 con 0x7f4eec0ab410 2023-10-06T04:28:12.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.880+0000 7f4ef259c700 1 --2- 172.21.15.60:0/309403463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4eec0ab410 0x7f4eec0afb80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4009e60 tx=0x7f4ee4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45aeb3898a609052 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:12.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.880+0000 7f4ef0d99700 1 -- 172.21.15.60:0/309403463 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee400e070 con 0x7f4eec0ab410 2023-10-06T04:28:12.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.880+0000 7f4ef0d99700 1 -- 172.21.15.60:0/309403463 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee400b850 con 0x7f4eec0ab410 2023-10-06T04:28:12.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.880+0000 7f4ef0d99700 1 -- 172.21.15.60:0/309403463 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8001470 con 0x7f4eec0ab410 2023-10-06T04:28:12.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.881+0000 7f4ef2d9d700 1 -- 172.21.15.60:0/309403463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4eec0ab410 msgr2=0x7f4eec0afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:12.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.881+0000 7f4ef2d9d700 1 --2- 172.21.15.60:0/309403463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4eec0ab410 0x7f4eec0afb80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4009e60 tx=0x7f4ee4009780 comp rx=0 tx=0).stop 2023-10-06T04:28:12.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.881+0000 7f4ef2d9d700 1 -- 172.21.15.60:0/309403463 shutdown_connections 2023-10-06T04:28:12.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.881+0000 7f4ef2d9d700 1 --2- 172.21.15.60:0/309403463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4eec0ab410 0x7f4eec0afb80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:12.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.881+0000 7f4ef2d9d700 1 -- 172.21.15.60:0/309403463 >> 172.21.15.60:0/309403463 conn(0x7f4eec097410 msgr2=0x7f4eec067d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:12.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.881+0000 7f4ef2d9d700 1 -- 172.21.15.60:0/309403463 shutdown_connections 2023-10-06T04:28:12.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.881+0000 7f4ef2d9d700 1 -- 172.21.15.60:0/309403463 wait complete. 2023-10-06T04:28:12.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.882+0000 7f4ef2d9d700 1 Processor -- start 2023-10-06T04:28:12.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.883+0000 7f4ef2d9d700 1 -- start start 2023-10-06T04:28:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.883+0000 7f4ef2d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4eec0ab410 0x7f4eec1558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.883+0000 7f4ef2d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4eec159390 0x7f4eec098010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.884+0000 7f4ef2d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eec159760 0x7f4eec15e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.884+0000 7f4ef2d9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0b3fd0 con 0x7f4eec159760 2023-10-06T04:28:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.884+0000 7f4ef2d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0b1910 con 0x7f4eec0ab410 2023-10-06T04:28:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.884+0000 7f4ef2d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec155de0 con 0x7f4eec159390 2023-10-06T04:28:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.884+0000 7f4ef259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eec159760 0x7f4eec15e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.884+0000 7f4ef259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eec159760 0x7f4eec15e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54632/0 (socket says 172.21.15.60:54632) 2023-10-06T04:28:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.884+0000 7f4ef259c700 1 -- 172.21.15.60:0/3945278368 learned_addr learned my addr 172.21.15.60:0/3945278368 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.884+0000 7f4ef1d9b700 1 --2- 172.21.15.60:0/3945278368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4eec0ab410 0x7f4eec1558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.884+0000 7f4ef259c700 1 -- 172.21.15.60:0/3945278368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4eec159390 msgr2=0x7f4eec098010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.884+0000 7f4ef259c700 1 --2- 172.21.15.60:0/3945278368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4eec159390 0x7f4eec098010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.884+0000 7f4ef259c700 1 -- 172.21.15.60:0/3945278368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4eec0ab410 msgr2=0x7f4eec1558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.884+0000 7f4ef259c700 1 --2- 172.21.15.60:0/3945278368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4eec0ab410 0x7f4eec1558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.884+0000 7f4ef259c700 1 -- 172.21.15.60:0/3945278368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee4009a20 con 0x7f4eec159760 2023-10-06T04:28:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.884+0000 7f4ef1d9b700 1 --2- 172.21.15.60:0/3945278368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4eec0ab410 0x7f4eec1558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.884+0000 7f4ef259c700 1 --2- 172.21.15.60:0/3945278368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eec159760 0x7f4eec15e030 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40097c0 tx=0x7f4ee4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.885+0000 7f4ee1ffb700 1 -- 172.21.15.60:0/3945278368 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee401f410 con 0x7f4eec159760 2023-10-06T04:28:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.885+0000 7f4ee1ffb700 1 -- 172.21.15.60:0/3945278368 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee401f5b0 con 0x7f4eec159760 2023-10-06T04:28:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.885+0000 7f4ee1ffb700 1 -- 172.21.15.60:0/3945278368 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee401f970 con 0x7f4eec159760 2023-10-06T04:28:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.885+0000 7f4ef2d9d700 1 -- 172.21.15.60:0/3945278368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eec09ad30 con 0x7f4eec159760 2023-10-06T04:28:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.885+0000 7f4ef2d9d700 1 -- 172.21.15.60:0/3945278368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eec09b2f0 con 0x7f4eec159760 2023-10-06T04:28:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.886+0000 7f4ef2d9d700 1 -- 172.21.15.60:0/3945278368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eec0b1a80 con 0x7f4eec159760 2023-10-06T04:28:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.887+0000 7f4ee1ffb700 1 -- 172.21.15.60:0/3945278368 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ee40113b0 con 0x7f4eec159760 2023-10-06T04:28:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.887+0000 7f4ee1ffb700 1 --2- 172.21.15.60:0/3945278368 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4ed0066f30 0x7f4ed00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.888+0000 7f4ee1ffb700 1 -- 172.21.15.60:0/3945278368 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4ee4086d00 con 0x7f4eec159760 2023-10-06T04:28:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.888+0000 7f4ef1d9b700 1 --2- 172.21.15.60:0/3945278368 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4ed0066f30 0x7f4ed00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:12.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.888+0000 7f4ef1d9b700 1 --2- 172.21.15.60:0/3945278368 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4ed0066f30 0x7f4ed00693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80011e0 tx=0x7f4ee8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:12.892+0000 7f4ee1ffb700 1 -- 172.21.15.60:0/3945278368 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ee4053a80 con 0x7f4eec159760 2023-10-06T04:28:13.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.095+0000 7f4ef2d9d700 1 -- 172.21.15.60:0/3945278368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4eec05f230 con 0x7f4eec159760 2023-10-06T04:28:13.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.096+0000 7f4ee1ffb700 1 -- 172.21.15.60:0/3945278368 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f4ee4023090 con 0x7f4eec159760 2023-10-06T04:28:13.097 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:13.098 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:28:11.290557+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:28:04.355358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:28:05.208550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:28:08.791979+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:28:13.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.098+0000 7f4ef2d9d700 1 -- 172.21.15.60:0/3945278368 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4ed0066f30 msgr2=0x7f4ed00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:13.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.098+0000 7f4ef2d9d700 1 --2- 172.21.15.60:0/3945278368 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4ed0066f30 0x7f4ed00693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80011e0 tx=0x7f4ee8009040 comp rx=0 tx=0).stop 2023-10-06T04:28:13.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.098+0000 7f4ef2d9d700 1 -- 172.21.15.60:0/3945278368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eec159760 msgr2=0x7f4eec15e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:13.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.098+0000 7f4ef2d9d700 1 --2- 172.21.15.60:0/3945278368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eec159760 0x7f4eec15e030 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40097c0 tx=0x7f4ee4017000 comp rx=0 tx=0).stop 2023-10-06T04:28:13.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.098+0000 7f4ef2d9d700 1 -- 172.21.15.60:0/3945278368 shutdown_connections 2023-10-06T04:28:13.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.098+0000 7f4ef2d9d700 1 --2- 172.21.15.60:0/3945278368 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4ed0066f30 0x7f4ed00693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:13.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.098+0000 7f4ef2d9d700 1 --2- 172.21.15.60:0/3945278368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eec159760 0x7f4eec15e030 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:13.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.098+0000 7f4ef2d9d700 1 --2- 172.21.15.60:0/3945278368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4eec0ab410 0x7f4eec1558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:13.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.098+0000 7f4ef2d9d700 1 --2- 172.21.15.60:0/3945278368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4eec159390 0x7f4eec098010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:13.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.098+0000 7f4ef2d9d700 1 -- 172.21.15.60:0/3945278368 >> 172.21.15.60:0/3945278368 conn(0x7f4eec097410 msgr2=0x7f4eec0abd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:13.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.098+0000 7f4ef2d9d700 1 -- 172.21.15.60:0/3945278368 shutdown_connections 2023-10-06T04:28:13.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.098+0000 7f4ef2d9d700 1 -- 172.21.15.60:0/3945278368 wait complete. 2023-10-06T04:28:13.129 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:28:13.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.315+0000 7fdf15b9d700 1 Processor -- start 2023-10-06T04:28:13.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.315+0000 7fdf15b9d700 1 -- start start 2023-10-06T04:28:13.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.317+0000 7fdf15b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdf10140770 0x7fdf1006d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:13.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.317+0000 7fdf15b9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdf1006f2d0 0x7fdf1015adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:13.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.317+0000 7fdf15b9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf100af390 con 0x7fdf10140b40 2023-10-06T04:28:13.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.317+0000 7fdf15b9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf100c6500 con 0x7fdf1006f2d0 2023-10-06T04:28:13.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.317+0000 7fdf15b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf100c67e0 con 0x7fdf10140770 2023-10-06T04:28:13.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.317+0000 7fdf0ffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fdf10140b40 0x7fdf100aec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55134/0 (socket says 172.21.15.60:55134) 2023-10-06T04:28:13.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.317+0000 7fdf0ffff700 1 -- 172.21.15.60:0/744357280 learned_addr learned my addr 172.21.15.60:0/744357280 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:13.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.317+0000 7fdf1539c700 1 --2- 172.21.15.60:0/744357280 >> v2:172.21.15.60:3300/0 conn(0x7fdf1006f2d0 0x7fdf1015adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:13.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.317+0000 7fdf14b9b700 1 --2- 172.21.15.60:0/744357280 >> v2:172.21.15.135:3300/0 conn(0x7fdf10140770 0x7fdf1006d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:13.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.317+0000 7fdf0f7fe700 1 -- 172.21.15.60:0/744357280 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110703801 0 0) 0x7fdf100af390 con 0x7fdf10140b40 2023-10-06T04:28:13.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.317+0000 7fdf1539c700 1 -- 172.21.15.60:0/744357280 >> v2:172.21.15.135:3300/0 conn(0x7fdf10140770 msgr2=0x7fdf1006d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:13.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.317+0000 7fdf1539c700 1 --2- 172.21.15.60:0/744357280 >> v2:172.21.15.135:3300/0 conn(0x7fdf10140770 0x7fdf1006d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:13.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.317+0000 7fdf1539c700 1 -- 172.21.15.60:0/744357280 >> v1:172.21.15.60:6789/0 conn(0x7fdf10140b40 legacy=0x7fdf100aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:13.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.317+0000 7fdf1539c700 1 -- 172.21.15.60:0/744357280 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf100c6ac0 con 0x7fdf1006f2d0 2023-10-06T04:28:13.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.318+0000 7fdf1539c700 1 --2- 172.21.15.60:0/744357280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf1006f2d0 0x7fdf1015adb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdf1006c660 tx=0x7fdf08009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb33c1b9792153d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:13.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.318+0000 7fdf0f7fe700 1 -- 172.21.15.60:0/744357280 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0800e070 con 0x7fdf1006f2d0 2023-10-06T04:28:13.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.318+0000 7fdf0f7fe700 1 -- 172.21.15.60:0/744357280 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0800bc30 con 0x7fdf1006f2d0 2023-10-06T04:28:13.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.318+0000 7fdf0f7fe700 1 -- 172.21.15.60:0/744357280 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf08012430 con 0x7fdf1006f2d0 2023-10-06T04:28:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.318+0000 7fdf15b9d700 1 -- 172.21.15.60:0/744357280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf1006f2d0 msgr2=0x7fdf1015adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.318+0000 7fdf15b9d700 1 --2- 172.21.15.60:0/744357280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf1006f2d0 0x7fdf1015adb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdf1006c660 tx=0x7fdf08009780 comp rx=0 tx=0).stop 2023-10-06T04:28:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.319+0000 7fdf15b9d700 1 -- 172.21.15.60:0/744357280 shutdown_connections 2023-10-06T04:28:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.319+0000 7fdf15b9d700 1 --2- 172.21.15.60:0/744357280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf1006f2d0 0x7fdf1015adb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.319+0000 7fdf15b9d700 1 --2- 172.21.15.60:0/744357280 >> v2:172.21.15.135:3300/0 conn(0x7fdf10140770 0x7fdf1006d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.319+0000 7fdf15b9d700 1 -- 172.21.15.60:0/744357280 >> 172.21.15.60:0/744357280 conn(0x7fdf10068080 msgr2=0x7fdf100cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.319+0000 7fdf15b9d700 1 -- 172.21.15.60:0/744357280 shutdown_connections 2023-10-06T04:28:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.319+0000 7fdf15b9d700 1 -- 172.21.15.60:0/744357280 wait complete. 2023-10-06T04:28:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.320+0000 7fdf15b9d700 1 Processor -- start 2023-10-06T04:28:13.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.320+0000 7fdf15b9d700 1 -- start start 2023-10-06T04:28:13.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.321+0000 7fdf15b9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf1006f2d0 0x7fdf1013f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:13.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.321+0000 7fdf15b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf10140770 0x7fdf10155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:13.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.321+0000 7fdf15b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf10157820 0x7fdf101590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:13.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.321+0000 7fdf15b9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf10156270 con 0x7fdf1006f2d0 2023-10-06T04:28:13.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.321+0000 7fdf15b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf100c3c20 con 0x7fdf10157820 2023-10-06T04:28:13.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.321+0000 7fdf15b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf10157fc0 con 0x7fdf10140770 2023-10-06T04:28:13.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.321+0000 7fdf14b9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf1006f2d0 0x7fdf1013f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:13.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.321+0000 7fdf14b9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf1006f2d0 0x7fdf1013f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55816/0 (socket says 172.21.15.60:55816) 2023-10-06T04:28:13.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.321+0000 7fdf14b9b700 1 -- 172.21.15.60:0/3397685637 learned_addr learned my addr 172.21.15.60:0/3397685637 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:13.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.321+0000 7fdf1539c700 1 --2- 172.21.15.60:0/3397685637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf10157820 0x7fdf101590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:13.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.321+0000 7fdf0ffff700 1 --2- 172.21.15.60:0/3397685637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf10140770 0x7fdf10155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:13.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.322+0000 7fdf14b9b700 1 -- 172.21.15.60:0/3397685637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf10140770 msgr2=0x7fdf10155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:13.325 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.322+0000 7fdf14b9b700 1 --2- 172.21.15.60:0/3397685637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf10140770 0x7fdf10155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:13.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.322+0000 7fdf14b9b700 1 -- 172.21.15.60:0/3397685637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf10157820 msgr2=0x7fdf101590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:13.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.322+0000 7fdf14b9b700 1 --2- 172.21.15.60:0/3397685637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf10157820 0x7fdf101590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:13.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.322+0000 7fdf14b9b700 1 -- 172.21.15.60:0/3397685637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf08009a20 con 0x7fdf1006f2d0 2023-10-06T04:28:13.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.322+0000 7fdf14b9b700 1 --2- 172.21.15.60:0/3397685637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf1006f2d0 0x7fdf1013f460 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400d890 tx=0x7fdf04008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:13.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.322+0000 7fdf0cff9700 1 -- 172.21.15.60:0/3397685637 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf040125f0 con 0x7fdf1006f2d0 2023-10-06T04:28:13.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.322+0000 7fdf0cff9700 1 -- 172.21.15.60:0/3397685637 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf04012750 con 0x7fdf1006f2d0 2023-10-06T04:28:13.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.322+0000 7fdf0cff9700 1 -- 172.21.15.60:0/3397685637 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04012af0 con 0x7fdf1006f2d0 2023-10-06T04:28:13.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.322+0000 7fdf15b9d700 1 -- 172.21.15.60:0/3397685637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf101582a0 con 0x7fdf1006f2d0 2023-10-06T04:28:13.326 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.323+0000 7fdf15b9d700 1 -- 172.21.15.60:0/3397685637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf10158860 con 0x7fdf1006f2d0 2023-10-06T04:28:13.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.324+0000 7fdf15b9d700 1 -- 172.21.15.60:0/3397685637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf100c39f0 con 0x7fdf1006f2d0 2023-10-06T04:28:13.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.325+0000 7fdf0cff9700 1 -- 172.21.15.60:0/3397685637 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf0401e460 con 0x7fdf1006f2d0 2023-10-06T04:28:13.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.326+0000 7fdf0cff9700 1 --2- 172.21.15.60:0/3397685637 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fdef4066f30 0x7fdef40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:13.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.326+0000 7fdf0cff9700 1 -- 172.21.15.60:0/3397685637 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdf04084f50 con 0x7fdf1006f2d0 2023-10-06T04:28:13.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.326+0000 7fdf0ffff700 1 --2- 172.21.15.60:0/3397685637 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fdef4066f30 0x7fdef40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:13.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.327+0000 7fdf0ffff700 1 --2- 172.21.15.60:0/3397685637 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fdef4066f30 0x7fdef40693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdf1013f9a0 tx=0x7fdefc007f50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:13.331 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.330+0000 7fdf0cff9700 1 -- 172.21.15.60:0/3397685637 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf100c39f0 con 0x7fdf1006f2d0 2023-10-06T04:28:13.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.579+0000 7fdf15b9d700 1 -- 172.21.15.60:0/3397685637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf100c39f0 con 0x7fdf1006f2d0 2023-10-06T04:28:13.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.580+0000 7fdf0cff9700 1 -- 172.21.15.60:0/3397685637 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4599 (secure 0 0 0) 0x7fdf100c39f0 con 0x7fdf1006f2d0 2023-10-06T04:28:13.581 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:13.581 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3950892589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3950892589},{"type":"v1","addr":"172.21.15.60:6837","nonce":3950892589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1381681252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1381681252},{"type":"v1","addr":"172.21.15.135:6834","nonce":1381681252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1306947344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1306947344},{"type":"v1","addr":"172.21.15.135:6835","nonce":1306947344}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:28:06.242656+0000","modified":"2023-10-06T04:28:11.764847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/1424722915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1424722915},{"type":"v1","addr":"172.21.15.60:6836","nonce":1424722915}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T04:28:13.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.582+0000 7fdf15b9d700 1 -- 172.21.15.60:0/3397685637 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fdef4066f30 msgr2=0x7fdef40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.582+0000 7fdf15b9d700 1 --2- 172.21.15.60:0/3397685637 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fdef4066f30 0x7fdef40693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdf1013f9a0 tx=0x7fdefc007f50 comp rx=0 tx=0).stop 2023-10-06T04:28:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.582+0000 7fdf15b9d700 1 -- 172.21.15.60:0/3397685637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf1006f2d0 msgr2=0x7fdf1013f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.582+0000 7fdf15b9d700 1 --2- 172.21.15.60:0/3397685637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf1006f2d0 0x7fdf1013f460 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400d890 tx=0x7fdf04008040 comp rx=0 tx=0).stop 2023-10-06T04:28:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.582+0000 7fdf15b9d700 1 -- 172.21.15.60:0/3397685637 shutdown_connections 2023-10-06T04:28:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.582+0000 7fdf15b9d700 1 --2- 172.21.15.60:0/3397685637 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fdef4066f30 0x7fdef40693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.582+0000 7fdf15b9d700 1 --2- 172.21.15.60:0/3397685637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdf1006f2d0 0x7fdf1013f460 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.582+0000 7fdf15b9d700 1 --2- 172.21.15.60:0/3397685637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf10157820 0x7fdf101590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.582+0000 7fdf15b9d700 1 --2- 172.21.15.60:0/3397685637 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf10140770 0x7fdf10155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.582+0000 7fdf15b9d700 1 -- 172.21.15.60:0/3397685637 >> 172.21.15.60:0/3397685637 conn(0x7fdf10068080 msgr2=0x7fdf10156a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.582+0000 7fdf15b9d700 1 -- 172.21.15.60:0/3397685637 shutdown_connections 2023-10-06T04:28:13.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.582+0000 7fdf15b9d700 1 -- 172.21.15.60:0/3397685637 wait complete. 2023-10-06T04:28:13.585 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2023-10-06T04:28:13.601 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:28:13.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.787+0000 7f402ffff700 1 Processor -- start 2023-10-06T04:28:13.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.788+0000 7f402ffff700 1 -- start start 2023-10-06T04:28:13.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.789+0000 7f402ffff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4030159390 0x7f40300ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:13.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.789+0000 7f402ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4030159760 0x7f40300aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:13.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.789+0000 7f402ffff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40300686c0 con 0x7f40300ab240 2023-10-06T04:28:13.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.789+0000 7f402ffff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4030068c80 con 0x7f4030159760 2023-10-06T04:28:13.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.789+0000 7f402ffff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40300ab660 con 0x7f4030159390 2023-10-06T04:28:13.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.789+0000 7f402e7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4030159760 0x7f40300aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:13.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.789+0000 7f402e7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4030159760 0x7f40300aad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55828/0 (socket says 172.21.15.60:55828) 2023-10-06T04:28:13.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.789+0000 7f402e7fc700 1 -- 172.21.15.60:0/1136207848 learned_addr learned my addr 172.21.15.60:0/1136207848 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:13.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.789+0000 7f402f7fe700 1 --1- 172.21.15.60:0/1136207848 >> v1:172.21.15.60:6789/0 conn(0x7f40300ab240 0x7f4030069110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55138/0 (socket says 172.21.15.60:55138) 2023-10-06T04:28:13.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.789+0000 7f402effd700 1 --2- 172.21.15.60:0/1136207848 >> v2:172.21.15.135:3300/0 conn(0x7f4030159390 0x7f40300ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:13.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.790+0000 7f402e7fc700 1 -- 172.21.15.60:0/1136207848 >> v2:172.21.15.135:3300/0 conn(0x7f4030159390 msgr2=0x7f40300ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:13.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.790+0000 7f402e7fc700 1 --2- 172.21.15.60:0/1136207848 >> v2:172.21.15.135:3300/0 conn(0x7f4030159390 0x7f40300ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:13.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.790+0000 7f402e7fc700 1 -- 172.21.15.60:0/1136207848 >> v1:172.21.15.60:6789/0 conn(0x7f40300ab240 legacy=0x7f4030069110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:13.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.790+0000 7f402e7fc700 1 -- 172.21.15.60:0/1136207848 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40300ace20 con 0x7f4030159760 2023-10-06T04:28:13.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.790+0000 7f402dffb700 1 -- 172.21.15.60:0/1136207848 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586351896 0 0) 0x7f40300686c0 con 0x7f40300ab240 2023-10-06T04:28:13.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.790+0000 7f402e7fc700 1 --2- 172.21.15.60:0/1136207848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4030159760 0x7f40300aad00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f403006eb90 tx=0x7f4024009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c275599a447447 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:13.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.790+0000 7f402dffb700 1 -- 172.21.15.60:0/1136207848 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4024009e70 con 0x7f4030159760 2023-10-06T04:28:13.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.790+0000 7f402dffb700 1 -- 172.21.15.60:0/1136207848 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402400b860 con 0x7f4030159760 2023-10-06T04:28:13.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.790+0000 7f402dffb700 1 -- 172.21.15.60:0/1136207848 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402400bc00 con 0x7f4030159760 2023-10-06T04:28:13.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.791+0000 7f402ffff700 1 -- 172.21.15.60:0/1136207848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4030159760 msgr2=0x7f40300aad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:13.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.791+0000 7f402ffff700 1 --2- 172.21.15.60:0/1136207848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4030159760 0x7f40300aad00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f403006eb90 tx=0x7f4024009250 comp rx=0 tx=0).stop 2023-10-06T04:28:13.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.791+0000 7f402ffff700 1 -- 172.21.15.60:0/1136207848 shutdown_connections 2023-10-06T04:28:13.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.791+0000 7f402ffff700 1 --2- 172.21.15.60:0/1136207848 >> v2:172.21.15.135:3300/0 conn(0x7f4030159390 0x7f40300ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:13.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.791+0000 7f402ffff700 1 --2- 172.21.15.60:0/1136207848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4030159760 0x7f40300aad00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:13.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.791+0000 7f402ffff700 1 -- 172.21.15.60:0/1136207848 >> 172.21.15.60:0/1136207848 conn(0x7f4030097410 msgr2=0x7f4030067d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:13.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.791+0000 7f402ffff700 1 -- 172.21.15.60:0/1136207848 shutdown_connections 2023-10-06T04:28:13.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.791+0000 7f402ffff700 1 -- 172.21.15.60:0/1136207848 wait complete. 2023-10-06T04:28:13.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.792+0000 7f402ffff700 1 Processor -- start 2023-10-06T04:28:13.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.792+0000 7f402ffff700 1 -- start start 2023-10-06T04:28:13.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.793+0000 7f402ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40300ab240 0x7f403009bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:13.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.793+0000 7f402ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4030159390 0x7f403015a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:13.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.793+0000 7f402ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4030159760 0x7f40300b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:13.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.793+0000 7f402ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4030142750 con 0x7f40300ab240 2023-10-06T04:28:13.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.793+0000 7f402ffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403015ba30 con 0x7f4030159760 2023-10-06T04:28:13.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.793+0000 7f402ffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403015ae20 con 0x7f4030159390 2023-10-06T04:28:13.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.793+0000 7f402effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40300ab240 0x7f403009bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:13.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.794+0000 7f402effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40300ab240 0x7f403009bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55834/0 (socket says 172.21.15.60:55834) 2023-10-06T04:28:13.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.794+0000 7f402effd700 1 -- 172.21.15.60:0/1100611400 learned_addr learned my addr 172.21.15.60:0/1100611400 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:13.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.794+0000 7f402f7fe700 1 --2- 172.21.15.60:0/1100611400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4030159760 0x7f40300b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:13.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.794+0000 7f402effd700 1 -- 172.21.15.60:0/1100611400 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4030159390 msgr2=0x7f403015a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:13.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.794+0000 7f402effd700 1 --2- 172.21.15.60:0/1100611400 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4030159390 0x7f403015a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:13.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.794+0000 7f402effd700 1 -- 172.21.15.60:0/1100611400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4030159760 msgr2=0x7f40300b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:13.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.794+0000 7f402effd700 1 --2- 172.21.15.60:0/1100611400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4030159760 0x7f40300b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:13.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.794+0000 7f402effd700 1 -- 172.21.15.60:0/1100611400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40240094f0 con 0x7f40300ab240 2023-10-06T04:28:13.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.794+0000 7f402f7fe700 1 --2- 172.21.15.60:0/1100611400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4030159760 0x7f40300b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:13.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.794+0000 7f402effd700 1 --2- 172.21.15.60:0/1100611400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40300ab240 0x7f403009bab0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f402000ec80 tx=0x7f40200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:13.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.794+0000 7f4016ffd700 1 -- 172.21.15.60:0/1100611400 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402000c9d0 con 0x7f40300ab240 2023-10-06T04:28:13.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.794+0000 7f4016ffd700 1 -- 172.21.15.60:0/1100611400 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402000cb30 con 0x7f40300ab240 2023-10-06T04:28:13.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.795+0000 7f402ffff700 1 -- 172.21.15.60:0/1100611400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f403015b100 con 0x7f40300ab240 2023-10-06T04:28:13.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.795+0000 7f4016ffd700 1 -- 172.21.15.60:0/1100611400 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4020013470 con 0x7f40300ab240 2023-10-06T04:28:13.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.795+0000 7f402ffff700 1 -- 172.21.15.60:0/1100611400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403015b6c0 con 0x7f40300ab240 2023-10-06T04:28:13.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.796+0000 7f402ffff700 1 -- 172.21.15.60:0/1100611400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f403005f230 con 0x7f40300ab240 2023-10-06T04:28:13.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.797+0000 7f4016ffd700 1 -- 172.21.15.60:0/1100611400 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4020013820 con 0x7f40300ab240 2023-10-06T04:28:13.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.797+0000 7f4016ffd700 1 --2- 172.21.15.60:0/1100611400 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f401c066f30 0x7f401c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:13.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.798+0000 7f4016ffd700 1 -- 172.21.15.60:0/1100611400 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4020084db0 con 0x7f40300ab240 2023-10-06T04:28:13.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.798+0000 7f402e7fc700 1 --2- 172.21.15.60:0/1100611400 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f401c066f30 0x7f401c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:13.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.798+0000 7f402e7fc700 1 --2- 172.21.15.60:0/1100611400 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f401c066f30 0x7f401c0693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f403006eb90 tx=0x7f4024017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:13.802 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:13.801+0000 7f4016ffd700 1 -- 172.21.15.60:0/1100611400 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4020089070 con 0x7f40300ab240 2023-10-06T04:28:14.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.005+0000 7f402ffff700 1 -- 172.21.15.60:0/1100611400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f403006c9e0 con 0x7f40300ab240 2023-10-06T04:28:14.007 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.006+0000 7f4016ffd700 1 -- 172.21.15.60:0/1100611400 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f4020051b30 con 0x7f40300ab240 2023-10-06T04:28:14.008 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:14.008 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:28:11.290557+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:28:04.355358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:28:05.208550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:28:08.791979+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:28:14.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.009+0000 7f402ffff700 1 -- 172.21.15.60:0/1100611400 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f401c066f30 msgr2=0x7f401c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:14.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.009+0000 7f402ffff700 1 --2- 172.21.15.60:0/1100611400 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f401c066f30 0x7f401c0693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f403006eb90 tx=0x7f4024017000 comp rx=0 tx=0).stop 2023-10-06T04:28:14.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.009+0000 7f402ffff700 1 -- 172.21.15.60:0/1100611400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40300ab240 msgr2=0x7f403009bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:14.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.009+0000 7f402ffff700 1 --2- 172.21.15.60:0/1100611400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40300ab240 0x7f403009bab0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f402000ec80 tx=0x7f40200091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.009+0000 7f402ffff700 1 -- 172.21.15.60:0/1100611400 shutdown_connections 2023-10-06T04:28:14.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.009+0000 7f402ffff700 1 --2- 172.21.15.60:0/1100611400 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f401c066f30 0x7f401c0693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.009+0000 7f402ffff700 1 --2- 172.21.15.60:0/1100611400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40300ab240 0x7f403009bab0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.009+0000 7f402ffff700 1 --2- 172.21.15.60:0/1100611400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4030159760 0x7f40300b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.009+0000 7f402ffff700 1 --2- 172.21.15.60:0/1100611400 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4030159390 0x7f403015a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.009+0000 7f402ffff700 1 -- 172.21.15.60:0/1100611400 >> 172.21.15.60:0/1100611400 conn(0x7f4030097410 msgr2=0x7f403006c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:14.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.009+0000 7f402ffff700 1 -- 172.21.15.60:0/1100611400 shutdown_connections 2023-10-06T04:28:14.011 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.009+0000 7f402ffff700 1 -- 172.21.15.60:0/1100611400 wait complete. 2023-10-06T04:28:14.431 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:28:06.242656+0000', 'modified': '2023-10-06T04:28:11.764847+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6836/1424722915', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6834', 'nonce': 1424722915}, {'type': 'v1', 'addr': '172.21.15.60:6836', 'nonce': 1424722915}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2023-10-06T04:28:14.431 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:28:14.431 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T04:28:14.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.618+0000 7efd6759e700 1 Processor -- start 2023-10-06T04:28:14.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.618+0000 7efd6759e700 1 -- start start 2023-10-06T04:28:14.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.619+0000 7efd6759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efd68159440 0x7efd680b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.619+0000 7efd6759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd680b2100 0x7efd680b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.619+0000 7efd6759e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd680cb7a0 con 0x7efd680b35d0 2023-10-06T04:28:14.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.619+0000 7efd6759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd680b0860 con 0x7efd68159440 2023-10-06T04:28:14.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.619+0000 7efd6759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd680cb150 con 0x7efd680b2100 2023-10-06T04:28:14.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.619+0000 7efd6659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efd68159440 0x7efd680b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.620+0000 7efd6659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efd68159440 0x7efd680b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55842/0 (socket says 172.21.15.60:55842) 2023-10-06T04:28:14.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.620+0000 7efd65d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efd680b35d0 0x7efd680cbc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55150/0 (socket says 172.21.15.60:55150) 2023-10-06T04:28:14.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.620+0000 7efd6659c700 1 -- 172.21.15.60:0/3503873450 learned_addr learned my addr 172.21.15.60:0/3503873450 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:14.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.620+0000 7efd66d9d700 1 --2- 172.21.15.60:0/3503873450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd680b2100 0x7efd680b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.620+0000 7efd6559a700 1 -- 172.21.15.60:0/3503873450 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32000142 0 0) 0x7efd680cb7a0 con 0x7efd680b35d0 2023-10-06T04:28:14.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.620+0000 7efd6659c700 1 -- 172.21.15.60:0/3503873450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd680b2100 msgr2=0x7efd680b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:14.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.620+0000 7efd6659c700 1 --2- 172.21.15.60:0/3503873450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd680b2100 0x7efd680b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.620+0000 7efd6659c700 1 -- 172.21.15.60:0/3503873450 >> v1:172.21.15.60:6789/0 conn(0x7efd680b35d0 legacy=0x7efd680cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:14.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.620+0000 7efd6659c700 1 -- 172.21.15.60:0/3503873450 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd680cb430 con 0x7efd68159440 2023-10-06T04:28:14.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.620+0000 7efd6659c700 1 --2- 172.21.15.60:0/3503873450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd68159440 0x7efd680b3090 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efd580099b0 tx=0x7efd58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1edb99c54b2ae4e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:14.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.620+0000 7efd6559a700 1 -- 172.21.15.60:0/3503873450 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5800b860 con 0x7efd68159440 2023-10-06T04:28:14.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.621+0000 7efd6559a700 1 -- 172.21.15.60:0/3503873450 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5800b9c0 con 0x7efd68159440 2023-10-06T04:28:14.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.621+0000 7efd6559a700 1 -- 172.21.15.60:0/3503873450 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5800bd60 con 0x7efd68159440 2023-10-06T04:28:14.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.621+0000 7efd6759e700 1 -- 172.21.15.60:0/3503873450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd68159440 msgr2=0x7efd680b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:14.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.621+0000 7efd6759e700 1 --2- 172.21.15.60:0/3503873450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd68159440 0x7efd680b3090 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efd580099b0 tx=0x7efd58009250 comp rx=0 tx=0).stop 2023-10-06T04:28:14.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.621+0000 7efd6759e700 1 -- 172.21.15.60:0/3503873450 shutdown_connections 2023-10-06T04:28:14.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.621+0000 7efd6759e700 1 --2- 172.21.15.60:0/3503873450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd680b2100 0x7efd680b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.621+0000 7efd6759e700 1 --2- 172.21.15.60:0/3503873450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd68159440 0x7efd680b3090 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.621+0000 7efd6759e700 1 -- 172.21.15.60:0/3503873450 >> 172.21.15.60:0/3503873450 conn(0x7efd6806ece0 msgr2=0x7efd6806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:14.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.621+0000 7efd6759e700 1 -- 172.21.15.60:0/3503873450 shutdown_connections 2023-10-06T04:28:14.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.621+0000 7efd6759e700 1 -- 172.21.15.60:0/3503873450 wait complete. 2023-10-06T04:28:14.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.623+0000 7efd6759e700 1 Processor -- start 2023-10-06T04:28:14.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.623+0000 7efd6759e700 1 -- start start 2023-10-06T04:28:14.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.624+0000 7efd6759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd680b2100 0x7efd681552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.624+0000 7efd6759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd680b35d0 0x7efd680c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.624+0000 7efd6759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd68159440 0x7efd680c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.624+0000 7efd6759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd68159da0 con 0x7efd68159440 2023-10-06T04:28:14.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.624+0000 7efd6759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6815cf50 con 0x7efd680b2100 2023-10-06T04:28:14.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.624+0000 7efd6759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6815d230 con 0x7efd680b35d0 2023-10-06T04:28:14.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.624+0000 7efd66d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd68159440 0x7efd680c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.624+0000 7efd66d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd68159440 0x7efd680c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55856/0 (socket says 172.21.15.60:55856) 2023-10-06T04:28:14.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.624+0000 7efd66d9d700 1 -- 172.21.15.60:0/1683182261 learned_addr learned my addr 172.21.15.60:0/1683182261 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:14.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.624+0000 7efd65d9b700 1 --2- 172.21.15.60:0/1683182261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd680b35d0 0x7efd680c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.624+0000 7efd6659c700 1 --2- 172.21.15.60:0/1683182261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd680b2100 0x7efd681552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.624+0000 7efd66d9d700 1 -- 172.21.15.60:0/1683182261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd680b35d0 msgr2=0x7efd680c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:14.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.624+0000 7efd66d9d700 1 --2- 172.21.15.60:0/1683182261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd680b35d0 0x7efd680c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.624+0000 7efd66d9d700 1 -- 172.21.15.60:0/1683182261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd680b2100 msgr2=0x7efd681552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:14.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.624+0000 7efd66d9d700 1 --2- 172.21.15.60:0/1683182261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd680b2100 0x7efd681552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.624+0000 7efd66d9d700 1 -- 172.21.15.60:0/1683182261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd580094f0 con 0x7efd68159440 2023-10-06T04:28:14.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.624+0000 7efd65d9b700 1 --2- 172.21.15.60:0/1683182261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd680b35d0 0x7efd680c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:14.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.624+0000 7efd6659c700 1 --2- 172.21.15.60:0/1683182261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd680b2100 0x7efd681552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:14.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.624+0000 7efd66d9d700 1 --2- 172.21.15.60:0/1683182261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd68159440 0x7efd680c82a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efd60009fa0 tx=0x7efd60009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:14.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.625+0000 7efd567fc700 1 -- 172.21.15.60:0/1683182261 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6000ed20 con 0x7efd68159440 2023-10-06T04:28:14.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.625+0000 7efd567fc700 1 -- 172.21.15.60:0/1683182261 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6000ee80 con 0x7efd68159440 2023-10-06T04:28:14.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.625+0000 7efd567fc700 1 -- 172.21.15.60:0/1683182261 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60014670 con 0x7efd68159440 2023-10-06T04:28:14.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.625+0000 7efd6759e700 1 -- 172.21.15.60:0/1683182261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6815a040 con 0x7efd68159440 2023-10-06T04:28:14.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.625+0000 7efd6759e700 1 -- 172.21.15.60:0/1683182261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6815d510 con 0x7efd68159440 2023-10-06T04:28:14.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.627+0000 7efd567fc700 1 -- 172.21.15.60:0/1683182261 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd600149e0 con 0x7efd68159440 2023-10-06T04:28:14.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.628+0000 7efd567fc700 1 --2- 172.21.15.60:0/1683182261 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7efd48066f30 0x7efd480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.628+0000 7efd567fc700 1 -- 172.21.15.60:0/1683182261 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7efd600851c0 con 0x7efd68159440 2023-10-06T04:28:14.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.628+0000 7efd6659c700 1 --2- 172.21.15.60:0/1683182261 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7efd48066f30 0x7efd480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.629+0000 7efd6659c700 1 --2- 172.21.15.60:0/1683182261 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7efd48066f30 0x7efd480693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efd580099b0 tx=0x7efd58017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:14.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.630+0000 7efd7b4b0b80 1 Processor -- start 2023-10-06T04:28:14.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.630+0000 7efd7b4b0b80 1 -- start start 2023-10-06T04:28:14.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.631+0000 7efd7b4b0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445ccba950 0x56445ccbad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.631+0000 7efd7b4b0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445cd04bc0 0x56445cce3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.631+0000 7efd7b4b0b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445cce3e60 0x56445ccb6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.631+0000 7efd7b4b0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445cc3ac80 con 0x56445ccba950 2023-10-06T04:28:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.631+0000 7efd7b4b0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445cc11a70 con 0x56445cd04bc0 2023-10-06T04:28:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.631+0000 7efd7b4b0b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x56445cc0f270 con 0x56445cce3e60 2023-10-06T04:28:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.631+0000 7efd6659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445ccba950 0x56445ccbad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.631+0000 7efd6659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445ccba950 0x56445ccbad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55868/0 (socket says 172.21.15.60:55868) 2023-10-06T04:28:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.631+0000 7efd6659c700 1 -- 172.21.15.60:0/4187295147 learned_addr learned my addr 172.21.15.60:0/4187295147 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:14.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.631+0000 7efd65d9b700 1 --2- 172.21.15.60:0/4187295147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445cd04bc0 0x56445cce3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.631+0000 7efd66d9d700 1 --2- 172.21.15.60:0/4187295147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445cce3e60 0x56445ccb6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.631+0000 7efd6659c700 1 -- 172.21.15.60:0/4187295147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445cce3e60 msgr2=0x56445ccb6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:14.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.631+0000 7efd6659c700 1 --2- 172.21.15.60:0/4187295147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445cce3e60 0x56445ccb6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.631+0000 7efd6659c700 1 -- 172.21.15.60:0/4187295147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445cd04bc0 msgr2=0x56445cce3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:14.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.631+0000 7efd6659c700 1 --2- 172.21.15.60:0/4187295147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445cd04bc0 0x56445cce3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.631+0000 7efd6659c700 1 -- 172.21.15.60:0/4187295147 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56445caa5270 con 0x56445ccba950 2023-10-06T04:28:14.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.632+0000 7efd6659c700 1 --2- 172.21.15.60:0/4187295147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445ccba950 0x56445ccbad20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efd58006d00 tx=0x7efd5801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee3a54bcb660a15 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:14.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.632+0000 7efd477fe700 1 -- 172.21.15.60:0/4187295147 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd58011b90 con 0x56445ccba950 2023-10-06T04:28:14.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.632+0000 7efd477fe700 1 -- 172.21.15.60:0/4187295147 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd58011cf0 con 0x56445ccba950 2023-10-06T04:28:14.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.632+0000 7efd477fe700 1 -- 172.21.15.60:0/4187295147 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5801c670 con 0x56445ccba950 2023-10-06T04:28:14.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.633+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/4187295147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445ccba950 msgr2=0x56445ccbad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.633+0000 7efd7b4b0b80 1 --2- 172.21.15.60:0/4187295147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445ccba950 0x56445ccbad20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efd58006d00 tx=0x7efd5801e040 comp rx=0 tx=0).stop 2023-10-06T04:28:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.633+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/4187295147 shutdown_connections 2023-10-06T04:28:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.633+0000 7efd7b4b0b80 1 --2- 172.21.15.60:0/4187295147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445ccba950 0x56445ccbad20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.633+0000 7efd7b4b0b80 1 --2- 172.21.15.60:0/4187295147 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445cce3e60 0x56445ccb6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.633+0000 7efd7b4b0b80 1 --2- 172.21.15.60:0/4187295147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445cd04bc0 0x56445cce3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.633+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/4187295147 >> 172.21.15.60:0/4187295147 conn(0x56445ccbc270 msgr2=0x56445ccbc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.633+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/4187295147 shutdown_connections 2023-10-06T04:28:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.633+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/4187295147 wait complete. 2023-10-06T04:28:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.634+0000 7efd7b4b0b80 1 -- start start 2023-10-06T04:28:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.634+0000 7efd7b4b0b80 1 Processor -- start 2023-10-06T04:28:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.635+0000 7efd7b4b0b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445ccba950 0x56445cccdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.635+0000 7efd7b4b0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445cce3e60 0x56445ccf8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.635+0000 7efd7b4b0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445cd04bc0 0x56445ccb11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.635+0000 7efd7b4b0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445cc0b060 con 0x56445cce3e60 2023-10-06T04:28:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.635+0000 7efd7b4b0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445cbb6890 con 0x56445cd04bc0 2023-10-06T04:28:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.635+0000 7efd7b4b0b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x56445cbd1ea0 con 0x56445ccba950 2023-10-06T04:28:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.635+0000 7efd7b4b0b80 10 client.0 _ll_register_callbacks cb 0x56445caa7f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:28:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.635+0000 7efd65d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445cce3e60 0x56445ccf8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.635+0000 7efd65d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445cce3e60 0x56445ccf8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55872/0 (socket says 172.21.15.60:55872) 2023-10-06T04:28:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.635+0000 7efd65d9b700 1 -- 172.21.15.60:0/1256168135 learned_addr learned my addr 172.21.15.60:0/1256168135 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.635+0000 7efd6659c700 1 --2- 172.21.15.60:0/1256168135 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445ccba950 0x56445cccdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.635+0000 7efd66d9d700 1 --2- 172.21.15.60:0/1256168135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445cd04bc0 0x56445ccb11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.635+0000 7efd65d9b700 1 -- 172.21.15.60:0/1256168135 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445ccba950 msgr2=0x56445cccdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:14.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.635+0000 7efd65d9b700 1 --2- 172.21.15.60:0/1256168135 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445ccba950 0x56445cccdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.635+0000 7efd65d9b700 1 -- 172.21.15.60:0/1256168135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445cd04bc0 msgr2=0x56445ccb11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:14.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.635+0000 7efd65d9b700 1 --2- 172.21.15.60:0/1256168135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445cd04bc0 0x56445ccb11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.635+0000 7efd65d9b700 1 -- 172.21.15.60:0/1256168135 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd58022070 con 0x56445cce3e60 2023-10-06T04:28:14.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.635+0000 7efd66d9d700 1 --2- 172.21.15.60:0/1256168135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445cd04bc0 0x56445ccb11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:14.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.636+0000 7efd65d9b700 1 --2- 172.21.15.60:0/1256168135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445cce3e60 0x56445ccf8b50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efd6815c6f0 tx=0x7efd5c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4d2fcd57c85663 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:14.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.636+0000 7efd44ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-06T04:28:14.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.636+0000 7efd44ff9700 1 -- 172.21.15.60:0/1256168135 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c0133f0 con 0x56445cce3e60 2023-10-06T04:28:14.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.636+0000 7efd44ff9700 1 -- 172.21.15.60:0/1256168135 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7efd5c013550 con 0x56445cce3e60 2023-10-06T04:28:14.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.636+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/1256168135 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56445ccaf690 con 0x56445cce3e60 2023-10-06T04:28:14.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.636+0000 7efd44ff9700 1 -- 172.21.15.60:0/1256168135 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd5c0059d0 con 0x56445cce3e60 2023-10-06T04:28:14.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.636+0000 7efd7b4b0b80 10 client.4449 fetch_fsmap learned FSMap version 7 2023-10-06T04:28:14.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.636+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/1256168135 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56445ca47fe0 con 0x56445cce3e60 2023-10-06T04:28:14.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.636+0000 7efd44ff9700 1 -- 172.21.15.60:0/1256168135 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56445ccaf690 con 0x56445cce3e60 2023-10-06T04:28:14.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.636+0000 7efd44ff9700 1 -- 172.21.15.60:0/1256168135 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7efd5c012070 con 0x56445cce3e60 2023-10-06T04:28:14.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.637+0000 7efd7b4b0b80 10 client.4449 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T04:28:14.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.637+0000 7efd7b4b0b80 10 client.4449 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T04:28:14.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.637+0000 7efd7b4b0b80 20 client.4449 populate_metadata read hostname 'smithi060' 2023-10-06T04:28:14.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.637+0000 7efd7b4b0b80 1 --2- 172.21.15.60:0/1256168135 >> [v2:172.21.15.60:6834/1424722915,v1:172.21.15.60:6836/1424722915] conn(0x56445cce2510 0x56445cce28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.637+0000 7efd7b4b0b80 4 client.4449 mds_command: new command op to 4281 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:28:14.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.637+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/1256168135 --> [v2:172.21.15.60:6834/1424722915,v1:172.21.15.60:6836/1424722915] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56445cc8c5c0 con 0x56445cce2510 2023-10-06T04:28:14.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.637+0000 7efd6659c700 1 --2- 172.21.15.60:0/1256168135 >> [v2:172.21.15.60:6834/1424722915,v1:172.21.15.60:6836/1424722915] conn(0x56445cce2510 0x56445cce28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.637+0000 7efd6659c700 1 --2- 172.21.15.60:0/1256168135 >> [v2:172.21.15.60:6834/1424722915,v1:172.21.15.60:6836/1424722915] conn(0x56445cce2510 0x56445cce28e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79d4d0c69e5bf3bd server_cookie=b745cb0531134946 in_seq=0 out_seq=0 2023-10-06T04:28:14.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.637+0000 7efd44ff9700 10 client.4449 ms_handle_connect on v2:172.21.15.60:6834/1424722915 2023-10-06T04:28:14.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.638+0000 7efd44ff9700 1 -- 172.21.15.60:0/1256168135 <== mds.0 v2:172.21.15.60:6834/1424722915 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56445cc8c5c0 con 0x56445cce2510 2023-10-06T04:28:14.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.638+0000 7efd44ff9700 10 client.4449 handle_command_reply: tid=0 2023-10-06T04:28:14.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.638+0000 7efd7b4b0b80 1 client.4449 shutdown 2023-10-06T04:28:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.638+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/1256168135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445cce3e60 msgr2=0x56445ccf8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.638+0000 7efd7b4b0b80 1 --2- 172.21.15.60:0/1256168135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445cce3e60 0x56445ccf8b50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efd6815c6f0 tx=0x7efd5c009040 comp rx=0 tx=0).stop 2023-10-06T04:28:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.638+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/1256168135 shutdown_connections 2023-10-06T04:28:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.638+0000 7efd7b4b0b80 1 --2- 172.21.15.60:0/1256168135 >> [v2:172.21.15.60:6834/1424722915,v1:172.21.15.60:6836/1424722915] conn(0x56445cce2510 0x56445cce28e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.638+0000 7efd7b4b0b80 1 --2- 172.21.15.60:0/1256168135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445cd04bc0 0x56445ccb11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.638+0000 7efd44ff9700 0 client.4449 ms_handle_reset on v2:172.21.15.60:6834/1424722915 2023-10-06T04:28:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.638+0000 7efd7b4b0b80 1 --2- 172.21.15.60:0/1256168135 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445ccba950 0x56445cccdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.638+0000 7efd7b4b0b80 1 --2- 172.21.15.60:0/1256168135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445cce3e60 0x56445ccf8b50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.638+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/1256168135 >> 172.21.15.60:0/1256168135 conn(0x56445ccbc270 msgr2=0x56445cd004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.639+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/1256168135 shutdown_connections 2023-10-06T04:28:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.639+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/1256168135 wait complete. 2023-10-06T04:28:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.639+0000 7efd7b4b0b80 20 client.4449 trim_cache size 0 max 16384 2023-10-06T04:28:14.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.656+0000 7efd7b4b0b80 1 Processor -- start 2023-10-06T04:28:14.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.656+0000 7efd7b4b0b80 1 -- start start 2023-10-06T04:28:14.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.657+0000 7efd7b4b0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445ccba950 0x56445ccb7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.657+0000 7efd7b4b0b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445cce3e60 0x56445ccdff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.657+0000 7efd7b4b0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445cd04bc0 0x56445cce04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.657+0000 7efd7b4b0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445ca8de30 con 0x56445ccba950 2023-10-06T04:28:14.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.657+0000 7efd7b4b0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445ccb1bb0 con 0x56445cd04bc0 2023-10-06T04:28:14.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.657+0000 7efd7b4b0b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x56445ccfa3c0 con 0x56445cce3e60 2023-10-06T04:28:14.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.657+0000 7efd6659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445ccba950 0x56445ccb7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.657+0000 7efd6659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445ccba950 0x56445ccb7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55882/0 (socket says 172.21.15.60:55882) 2023-10-06T04:28:14.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.657+0000 7efd6659c700 1 -- 172.21.15.60:0/3864041397 learned_addr learned my addr 172.21.15.60:0/3864041397 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:14.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.658+0000 7efd66d9d700 1 --2- 172.21.15.60:0/3864041397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445cd04bc0 0x56445cce04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.658+0000 7efd65d9b700 1 --2- 172.21.15.60:0/3864041397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445cce3e60 0x56445ccdff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.658+0000 7efd6659c700 1 -- 172.21.15.60:0/3864041397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445cce3e60 msgr2=0x56445ccdff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:14.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.658+0000 7efd6659c700 1 --2- 172.21.15.60:0/3864041397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445cce3e60 0x56445ccdff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.658+0000 7efd6659c700 1 -- 172.21.15.60:0/3864041397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445cd04bc0 msgr2=0x56445cce04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:14.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.658+0000 7efd6659c700 1 --2- 172.21.15.60:0/3864041397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445cd04bc0 0x56445cce04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.658+0000 7efd6659c700 1 -- 172.21.15.60:0/3864041397 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56445cbd9780 con 0x56445ccba950 2023-10-06T04:28:14.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.658+0000 7efd65d9b700 1 --2- 172.21.15.60:0/3864041397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445cce3e60 0x56445ccdff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:14.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.658+0000 7efd6659c700 1 --2- 172.21.15.60:0/3864041397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445ccba950 0x56445ccb7140 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efd580030c0 tx=0x7efd58039250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e472b9ee3e524543 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:14.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.658+0000 7efd47fff700 1 -- 172.21.15.60:0/3864041397 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd58011a40 con 0x56445ccba950 2023-10-06T04:28:14.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.658+0000 7efd47fff700 1 -- 172.21.15.60:0/3864041397 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5801c440 con 0x56445ccba950 2023-10-06T04:28:14.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.658+0000 7efd47fff700 1 -- 172.21.15.60:0/3864041397 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5801c5d0 con 0x56445ccba950 2023-10-06T04:28:14.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.658+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/3864041397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445ccba950 msgr2=0x56445ccb7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:14.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.658+0000 7efd7b4b0b80 1 --2- 172.21.15.60:0/3864041397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445ccba950 0x56445ccb7140 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efd580030c0 tx=0x7efd58039250 comp rx=0 tx=0).stop 2023-10-06T04:28:14.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.659+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/3864041397 shutdown_connections 2023-10-06T04:28:14.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.659+0000 7efd7b4b0b80 1 --2- 172.21.15.60:0/3864041397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445ccba950 0x56445ccb7140 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.659+0000 7efd7b4b0b80 1 --2- 172.21.15.60:0/3864041397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445cd04bc0 0x56445cce04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.659+0000 7efd7b4b0b80 1 --2- 172.21.15.60:0/3864041397 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445cce3e60 0x56445ccdff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.659+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/3864041397 >> 172.21.15.60:0/3864041397 conn(0x56445ccbc270 msgr2=0x56445ccbc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:14.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.659+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/3864041397 shutdown_connections 2023-10-06T04:28:14.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.659+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/3864041397 wait complete. 2023-10-06T04:28:14.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.659+0000 7efd7b4b0b80 1 -- start start 2023-10-06T04:28:14.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.659+0000 7efd7b4b0b80 1 Processor -- start 2023-10-06T04:28:14.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.660+0000 7efd7b4b0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445ccba950 0x56445cd664b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.660+0000 7efd7b4b0b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445cce3e60 0x56445cce1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.660+0000 7efd7b4b0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445cd04bc0 0x56445cd180b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.668 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.660+0000 7efd7b4b0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445cd04270 con 0x56445cd04bc0 2023-10-06T04:28:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.660+0000 7efd7b4b0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445cce0da0 con 0x56445ccba950 2023-10-06T04:28:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.660+0000 7efd7b4b0b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x56445cd669f0 con 0x56445cce3e60 2023-10-06T04:28:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.660+0000 7efd7b4b0b80 10 client.0 _ll_register_callbacks cb 0x56445caa7f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:28:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.661+0000 7efd66d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445cd04bc0 0x56445cd180b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.661+0000 7efd66d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445cd04bc0 0x56445cd180b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55884/0 (socket says 172.21.15.60:55884) 2023-10-06T04:28:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.661+0000 7efd66d9d700 1 -- 172.21.15.60:0/3576518372 learned_addr learned my addr 172.21.15.60:0/3576518372 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.661+0000 7efd6659c700 1 --2- 172.21.15.60:0/3576518372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445ccba950 0x56445cd664b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.661+0000 7efd65d9b700 1 --2- 172.21.15.60:0/3576518372 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445cce3e60 0x56445cce1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.661+0000 7efd66d9d700 1 -- 172.21.15.60:0/3576518372 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445cce3e60 msgr2=0x56445cce1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.661+0000 7efd66d9d700 1 --2- 172.21.15.60:0/3576518372 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445cce3e60 0x56445cce1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.661+0000 7efd66d9d700 1 -- 172.21.15.60:0/3576518372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445ccba950 msgr2=0x56445cd664b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.661+0000 7efd66d9d700 1 --2- 172.21.15.60:0/3576518372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445ccba950 0x56445cd664b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.661+0000 7efd66d9d700 1 -- 172.21.15.60:0/3576518372 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56445caa5270 con 0x56445cd04bc0 2023-10-06T04:28:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.661+0000 7efd66d9d700 1 --2- 172.21.15.60:0/3576518372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445cd04bc0 0x56445cd180b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efd60055b90 tx=0x7efd60058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf847fe029f2b22 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.661+0000 7efd44ff9700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-06T04:28:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.661+0000 7efd44ff9700 1 -- 172.21.15.60:0/3576518372 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd600550f0 con 0x56445cd04bc0 2023-10-06T04:28:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.661+0000 7efd44ff9700 1 -- 172.21.15.60:0/3576518372 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7efd60055250 con 0x56445cd04bc0 2023-10-06T04:28:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.662+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/3576518372 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd58011cf0 con 0x56445cd04bc0 2023-10-06T04:28:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.662+0000 7efd44ff9700 1 -- 172.21.15.60:0/3576518372 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd6005c920 con 0x56445cd04bc0 2023-10-06T04:28:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.662+0000 7efd7b4b0b80 10 client.4455 fetch_fsmap learned FSMap version 7 2023-10-06T04:28:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.662+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/3576518372 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56445cbc0470 con 0x56445cd04bc0 2023-10-06T04:28:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.662+0000 7efd44ff9700 1 -- 172.21.15.60:0/3576518372 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd60060020 con 0x56445cd04bc0 2023-10-06T04:28:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.662+0000 7efd44ff9700 1 -- 172.21.15.60:0/3576518372 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7efd60059b90 con 0x56445cd04bc0 2023-10-06T04:28:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.662+0000 7efd7b4b0b80 10 client.4455 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T04:28:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.662+0000 7efd7b4b0b80 10 client.4455 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T04:28:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.662+0000 7efd7b4b0b80 20 client.4455 populate_metadata read hostname 'smithi060' 2023-10-06T04:28:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.662+0000 7efd7b4b0b80 1 --2- 172.21.15.60:0/3576518372 >> [v2:172.21.15.60:6834/1424722915,v1:172.21.15.60:6836/1424722915] conn(0x56445cd035c0 0x56445cd03990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.662+0000 7efd7b4b0b80 4 client.4455 mds_command: new command op to 4281 tid=0[{"prefix": "status"}] 2023-10-06T04:28:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.662+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/3576518372 --> [v2:172.21.15.60:6834/1424722915,v1:172.21.15.60:6836/1424722915] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56445cbade00 con 0x56445cd035c0 2023-10-06T04:28:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.662+0000 7efd6659c700 1 --2- 172.21.15.60:0/3576518372 >> [v2:172.21.15.60:6834/1424722915,v1:172.21.15.60:6836/1424722915] conn(0x56445cd035c0 0x56445cd03990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.663+0000 7efd6659c700 1 --2- 172.21.15.60:0/3576518372 >> [v2:172.21.15.60:6834/1424722915,v1:172.21.15.60:6836/1424722915] conn(0x56445cd035c0 0x56445cd03990 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bb4f5c19c11ae27 server_cookie=3cd95298cc16ecf1 in_seq=0 out_seq=0 2023-10-06T04:28:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.663+0000 7efd44ff9700 10 client.4455 ms_handle_connect on v2:172.21.15.60:6834/1424722915 2023-10-06T04:28:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.663+0000 7efd44ff9700 1 -- 172.21.15.60:0/3576518372 <== mds.0 v2:172.21.15.60:6834/1424722915 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x56445cbade00 con 0x56445cd035c0 2023-10-06T04:28:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.663+0000 7efd44ff9700 10 client.4455 handle_command_reply: tid=0 2023-10-06T04:28:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.663+0000 7efd7b4b0b80 1 client.4455 shutdown 2023-10-06T04:28:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.663+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/3576518372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445cd04bc0 msgr2=0x56445cd180b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.663+0000 7efd7b4b0b80 1 --2- 172.21.15.60:0/3576518372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445cd04bc0 0x56445cd180b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efd60055b90 tx=0x7efd60058040 comp rx=0 tx=0).stop 2023-10-06T04:28:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.663+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/3576518372 shutdown_connections 2023-10-06T04:28:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.663+0000 7efd7b4b0b80 1 --2- 172.21.15.60:0/3576518372 >> [v2:172.21.15.60:6834/1424722915,v1:172.21.15.60:6836/1424722915] conn(0x56445cd035c0 0x56445cd03990 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.663+0000 7efd7b4b0b80 1 --2- 172.21.15.60:0/3576518372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56445cd04bc0 0x56445cd180b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.663+0000 7efd7b4b0b80 1 --2- 172.21.15.60:0/3576518372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56445ccba950 0x56445cd664b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.663+0000 7efd7b4b0b80 1 --2- 172.21.15.60:0/3576518372 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56445cce3e60 0x56445cce1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.663+0000 7efd44ff9700 0 client.4455 ms_handle_reset on v2:172.21.15.60:6834/1424722915 2023-10-06T04:28:14.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.663+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/3576518372 >> 172.21.15.60:0/3576518372 conn(0x56445ccbc270 msgr2=0x56445cd14070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:14.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.663+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/3576518372 shutdown_connections 2023-10-06T04:28:14.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.663+0000 7efd7b4b0b80 1 -- 172.21.15.60:0/3576518372 wait complete. 2023-10-06T04:28:14.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.664+0000 7efd7b4b0b80 20 client.4455 trim_cache size 0 max 16384 2023-10-06T04:28:14.674 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-06T04:28:14.674 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "caf6a2b8-149e-4228-9a04-404e2d811afd", 2023-10-06T04:28:14.674 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2023-10-06T04:28:14.674 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4281, 2023-10-06T04:28:14.674 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-06T04:28:14.674 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-06T04:28:14.674 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-06T04:28:14.674 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 7.9291244189999999, 2023-10-06T04:28:14.674 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 7, 2023-10-06T04:28:14.675 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 25, 2023-10-06T04:28:14.675 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 25, 2023-10-06T04:28:14.675 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 14.313395836 2023-10-06T04:28:14.675 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-06T04:28:14.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.664+0000 7efd6759e700 1 -- 172.21.15.60:0/1683182261 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7efd48066f30 msgr2=0x7efd480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:14.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.664+0000 7efd6759e700 1 --2- 172.21.15.60:0/1683182261 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7efd48066f30 0x7efd480693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efd580099b0 tx=0x7efd58017000 comp rx=0 tx=0).stop 2023-10-06T04:28:14.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.664+0000 7efd6759e700 1 -- 172.21.15.60:0/1683182261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd68159440 msgr2=0x7efd680c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:14.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.664+0000 7efd6759e700 1 --2- 172.21.15.60:0/1683182261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd68159440 0x7efd680c82a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efd60009fa0 tx=0x7efd60009900 comp rx=0 tx=0).stop 2023-10-06T04:28:14.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.664+0000 7efd6759e700 1 -- 172.21.15.60:0/1683182261 shutdown_connections 2023-10-06T04:28:14.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.664+0000 7efd6759e700 1 --2- 172.21.15.60:0/1683182261 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7efd48066f30 0x7efd480693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.664+0000 7efd6759e700 1 --2- 172.21.15.60:0/1683182261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd68159440 0x7efd680c82a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.664+0000 7efd6759e700 1 --2- 172.21.15.60:0/1683182261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd680b2100 0x7efd681552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.664+0000 7efd6759e700 1 --2- 172.21.15.60:0/1683182261 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd680b35d0 0x7efd680c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.664+0000 7efd6759e700 1 -- 172.21.15.60:0/1683182261 >> 172.21.15.60:0/1683182261 conn(0x7efd6806ece0 msgr2=0x7efd6806f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:14.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.664+0000 7efd6759e700 1 -- 172.21.15.60:0/1683182261 shutdown_connections 2023-10-06T04:28:14.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.664+0000 7efd6759e700 1 -- 172.21.15.60:0/1683182261 wait complete. 2023-10-06T04:28:14.682 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:28:14.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.868+0000 7f6c48f9d700 1 Processor -- start 2023-10-06T04:28:14.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.868+0000 7f6c48f9d700 1 -- start start 2023-10-06T04:28:14.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.869+0000 7f6c48f9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6c440cbc30 0x7f6c440cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.869+0000 7f6c48f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6c440b2100 0x7f6c440b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.869+0000 7f6c48f9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c440cb7a0 con 0x7f6c44159440 2023-10-06T04:28:14.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.869+0000 7f6c48f9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c440b0860 con 0x7f6c440cbc30 2023-10-06T04:28:14.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.869+0000 7f6c48f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c440cb150 con 0x7f6c440b2100 2023-10-06T04:28:14.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.869+0000 7f6c42ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6c440cbc30 0x7f6c440cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.870+0000 7f6c42ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6c440cbc30 0x7f6c440cc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55892/0 (socket says 172.21.15.60:55892) 2023-10-06T04:28:14.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.870+0000 7f6c42ffd700 1 -- 172.21.15.60:0/1842555315 learned_addr learned my addr 172.21.15.60:0/1842555315 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:14.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.870+0000 7f6c43fff700 1 --2- 172.21.15.60:0/1842555315 >> v2:172.21.15.135:3300/0 conn(0x7f6c440b2100 0x7f6c440b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.870+0000 7f6c42ffd700 1 -- 172.21.15.60:0/1842555315 >> v2:172.21.15.135:3300/0 conn(0x7f6c440b2100 msgr2=0x7f6c440b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:14.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.870+0000 7f6c42ffd700 1 --2- 172.21.15.60:0/1842555315 >> v2:172.21.15.135:3300/0 conn(0x7f6c440b2100 0x7f6c440b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.870+0000 7f6c42ffd700 1 -- 172.21.15.60:0/1842555315 >> v1:172.21.15.60:6789/0 conn(0x7f6c44159440 legacy=0x7f6c440b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:14.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.870+0000 7f6c42ffd700 1 -- 172.21.15.60:0/1842555315 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c440cb430 con 0x7f6c440cbc30 2023-10-06T04:28:14.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.870+0000 7f6c43fff700 1 --2- 172.21.15.60:0/1842555315 >> v2:172.21.15.135:3300/0 conn(0x7f6c440b2100 0x7f6c440b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:14.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.870+0000 7f6c42ffd700 1 --2- 172.21.15.60:0/1842555315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c440cbc30 0x7f6c440cc080 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6c440ca7f0 tx=0x7f6c38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d32bdc2c7c7be19 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:14.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.870+0000 7f6c427fc700 1 -- 172.21.15.60:0/1842555315 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3800b860 con 0x7f6c440cbc30 2023-10-06T04:28:14.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.870+0000 7f6c427fc700 1 -- 172.21.15.60:0/1842555315 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3800b9c0 con 0x7f6c440cbc30 2023-10-06T04:28:14.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.870+0000 7f6c427fc700 1 -- 172.21.15.60:0/1842555315 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3800bd60 con 0x7f6c440cbc30 2023-10-06T04:28:14.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.871+0000 7f6c48f9d700 1 -- 172.21.15.60:0/1842555315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c440cbc30 msgr2=0x7f6c440cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:14.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.871+0000 7f6c48f9d700 1 --2- 172.21.15.60:0/1842555315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c440cbc30 0x7f6c440cc080 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6c440ca7f0 tx=0x7f6c38009250 comp rx=0 tx=0).stop 2023-10-06T04:28:14.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.871+0000 7f6c48f9d700 1 -- 172.21.15.60:0/1842555315 shutdown_connections 2023-10-06T04:28:14.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.871+0000 7f6c48f9d700 1 --2- 172.21.15.60:0/1842555315 >> v2:172.21.15.135:3300/0 conn(0x7f6c440b2100 0x7f6c440b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.871+0000 7f6c48f9d700 1 --2- 172.21.15.60:0/1842555315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c440cbc30 0x7f6c440cc080 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.871+0000 7f6c48f9d700 1 -- 172.21.15.60:0/1842555315 >> 172.21.15.60:0/1842555315 conn(0x7f6c4406ece0 msgr2=0x7f6c4406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:14.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.871+0000 7f6c48f9d700 1 -- 172.21.15.60:0/1842555315 shutdown_connections 2023-10-06T04:28:14.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.871+0000 7f6c48f9d700 1 -- 172.21.15.60:0/1842555315 wait complete. 2023-10-06T04:28:14.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.873+0000 7f6c48f9d700 1 Processor -- start 2023-10-06T04:28:14.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.873+0000 7f6c48f9d700 1 -- start start 2023-10-06T04:28:14.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.874+0000 7f6c48f9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c440b2100 0x7f6c440c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.874+0000 7f6c48f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c440cbc30 0x7f6c44154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.874+0000 7f6c48f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c44159440 0x7f6c440c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.874+0000 7f6c48f9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c440cddf0 con 0x7f6c440b2100 2023-10-06T04:28:14.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.874+0000 7f6c48f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c440c91f0 con 0x7f6c440cbc30 2023-10-06T04:28:14.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.874+0000 7f6c48f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c440c94d0 con 0x7f6c44159440 2023-10-06T04:28:14.879 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.874+0000 7f6c437fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c440b2100 0x7f6c440c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.874+0000 7f6c437fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c440b2100 0x7f6c440c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55896/0 (socket says 172.21.15.60:55896) 2023-10-06T04:28:14.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.874+0000 7f6c437fe700 1 -- 172.21.15.60:0/2546765238 learned_addr learned my addr 172.21.15.60:0/2546765238 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:14.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.874+0000 7f6c42ffd700 1 --2- 172.21.15.60:0/2546765238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c440cbc30 0x7f6c44154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.874+0000 7f6c43fff700 1 --2- 172.21.15.60:0/2546765238 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c44159440 0x7f6c440c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.874+0000 7f6c437fe700 1 -- 172.21.15.60:0/2546765238 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c44159440 msgr2=0x7f6c440c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:14.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.874+0000 7f6c437fe700 1 --2- 172.21.15.60:0/2546765238 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c44159440 0x7f6c440c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.874+0000 7f6c437fe700 1 -- 172.21.15.60:0/2546765238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c440cbc30 msgr2=0x7f6c44154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:14.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.874+0000 7f6c437fe700 1 --2- 172.21.15.60:0/2546765238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c440cbc30 0x7f6c44154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:14.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.874+0000 7f6c437fe700 1 -- 172.21.15.60:0/2546765238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c380094f0 con 0x7f6c440b2100 2023-10-06T04:28:14.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.874+0000 7f6c42ffd700 1 --2- 172.21.15.60:0/2546765238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c440cbc30 0x7f6c44154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:14.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.874+0000 7f6c437fe700 1 --2- 172.21.15.60:0/2546765238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c440b2100 0x7f6c440c8260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400c4e0 tx=0x7f6c3400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:14.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.875+0000 7f6c2b7fe700 1 -- 172.21.15.60:0/2546765238 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c34011590 con 0x7f6c440b2100 2023-10-06T04:28:14.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.875+0000 7f6c2b7fe700 1 -- 172.21.15.60:0/2546765238 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c34011710 con 0x7f6c440b2100 2023-10-06T04:28:14.881 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.875+0000 7f6c2b7fe700 1 -- 172.21.15.60:0/2546765238 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c34011ad0 con 0x7f6c440b2100 2023-10-06T04:28:14.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.875+0000 7f6c48f9d700 1 -- 172.21.15.60:0/2546765238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c440c97b0 con 0x7f6c440b2100 2023-10-06T04:28:14.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.875+0000 7f6c48f9d700 1 -- 172.21.15.60:0/2546765238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c440c5260 con 0x7f6c440b2100 2023-10-06T04:28:14.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.876+0000 7f6c48f9d700 1 -- 172.21.15.60:0/2546765238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c440c4de0 con 0x7f6c440b2100 2023-10-06T04:28:14.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.877+0000 7f6c2b7fe700 1 -- 172.21.15.60:0/2546765238 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c3401b3b0 con 0x7f6c440b2100 2023-10-06T04:28:14.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.877+0000 7f6c2b7fe700 1 --2- 172.21.15.60:0/2546765238 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6c30066f30 0x7f6c300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:14.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.878+0000 7f6c2b7fe700 1 -- 172.21.15.60:0/2546765238 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6c34083f50 con 0x7f6c440b2100 2023-10-06T04:28:14.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.878+0000 7f6c42ffd700 1 --2- 172.21.15.60:0/2546765238 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6c30066f30 0x7f6c300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:14.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.878+0000 7f6c42ffd700 1 --2- 172.21.15.60:0/2546765238 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6c30066f30 0x7f6c300693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6c440ca7f0 tx=0x7f6c38017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:14.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:14.881+0000 7f6c2b7fe700 1 -- 172.21.15.60:0/2546765238 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c440c4de0 con 0x7f6c440b2100 2023-10-06T04:28:15.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:15.133+0000 7f6c48f9d700 1 -- 172.21.15.60:0/2546765238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6c440c4de0 con 0x7f6c440b2100 2023-10-06T04:28:15.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:15.133+0000 7f6c2b7fe700 1 -- 172.21.15.60:0/2546765238 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f6c440c4de0 con 0x7f6c440b2100 2023-10-06T04:28:15.135 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T04:28:15.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:15.135+0000 7f6c48f9d700 1 -- 172.21.15.60:0/2546765238 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6c30066f30 msgr2=0x7f6c300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:15.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:15.135+0000 7f6c48f9d700 1 --2- 172.21.15.60:0/2546765238 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6c30066f30 0x7f6c300693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6c440ca7f0 tx=0x7f6c38017000 comp rx=0 tx=0).stop 2023-10-06T04:28:15.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:15.135+0000 7f6c48f9d700 1 -- 172.21.15.60:0/2546765238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c440b2100 msgr2=0x7f6c440c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:15.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:15.135+0000 7f6c48f9d700 1 --2- 172.21.15.60:0/2546765238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c440b2100 0x7f6c440c8260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400c4e0 tx=0x7f6c3400c8a0 comp rx=0 tx=0).stop 2023-10-06T04:28:15.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:15.136+0000 7f6c48f9d700 1 -- 172.21.15.60:0/2546765238 shutdown_connections 2023-10-06T04:28:15.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:15.136+0000 7f6c48f9d700 1 --2- 172.21.15.60:0/2546765238 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6c30066f30 0x7f6c300693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:15.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:15.136+0000 7f6c48f9d700 1 --2- 172.21.15.60:0/2546765238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c440b2100 0x7f6c440c8260 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:15.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:15.136+0000 7f6c48f9d700 1 --2- 172.21.15.60:0/2546765238 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c44159440 0x7f6c440c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:15.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:15.136+0000 7f6c48f9d700 1 --2- 172.21.15.60:0/2546765238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c440cbc30 0x7f6c44154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:15.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:15.136+0000 7f6c48f9d700 1 -- 172.21.15.60:0/2546765238 >> 172.21.15.60:0/2546765238 conn(0x7f6c4406ece0 msgr2=0x7f6c4415bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:15.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:15.136+0000 7f6c48f9d700 1 -- 172.21.15.60:0/2546765238 shutdown_connections 2023-10-06T04:28:15.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:15.136+0000 7f6c48f9d700 1 -- 172.21.15.60:0/2546765238 wait complete. 2023-10-06T04:28:15.154 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T04:28:15.154 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:28:15.154 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-10-06T04:28:15.154 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-06T04:28:15.155 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:28:15.155 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T04:28:15.155 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:28:15.155 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:28:15.155 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T04:28:15.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:15.155 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-10-06T04:28:15.192 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:28:15.192 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:28:15.192 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:28:15.192 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:15.192 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-06T04:28:15.193 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:15.193 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:28:15.193 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:15.193 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2023-10-06T04:28:15.193 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:28:15.193 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:15.193 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2023-10-06T04:28:15.193 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:28:15.193 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:15.194 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2023-10-06T04:28:15.194 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T04:28:15.194 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42278sec preferred_lft 42278sec 2023-10-06T04:28:15.194 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-10-06T04:28:15.194 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:15.194 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:28:15.194 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:15.194 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2023-10-06T04:28:15.197 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T04:28:15.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:15.198 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-06T04:28:15.198 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-06T04:28:15.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add name ceph-brx type bridge 2023-10-06T04:28:15.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr flush dev ceph-brx 2023-10-06T04:28:15.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set ceph-brx up 2023-10-06T04:28:15.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T04:28:15.198 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-06T04:28:15.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:15.651 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:28:15.716 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-10-06T04:28:15.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:15.719 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-10-06T04:28:15.769 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-10-06T04:28:15.769 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:28:15.769 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T04:28:15.769 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T04:28:15.769 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:28:15.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:15.771 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-06T04:28:15.771 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-06T04:28:15.771 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:28:15.771 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:28:15.771 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:28:15.771 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-06T04:28:16.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:16.797 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-06T04:28:16.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:16.836 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list-id 2023-10-06T04:28:16.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:16.914 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-06T04:28:16.914 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-06T04:28:16.914 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T04:28:16.914 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-06T04:28:16.914 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-06T04:28:17.084 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-06T04:28:17.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:17.084 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-06T04:28:17.084 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-06T04:28:17.084 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-06T04:28:17.084 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T04:28:17.085 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-06T04:28:17.085 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-06T04:28:17.085 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-06T04:28:17.085 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-06T04:28:17.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:17.342 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-06T04:28:17.342 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-06T04:28:17.342 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2023-10-06T04:28:17.342 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T04:28:17.342 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-06T04:28:17.502 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-06T04:28:17.502 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:28:17.502 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:28:17.539 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T04:28:17.539 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:28:17.540 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:28:17.615 DEBUG:teuthology.orchestra.run.smithi060:> sudo modprobe fuse 2023-10-06T04:28:17.718 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:28:17.719 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:28:17.779 INFO:teuthology.orchestra.run.smithi060.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:28:17.781 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:28:17.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:28:17.782 DEBUG:teuthology.orchestra.run.smithi060:> ls /sys/fs/fuse/connections 2023-10-06T04:28:17.819 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T04:28:17.819 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-06T04:28:17.864 DEBUG:teuthology.orchestra.run.smithi060:> sudo modprobe fuse 2023-10-06T04:28:17.926 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:28:17.927 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:28:17.989 INFO:teuthology.orchestra.run.smithi060.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:28:17.992 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:28:17.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:28:17.992 DEBUG:teuthology.orchestra.run.smithi060:> ls /sys/fs/fuse/connections 2023-10-06T04:28:18.032 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi060.stderr:2023-10-06T04:28:18.030+0000 7f8a66188540 -1 init, newargv = 0x55ec675c84d0 newargc=15 2023-10-06T04:28:18.032 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi060.stderr:ceph-fuse[91271]: starting ceph client 2023-10-06T04:28:18.042 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi060.stderr:ceph-fuse[91271]: starting fuse 2023-10-06T04:28:19.133 DEBUG:teuthology.orchestra.run.smithi060:> sudo modprobe fuse 2023-10-06T04:28:19.204 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:28:19.204 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T04:28:19.267 INFO:teuthology.orchestra.run.smithi060.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T04:28:19.269 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T04:28:19.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:28:19.270 DEBUG:teuthology.orchestra.run.smithi060:> ls /sys/fs/fuse/connections 2023-10-06T04:28:19.307 INFO:teuthology.orchestra.run.smithi060.stdout:44 2023-10-06T04:28:19.307 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2023-10-06T04:28:19.307 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T04:28:19.307 DEBUG:teuthology.orchestra.run.smithi060:> import glob 2023-10-06T04:28:19.307 DEBUG:teuthology.orchestra.run.smithi060:> import re 2023-10-06T04:28:19.307 DEBUG:teuthology.orchestra.run.smithi060:> import os 2023-10-06T04:28:19.307 DEBUG:teuthology.orchestra.run.smithi060:> import subprocess 2023-10-06T04:28:19.309 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-06T04:28:19.309 DEBUG:teuthology.orchestra.run.smithi060:> def _find_admin_socket(client_name): 2023-10-06T04:28:19.309 DEBUG:teuthology.orchestra.run.smithi060:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-06T04:28:19.309 DEBUG:teuthology.orchestra.run.smithi060:> files = glob.glob(asok_path) 2023-10-06T04:28:19.309 DEBUG:teuthology.orchestra.run.smithi060:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-06T04:28:19.309 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-06T04:28:19.309 DEBUG:teuthology.orchestra.run.smithi060:> # Given a non-glob path, it better be there 2023-10-06T04:28:19.309 DEBUG:teuthology.orchestra.run.smithi060:> if "*" not in asok_path: 2023-10-06T04:28:19.309 DEBUG:teuthology.orchestra.run.smithi060:> assert(len(files) == 1) 2023-10-06T04:28:19.309 DEBUG:teuthology.orchestra.run.smithi060:> return files[0] 2023-10-06T04:28:19.310 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-06T04:28:19.310 DEBUG:teuthology.orchestra.run.smithi060:> for f in files: 2023-10-06T04:28:19.310 DEBUG:teuthology.orchestra.run.smithi060:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T04:28:19.310 DEBUG:teuthology.orchestra.run.smithi060:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T04:28:19.310 DEBUG:teuthology.orchestra.run.smithi060:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T04:28:19.310 DEBUG:teuthology.orchestra.run.smithi060:> contents = proc_f.read() 2023-10-06T04:28:19.310 DEBUG:teuthology.orchestra.run.smithi060:> if mountpoint in contents: 2023-10-06T04:28:19.310 DEBUG:teuthology.orchestra.run.smithi060:> return f 2023-10-06T04:28:19.310 DEBUG:teuthology.orchestra.run.smithi060:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T04:28:19.310 DEBUG:teuthology.orchestra.run.smithi060:> 2023-10-06T04:28:19.310 DEBUG:teuthology.orchestra.run.smithi060:> print(_find_admin_socket("client.admin")) 2023-10-06T04:28:19.311 DEBUG:teuthology.orchestra.run.smithi060:> ' 2023-10-06T04:28:19.486 INFO:teuthology.orchestra.run.smithi060.stdout:/var/run/ceph/ceph-client.admin.91271.asok 2023-10-06T04:28:19.663 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.91271.asok 2023-10-06T04:28:19.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:28:19.664 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.91271.asok status 2023-10-06T04:28:19.880 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-06T04:28:19.880 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": { 2023-10-06T04:28:19.880 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T04:28:19.880 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T04:28:19.880 INFO:teuthology.orchestra.run.smithi060.stdout: "entity_id": "admin", 2023-10-06T04:28:19.880 INFO:teuthology.orchestra.run.smithi060.stdout: "hostname": "smithi060", 2023-10-06T04:28:19.880 INFO:teuthology.orchestra.run.smithi060.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-06T04:28:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: "pid": "91271", 2023-10-06T04:28:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: "root": "/" 2023-10-06T04:28:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:28:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: "dentry_count": 0, 2023-10-06T04:28:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: "dentry_pinned_count": 0, 2023-10-06T04:28:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4473, 2023-10-06T04:28:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: "inst": { 2023-10-06T04:28:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: "name": { 2023-10-06T04:28:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2023-10-06T04:28:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4473 2023-10-06T04:28:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:28:19.881 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": { 2023-10-06T04:28:19.882 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-06T04:28:19.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "192.168.0.1:0", 2023-10-06T04:28:19.882 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3610459142 2023-10-06T04:28:19.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:28:19.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:28:19.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": { 2023-10-06T04:28:19.882 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2023-10-06T04:28:19.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "192.168.0.1:0", 2023-10-06T04:28:19.882 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3610459142 2023-10-06T04:28:19.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:28:19.882 INFO:teuthology.orchestra.run.smithi060.stdout: "inst_str": "client.4473 192.168.0.1:0/3610459142", 2023-10-06T04:28:19.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addr_str": "192.168.0.1:0/3610459142", 2023-10-06T04:28:19.883 INFO:teuthology.orchestra.run.smithi060.stdout: "inode_count": 1, 2023-10-06T04:28:19.883 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_epoch": 7, 2023-10-06T04:28:19.883 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_epoch": 25, 2023-10-06T04:28:19.883 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_epoch_barrier": 0, 2023-10-06T04:28:19.883 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklisted": false, 2023-10-06T04:28:19.883 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs" 2023-10-06T04:28:19.883 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-06T04:28:19.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:28:19.892 DEBUG:teuthology.orchestra.run.smithi060:> stat --file-system '--printf=%T 2023-10-06T04:28:19.892 DEBUG:teuthology.orchestra.run.smithi060:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:28:19.930 INFO:teuthology.orchestra.run.smithi060.stdout:fuseblk 2023-10-06T04:28:19.931 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:28:19.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:28:19.931 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:28:20.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:28:20.034 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-06T04:28:20.136 INFO:teuthology.orchestra.run.smithi060.stdout:# file: . 2023-10-06T04:28:20.136 INFO:teuthology.orchestra.run.smithi060.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-06T04:28:20.136 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:20.137 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi060.front.sepia.ceph.com... 2023-10-06T04:28:20.137 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:28:20.137 DEBUG:teuthology.orchestra.run.smithi060:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-06T04:28:20.196 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi060.stderr:ceph-fuse[91271]: fuse finished with error 0 and tester_r 0 2023-10-06T04:28:20.200 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T04:28:20.220 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2023-10-06T04:28:20.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:20.220 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-06T04:28:20.310 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:28:20.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.497+0000 7f68dcd9d700 1 Processor -- start 2023-10-06T04:28:20.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.497+0000 7f68dcd9d700 1 -- start start 2023-10-06T04:28:20.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.498+0000 7f68dcd9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8153e00 0x7f68d806df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:20.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.498+0000 7f68dcd9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d80c9cc0 con 0x7f68d806a590 2023-10-06T04:28:20.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.498+0000 7f68dcd9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d80c6710 con 0x7f68d806a960 2023-10-06T04:28:20.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.498+0000 7f68dcd9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d806f560 con 0x7f68d8153e00 2023-10-06T04:28:20.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.498+0000 7f68d77fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f68d806a590 0x7f68d81536f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55166/0 (socket says 172.21.15.60:55166) 2023-10-06T04:28:20.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.498+0000 7f68d77fe700 1 -- 172.21.15.60:0/3385791501 learned_addr learned my addr 172.21.15.60:0/3385791501 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:20.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.499+0000 7f68d6ffd700 1 --2- 172.21.15.60:0/3385791501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8153e00 0x7f68d806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:20.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.499+0000 7f68d67fc700 1 -- 172.21.15.60:0/3385791501 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3390569193 0 0) 0x7f68d80c9cc0 con 0x7f68d806a590 2023-10-06T04:28:20.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.499+0000 7f68d67fc700 1 -- 172.21.15.60:0/3385791501 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68c0003570 con 0x7f68d806a590 2023-10-06T04:28:20.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.499+0000 7f68d67fc700 1 -- 172.21.15.60:0/3385791501 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722260599 0 0) 0x7f68d80c6710 con 0x7f68d806a960 2023-10-06T04:28:20.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.499+0000 7f68d67fc700 1 -- 172.21.15.60:0/3385791501 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68d80c9cc0 con 0x7f68d806a960 2023-10-06T04:28:20.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.499+0000 7f68d67fc700 1 -- 172.21.15.60:0/3385791501 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1234903380 0 0) 0x7f68c0003570 con 0x7f68d806a590 2023-10-06T04:28:20.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.499+0000 7f68d67fc700 1 -- 172.21.15.60:0/3385791501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8153e00 msgr2=0x7f68d806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:20.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.499+0000 7f68d67fc700 1 --2- 172.21.15.60:0/3385791501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8153e00 0x7f68d806df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:20.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.499+0000 7f68d67fc700 1 -- 172.21.15.60:0/3385791501 >> v1:172.21.15.135:6789/0 conn(0x7f68d806a960 legacy=0x7f68d806e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:20.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.499+0000 7f68d67fc700 1 -- 172.21.15.60:0/3385791501 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d806ecc0 con 0x7f68d806a590 2023-10-06T04:28:20.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.499+0000 7f68d67fc700 1 -- 172.21.15.60:0/3385791501 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7f68c8001470 con 0x7f68d806a590 2023-10-06T04:28:20.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.499+0000 7f68d67fc700 1 -- 172.21.15.60:0/3385791501 >> v1:172.21.15.60:6789/0 conn(0x7f68d806a590 legacy=0x7f68d81536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:20.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.499+0000 7f68d67fc700 1 --2- 172.21.15.60:0/3385791501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c0003c20 0x7f68c0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:20.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.499+0000 7f68d67fc700 1 --2- 172.21.15.60:0/3385791501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68c0004810 0x7f68c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:20.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.499+0000 7f68d67fc700 1 --2- 172.21.15.60:0/3385791501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8153e00 0x7f68c0005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:20.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.499+0000 7f68d67fc700 1 -- 172.21.15.60:0/3385791501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d806f560 con 0x7f68c0003c20 2023-10-06T04:28:20.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.499+0000 7f68d67fc700 1 -- 172.21.15.60:0/3385791501 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c000de00 con 0x7f68c0004810 2023-10-06T04:28:20.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.499+0000 7f68d67fc700 1 -- 172.21.15.60:0/3385791501 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c000dfc0 con 0x7f68d8153e00 2023-10-06T04:28:20.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.499+0000 7f68d77fe700 1 --2- 172.21.15.60:0/3385791501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c0003c20 0x7f68c0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:20.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.500+0000 7f68d6ffd700 1 --2- 172.21.15.60:0/3385791501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68c0004810 0x7f68c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:20.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.500+0000 7f68d7fff700 1 --2- 172.21.15.60:0/3385791501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8153e00 0x7f68c0005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:20.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.500+0000 7f68d77fe700 1 -- 172.21.15.60:0/3385791501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8153e00 msgr2=0x7f68c0005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:20.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.500+0000 7f68d77fe700 1 --2- 172.21.15.60:0/3385791501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8153e00 0x7f68c0005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:20.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.500+0000 7f68d77fe700 1 -- 172.21.15.60:0/3385791501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68c0004810 msgr2=0x7f68c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:20.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.500+0000 7f68d77fe700 1 --2- 172.21.15.60:0/3385791501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68c0004810 0x7f68c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:20.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.500+0000 7f68d77fe700 1 -- 172.21.15.60:0/3385791501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c0003570 con 0x7f68c0003c20 2023-10-06T04:28:20.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.500+0000 7f68d77fe700 1 --2- 172.21.15.60:0/3385791501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c0003c20 0x7f68c0004010 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f68c800c210 tx=0x7f68c8001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3ba581d8f2c096 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:20.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.500+0000 7f68d67fc700 1 -- 172.21.15.60:0/3385791501 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c800cc10 con 0x7f68c0003c20 2023-10-06T04:28:20.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.500+0000 7f68d67fc700 1 -- 172.21.15.60:0/3385791501 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c800cd70 con 0x7f68c0003c20 2023-10-06T04:28:20.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.500+0000 7f68d67fc700 1 -- 172.21.15.60:0/3385791501 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c8005b70 con 0x7f68c0003c20 2023-10-06T04:28:20.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.501+0000 7f68dcd9d700 1 -- 172.21.15.60:0/3385791501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c0003c20 msgr2=0x7f68c0004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:20.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.501+0000 7f68dcd9d700 1 --2- 172.21.15.60:0/3385791501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c0003c20 0x7f68c0004010 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f68c800c210 tx=0x7f68c8001d40 comp rx=0 tx=0).stop 2023-10-06T04:28:20.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.501+0000 7f68d7fff700 1 -- 172.21.15.60:0/3385791501 reap_dead start 2023-10-06T04:28:20.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.501+0000 7f68dcd9d700 1 -- 172.21.15.60:0/3385791501 shutdown_connections 2023-10-06T04:28:20.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.501+0000 7f68dcd9d700 1 -- 172.21.15.60:0/3385791501 >> 172.21.15.60:0/3385791501 conn(0x7f68d8068080 msgr2=0x7f68d80cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:20.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.501+0000 7f68dcd9d700 1 -- 172.21.15.60:0/3385791501 shutdown_connections 2023-10-06T04:28:20.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.501+0000 7f68dcd9d700 1 -- 172.21.15.60:0/3385791501 wait complete. 2023-10-06T04:28:20.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.503+0000 7f68dcd9d700 1 Processor -- start 2023-10-06T04:28:20.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.503+0000 7f68dcd9d700 1 -- start start 2023-10-06T04:28:20.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.504+0000 7f68dcd9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c0003c20 0x7f68d8152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:20.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.504+0000 7f68dcd9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68d80c3980 0x7f68d81566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:20.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.504+0000 7f68dcd9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8156bf0 0x7f68d80c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:20.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.504+0000 7f68dcd9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d80c5090 con 0x7f68c0003c20 2023-10-06T04:28:20.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.504+0000 7f68dcd9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d8153160 con 0x7f68d80c3980 2023-10-06T04:28:20.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.504+0000 7f68dcd9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d80c4480 con 0x7f68d8156bf0 2023-10-06T04:28:20.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.504+0000 7f68d77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c0003c20 0x7f68d8152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:20.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.504+0000 7f68d77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c0003c20 0x7f68d8152c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55920/0 (socket says 172.21.15.60:55920) 2023-10-06T04:28:20.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.504+0000 7f68d77fe700 1 -- 172.21.15.60:0/1474573130 learned_addr learned my addr 172.21.15.60:0/1474573130 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:20.514 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.504+0000 7f68d6ffd700 1 --2- 172.21.15.60:0/1474573130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68d80c3980 0x7f68d81566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:20.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.504+0000 7f68d7fff700 1 --2- 172.21.15.60:0/1474573130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8156bf0 0x7f68d80c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:20.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.504+0000 7f68d77fe700 1 -- 172.21.15.60:0/1474573130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8156bf0 msgr2=0x7f68d80c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:20.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.504+0000 7f68d77fe700 1 --2- 172.21.15.60:0/1474573130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8156bf0 0x7f68d80c5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:20.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.504+0000 7f68d77fe700 1 -- 172.21.15.60:0/1474573130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68d80c3980 msgr2=0x7f68d81566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:20.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.504+0000 7f68d77fe700 1 --2- 172.21.15.60:0/1474573130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68d80c3980 0x7f68d81566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:20.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.504+0000 7f68d77fe700 1 -- 172.21.15.60:0/1474573130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d80c4760 con 0x7f68c0003c20 2023-10-06T04:28:20.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.505+0000 7f68d77fe700 1 --2- 172.21.15.60:0/1474573130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c0003c20 0x7f68d8152c20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f68c800c800 tx=0x7f68c8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:20.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.505+0000 7f68bf7fe700 1 -- 172.21.15.60:0/1474573130 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c8007a30 con 0x7f68c0003c20 2023-10-06T04:28:20.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.505+0000 7f68bf7fe700 1 -- 172.21.15.60:0/1474573130 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c8001d40 con 0x7f68c0003c20 2023-10-06T04:28:20.515 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.505+0000 7f68dcd9d700 1 -- 172.21.15.60:0/1474573130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d80c4a40 con 0x7f68c0003c20 2023-10-06T04:28:20.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.505+0000 7f68bf7fe700 1 -- 172.21.15.60:0/1474573130 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c8007300 con 0x7f68c0003c20 2023-10-06T04:28:20.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.505+0000 7f68dcd9d700 1 -- 172.21.15.60:0/1474573130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d80c4110 con 0x7f68c0003c20 2023-10-06T04:28:20.516 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.506+0000 7f68dcd9d700 1 -- 172.21.15.60:0/1474573130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d805f230 con 0x7f68c0003c20 2023-10-06T04:28:20.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.507+0000 7f68bf7fe700 1 -- 172.21.15.60:0/1474573130 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68c8019030 con 0x7f68c0003c20 2023-10-06T04:28:20.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.508+0000 7f68bf7fe700 1 --2- 172.21.15.60:0/1474573130 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f68c4066f30 0x7f68c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:20.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.508+0000 7f68bf7fe700 1 -- 172.21.15.60:0/1474573130 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f68c8085fc0 con 0x7f68c0003c20 2023-10-06T04:28:20.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.508+0000 7f68d6ffd700 1 --2- 172.21.15.60:0/1474573130 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f68c4066f30 0x7f68c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:20.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.509+0000 7f68d6ffd700 1 --2- 172.21.15.60:0/1474573130 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f68c4066f30 0x7f68c40693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f68d8147fd0 tx=0x7f68cc0091a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:20.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.512+0000 7f68bf7fe700 1 -- 172.21.15.60:0/1474573130 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68c8052d40 con 0x7f68c0003c20 2023-10-06T04:28:20.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.716+0000 7f68dcd9d700 1 -- 172.21.15.60:0/1474573130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68d80c5370 con 0x7f68c0003c20 2023-10-06T04:28:20.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.717+0000 7f68bf7fe700 1 -- 172.21.15.60:0/1474573130 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f68c8017090 con 0x7f68c0003c20 2023-10-06T04:28:20.720 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:20.720 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:28:11.290557+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:28:04.355358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:28:05.208550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:28:08.791979+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:28:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.719+0000 7f68dcd9d700 1 -- 172.21.15.60:0/1474573130 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f68c4066f30 msgr2=0x7f68c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:20.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.719+0000 7f68dcd9d700 1 --2- 172.21.15.60:0/1474573130 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f68c4066f30 0x7f68c40693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f68d8147fd0 tx=0x7f68cc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.719+0000 7f68dcd9d700 1 -- 172.21.15.60:0/1474573130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c0003c20 msgr2=0x7f68d8152c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.719+0000 7f68dcd9d700 1 --2- 172.21.15.60:0/1474573130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c0003c20 0x7f68d8152c20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f68c800c800 tx=0x7f68c8015000 comp rx=0 tx=0).stop 2023-10-06T04:28:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.719+0000 7f68dcd9d700 1 -- 172.21.15.60:0/1474573130 shutdown_connections 2023-10-06T04:28:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.719+0000 7f68dcd9d700 1 --2- 172.21.15.60:0/1474573130 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f68c4066f30 0x7f68c40693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.719+0000 7f68dcd9d700 1 --2- 172.21.15.60:0/1474573130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c0003c20 0x7f68d8152c20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.719+0000 7f68dcd9d700 1 --2- 172.21.15.60:0/1474573130 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68d8156bf0 0x7f68d80c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:20.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.719+0000 7f68dcd9d700 1 --2- 172.21.15.60:0/1474573130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68d80c3980 0x7f68d81566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:20.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.719+0000 7f68dcd9d700 1 -- 172.21.15.60:0/1474573130 >> 172.21.15.60:0/1474573130 conn(0x7f68d8068080 msgr2=0x7f68d80c6930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:20.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.720+0000 7f68dcd9d700 1 -- 172.21.15.60:0/1474573130 shutdown_connections 2023-10-06T04:28:20.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.720+0000 7f68dcd9d700 1 -- 172.21.15.60:0/1474573130 wait complete. 2023-10-06T04:28:20.740 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:28:20.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.926+0000 7fc57f39d700 1 Processor -- start 2023-10-06T04:28:20.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.926+0000 7fc57f39d700 1 -- start start 2023-10-06T04:28:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.927+0000 7fc57f39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc578159440 0x7fc5780b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.927+0000 7fc57f39d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc5780b2100 0x7fc5780b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.927+0000 7fc57f39d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5780cb7a0 con 0x7fc5780b35d0 2023-10-06T04:28:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.927+0000 7fc57f39d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5780b0860 con 0x7fc5780b2100 2023-10-06T04:28:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.927+0000 7fc57f39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5780cb150 con 0x7fc578159440 2023-10-06T04:28:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.928+0000 7fc57eb9c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc5780b2100 0x7fc5780b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.928+0000 7fc57eb9c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc5780b2100 0x7fc5780b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55934/0 (socket says 172.21.15.60:55934) 2023-10-06T04:28:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.928+0000 7fc57eb9c700 1 -- 172.21.15.60:0/1117969067 learned_addr learned my addr 172.21.15.60:0/1117969067 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:20.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.928+0000 7fc57e39b700 1 --2- 172.21.15.60:0/1117969067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc578159440 0x7fc5780b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:20.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.928+0000 7fc57eb9c700 1 -- 172.21.15.60:0/1117969067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc578159440 msgr2=0x7fc5780b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:20.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.928+0000 7fc57eb9c700 1 --2- 172.21.15.60:0/1117969067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc578159440 0x7fc5780b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:20.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.928+0000 7fc57eb9c700 1 -- 172.21.15.60:0/1117969067 >> v1:172.21.15.135:6789/0 conn(0x7fc5780b35d0 legacy=0x7fc5780cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:20.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.928+0000 7fc57eb9c700 1 -- 172.21.15.60:0/1117969067 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5780cb430 con 0x7fc5780b2100 2023-10-06T04:28:20.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.928+0000 7fc57e39b700 1 --2- 172.21.15.60:0/1117969067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc578159440 0x7fc5780b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:20.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.928+0000 7fc57eb9c700 1 --2- 172.21.15.60:0/1117969067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5780b2100 0x7fc5780b2580 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc570009f20 tx=0x7fc570009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b6721e71234d95 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:20.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.928+0000 7fc57d399700 1 -- 172.21.15.60:0/1117969067 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57000e070 con 0x7fc5780b2100 2023-10-06T04:28:20.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.929+0000 7fc57d399700 1 -- 172.21.15.60:0/1117969067 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57000ba80 con 0x7fc5780b2100 2023-10-06T04:28:20.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.929+0000 7fc57d399700 1 -- 172.21.15.60:0/1117969067 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5700092e0 con 0x7fc5780b2100 2023-10-06T04:28:20.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.929+0000 7fc57f39d700 1 -- 172.21.15.60:0/1117969067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5780b2100 msgr2=0x7fc5780b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:20.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.929+0000 7fc57f39d700 1 --2- 172.21.15.60:0/1117969067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5780b2100 0x7fc5780b2580 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc570009f20 tx=0x7fc570009840 comp rx=0 tx=0).stop 2023-10-06T04:28:20.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.929+0000 7fc57f39d700 1 -- 172.21.15.60:0/1117969067 shutdown_connections 2023-10-06T04:28:20.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.929+0000 7fc57f39d700 1 --2- 172.21.15.60:0/1117969067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5780b2100 0x7fc5780b2580 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:20.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.929+0000 7fc57f39d700 1 --2- 172.21.15.60:0/1117969067 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc578159440 0x7fc5780b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:20.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.929+0000 7fc57f39d700 1 -- 172.21.15.60:0/1117969067 >> 172.21.15.60:0/1117969067 conn(0x7fc57806ece0 msgr2=0x7fc57806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:20.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.929+0000 7fc57f39d700 1 -- 172.21.15.60:0/1117969067 shutdown_connections 2023-10-06T04:28:20.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.929+0000 7fc57f39d700 1 -- 172.21.15.60:0/1117969067 wait complete. 2023-10-06T04:28:20.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.931+0000 7fc57f39d700 1 Processor -- start 2023-10-06T04:28:20.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.931+0000 7fc57f39d700 1 -- start start 2023-10-06T04:28:20.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.932+0000 7fc57f39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5780b2100 0x7fc5780d05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:20.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.932+0000 7fc57f39d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5780b35d0 0x7fc5780c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:20.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.932+0000 7fc57f39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc578159440 0x7fc578155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:20.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.932+0000 7fc57f39d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5780c9140 con 0x7fc5780b35d0 2023-10-06T04:28:20.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.932+0000 7fc57f39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5780d0de0 con 0x7fc5780b2100 2023-10-06T04:28:20.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.932+0000 7fc57f39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5780cddf0 con 0x7fc578159440 2023-10-06T04:28:20.939 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.932+0000 7fc57db9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5780b35d0 0x7fc5780c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:20.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.932+0000 7fc57db9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5780b35d0 0x7fc5780c7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55942/0 (socket says 172.21.15.60:55942) 2023-10-06T04:28:20.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.932+0000 7fc57db9a700 1 -- 172.21.15.60:0/3031981127 learned_addr learned my addr 172.21.15.60:0/3031981127 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:20.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.932+0000 7fc57e39b700 1 --2- 172.21.15.60:0/3031981127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5780b2100 0x7fc5780d05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:20.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.932+0000 7fc57eb9c700 1 --2- 172.21.15.60:0/3031981127 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc578159440 0x7fc578155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:20.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.932+0000 7fc57db9a700 1 -- 172.21.15.60:0/3031981127 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc578159440 msgr2=0x7fc578155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:20.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.932+0000 7fc57db9a700 1 --2- 172.21.15.60:0/3031981127 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc578159440 0x7fc578155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:20.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.932+0000 7fc57db9a700 1 -- 172.21.15.60:0/3031981127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5780b2100 msgr2=0x7fc5780d05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:20.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.932+0000 7fc57db9a700 1 --2- 172.21.15.60:0/3031981127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5780b2100 0x7fc5780d05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:20.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.932+0000 7fc57db9a700 1 -- 172.21.15.60:0/3031981127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc570009ae0 con 0x7fc5780b35d0 2023-10-06T04:28:20.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.933+0000 7fc57db9a700 1 --2- 172.21.15.60:0/3031981127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5780b35d0 0x7fc5780c7490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc56800c590 tx=0x7fc56800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:20.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.933+0000 7fc56e7fc700 1 -- 172.21.15.60:0/3031981127 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc568011590 con 0x7fc5780b35d0 2023-10-06T04:28:20.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.933+0000 7fc56e7fc700 1 -- 172.21.15.60:0/3031981127 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc568011710 con 0x7fc5780b35d0 2023-10-06T04:28:20.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.933+0000 7fc57f39d700 1 -- 172.21.15.60:0/3031981127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5780d0b70 con 0x7fc5780b35d0 2023-10-06T04:28:20.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.933+0000 7fc56e7fc700 1 -- 172.21.15.60:0/3031981127 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc568011ad0 con 0x7fc5780b35d0 2023-10-06T04:28:20.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.933+0000 7fc57f39d700 1 -- 172.21.15.60:0/3031981127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5780c98e0 con 0x7fc5780b35d0 2023-10-06T04:28:20.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.934+0000 7fc57f39d700 1 -- 172.21.15.60:0/3031981127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5780cdf60 con 0x7fc5780b35d0 2023-10-06T04:28:20.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.935+0000 7fc56e7fc700 1 -- 172.21.15.60:0/3031981127 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc56801b3b0 con 0x7fc5780b35d0 2023-10-06T04:28:20.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.936+0000 7fc56e7fc700 1 --2- 172.21.15.60:0/3031981127 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc55c066f30 0x7fc55c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:20.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.937+0000 7fc56e7fc700 1 -- 172.21.15.60:0/3031981127 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc568083eb0 con 0x7fc5780b35d0 2023-10-06T04:28:20.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.937+0000 7fc57e39b700 1 --2- 172.21.15.60:0/3031981127 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc55c066f30 0x7fc55c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:20.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.937+0000 7fc57e39b700 1 --2- 172.21.15.60:0/3031981127 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc55c066f30 0x7fc55c0693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc574006f00 tx=0x7fc574008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:20.943 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:20.941+0000 7fc56e7fc700 1 -- 172.21.15.60:0/3031981127 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc568050c30 con 0x7fc5780b35d0 2023-10-06T04:28:21.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.146+0000 7fc57f39d700 1 -- 172.21.15.60:0/3031981127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc57805f230 con 0x7fc5780b35d0 2023-10-06T04:28:21.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.147+0000 7fc56e7fc700 1 -- 172.21.15.60:0/3031981127 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fc568017070 con 0x7fc5780b35d0 2023-10-06T04:28:21.150 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:21.150 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:28:11.290557+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:28:04.355358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:28:05.208550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:28:08.791979+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:28:21.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.149+0000 7fc57f39d700 1 -- 172.21.15.60:0/3031981127 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc55c066f30 msgr2=0x7fc55c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:21.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.149+0000 7fc57f39d700 1 --2- 172.21.15.60:0/3031981127 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc55c066f30 0x7fc55c0693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc574006f00 tx=0x7fc574008040 comp rx=0 tx=0).stop 2023-10-06T04:28:21.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.149+0000 7fc57f39d700 1 -- 172.21.15.60:0/3031981127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5780b35d0 msgr2=0x7fc5780c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:21.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.149+0000 7fc57f39d700 1 --2- 172.21.15.60:0/3031981127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5780b35d0 0x7fc5780c7490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc56800c590 tx=0x7fc56800c8a0 comp rx=0 tx=0).stop 2023-10-06T04:28:21.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.149+0000 7fc57f39d700 1 -- 172.21.15.60:0/3031981127 shutdown_connections 2023-10-06T04:28:21.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.149+0000 7fc57f39d700 1 --2- 172.21.15.60:0/3031981127 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc55c066f30 0x7fc55c0693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:21.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.149+0000 7fc57f39d700 1 --2- 172.21.15.60:0/3031981127 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc578159440 0x7fc578155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:21.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.149+0000 7fc57f39d700 1 --2- 172.21.15.60:0/3031981127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5780b2100 0x7fc5780d05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:21.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.150+0000 7fc57f39d700 1 --2- 172.21.15.60:0/3031981127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5780b35d0 0x7fc5780c7490 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:21.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.150+0000 7fc57f39d700 1 -- 172.21.15.60:0/3031981127 >> 172.21.15.60:0/3031981127 conn(0x7fc57806ece0 msgr2=0x7fc578157770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:21.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.150+0000 7fc57f39d700 1 -- 172.21.15.60:0/3031981127 shutdown_connections 2023-10-06T04:28:21.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.150+0000 7fc57f39d700 1 -- 172.21.15.60:0/3031981127 wait complete. 2023-10-06T04:28:21.170 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T04:28:21.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.362+0000 7fbf6a39d700 1 Processor -- start 2023-10-06T04:28:21.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.362+0000 7fbf6a39d700 1 -- start start 2023-10-06T04:28:21.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.363+0000 7fbf6a39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf640b2620 0x7fbf640cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:21.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.363+0000 7fbf6a39d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf640b29f0 0x7fbf640cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:21.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.363+0000 7fbf6a39d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf640cc970 con 0x7fbf640ceaa0 2023-10-06T04:28:21.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.363+0000 7fbf6a39d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf640cbd60 con 0x7fbf640b29f0 2023-10-06T04:28:21.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.363+0000 7fbf6a39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf640cc040 con 0x7fbf640b2620 2023-10-06T04:28:21.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.364+0000 7fbf68b9a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf640b29f0 0x7fbf640cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:21.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.364+0000 7fbf68b9a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf640b29f0 0x7fbf640cd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55958/0 (socket says 172.21.15.60:55958) 2023-10-06T04:28:21.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.364+0000 7fbf68b9a700 1 -- 172.21.15.60:0/3838527196 learned_addr learned my addr 172.21.15.60:0/3838527196 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:21.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.364+0000 7fbf6939b700 1 --2- 172.21.15.60:0/3838527196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf640b2620 0x7fbf640cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:21.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.364+0000 7fbf68b9a700 1 -- 172.21.15.60:0/3838527196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf640b2620 msgr2=0x7fbf640cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:21.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.364+0000 7fbf68b9a700 1 --2- 172.21.15.60:0/3838527196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf640b2620 0x7fbf640cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:21.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.364+0000 7fbf68b9a700 1 -- 172.21.15.60:0/3838527196 >> v1:172.21.15.135:6789/0 conn(0x7fbf640ceaa0 legacy=0x7fbf640cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:21.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.364+0000 7fbf68b9a700 1 -- 172.21.15.60:0/3838527196 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf640cc320 con 0x7fbf640b29f0 2023-10-06T04:28:21.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.364+0000 7fbf68b9a700 1 --2- 172.21.15.60:0/3838527196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf640b29f0 0x7fbf640cd1f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbf540099b0 tx=0x7fbf54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0074621db27890 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:21.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.365+0000 7fbf5bfff700 1 -- 172.21.15.60:0/3838527196 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5400b860 con 0x7fbf640b29f0 2023-10-06T04:28:21.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.365+0000 7fbf5bfff700 1 -- 172.21.15.60:0/3838527196 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5400b9c0 con 0x7fbf640b29f0 2023-10-06T04:28:21.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.365+0000 7fbf5bfff700 1 -- 172.21.15.60:0/3838527196 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5400bd60 con 0x7fbf640b29f0 2023-10-06T04:28:21.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.365+0000 7fbf6a39d700 1 -- 172.21.15.60:0/3838527196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf640b29f0 msgr2=0x7fbf640cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:21.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.365+0000 7fbf6a39d700 1 --2- 172.21.15.60:0/3838527196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf640b29f0 0x7fbf640cd1f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbf540099b0 tx=0x7fbf54009250 comp rx=0 tx=0).stop 2023-10-06T04:28:21.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.365+0000 7fbf6a39d700 1 -- 172.21.15.60:0/3838527196 shutdown_connections 2023-10-06T04:28:21.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.365+0000 7fbf6a39d700 1 --2- 172.21.15.60:0/3838527196 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf640b2620 0x7fbf640cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:21.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.365+0000 7fbf6a39d700 1 --2- 172.21.15.60:0/3838527196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf640b29f0 0x7fbf640cd1f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:21.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.365+0000 7fbf6a39d700 1 -- 172.21.15.60:0/3838527196 >> 172.21.15.60:0/3838527196 conn(0x7fbf64099520 msgr2=0x7fbf6406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:21.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.365+0000 7fbf6a39d700 1 -- 172.21.15.60:0/3838527196 shutdown_connections 2023-10-06T04:28:21.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.366+0000 7fbf6a39d700 1 -- 172.21.15.60:0/3838527196 wait complete. 2023-10-06T04:28:21.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.367+0000 7fbf6a39d700 1 Processor -- start 2023-10-06T04:28:21.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.367+0000 7fbf6a39d700 1 -- start start 2023-10-06T04:28:21.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.368+0000 7fbf6a39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf640b2620 0x7fbf6414cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:21.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.368+0000 7fbf6a39d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf640b29f0 0x7fbf6415b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:21.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.368+0000 7fbf6a39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf640ceaa0 0x7fbf640cde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:21.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.368+0000 7fbf6a39d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6415bdb0 con 0x7fbf640b29f0 2023-10-06T04:28:21.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.368+0000 7fbf6a39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6415c090 con 0x7fbf640b2620 2023-10-06T04:28:21.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.368+0000 7fbf6a39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6415c370 con 0x7fbf640ceaa0 2023-10-06T04:28:21.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.368+0000 7fbf68b9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf640b29f0 0x7fbf6415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:21.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.368+0000 7fbf68b9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf640b29f0 0x7fbf6415b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55968/0 (socket says 172.21.15.60:55968) 2023-10-06T04:28:21.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.368+0000 7fbf68b9a700 1 -- 172.21.15.60:0/1465147179 learned_addr learned my addr 172.21.15.60:0/1465147179 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:21.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.368+0000 7fbf6939b700 1 --2- 172.21.15.60:0/1465147179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf640b2620 0x7fbf6414cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:21.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.368+0000 7fbf69b9c700 1 --2- 172.21.15.60:0/1465147179 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf640ceaa0 0x7fbf640cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:21.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.369+0000 7fbf68b9a700 1 -- 172.21.15.60:0/1465147179 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf640ceaa0 msgr2=0x7fbf640cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:21.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.369+0000 7fbf68b9a700 1 --2- 172.21.15.60:0/1465147179 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf640ceaa0 0x7fbf640cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:21.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.369+0000 7fbf68b9a700 1 -- 172.21.15.60:0/1465147179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf640b2620 msgr2=0x7fbf6414cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:21.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.369+0000 7fbf68b9a700 1 --2- 172.21.15.60:0/1465147179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf640b2620 0x7fbf6414cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:21.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.369+0000 7fbf68b9a700 1 -- 172.21.15.60:0/1465147179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf540094f0 con 0x7fbf640b29f0 2023-10-06T04:28:21.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.369+0000 7fbf68b9a700 1 --2- 172.21.15.60:0/1465147179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf640b29f0 0x7fbf6415b300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbf6406fcc0 tx=0x7fbf54017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:21.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.369+0000 7fbf597fa700 1 -- 172.21.15.60:0/1465147179 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf54011e40 con 0x7fbf640b29f0 2023-10-06T04:28:21.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.369+0000 7fbf597fa700 1 -- 172.21.15.60:0/1465147179 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5401a420 con 0x7fbf640b29f0 2023-10-06T04:28:21.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.369+0000 7fbf597fa700 1 -- 172.21.15.60:0/1465147179 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5401a7e0 con 0x7fbf640b29f0 2023-10-06T04:28:21.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.369+0000 7fbf6a39d700 1 -- 172.21.15.60:0/1465147179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6415c650 con 0x7fbf640b29f0 2023-10-06T04:28:21.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.370+0000 7fbf6a39d700 1 -- 172.21.15.60:0/1465147179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6409b650 con 0x7fbf640b29f0 2023-10-06T04:28:21.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.371+0000 7fbf6a39d700 1 -- 172.21.15.60:0/1465147179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6409b8d0 con 0x7fbf640b29f0 2023-10-06T04:28:21.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.371+0000 7fbf597fa700 1 -- 172.21.15.60:0/1465147179 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf5401ab50 con 0x7fbf640b29f0 2023-10-06T04:28:21.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.372+0000 7fbf597fa700 1 --2- 172.21.15.60:0/1465147179 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf48066f30 0x7fbf480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:21.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.372+0000 7fbf597fa700 1 -- 172.21.15.60:0/1465147179 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fbf540863f0 con 0x7fbf640b29f0 2023-10-06T04:28:21.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.372+0000 7fbf6939b700 1 --2- 172.21.15.60:0/1465147179 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf48066f30 0x7fbf480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:21.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.373+0000 7fbf6939b700 1 --2- 172.21.15.60:0/1465147179 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf48066f30 0x7fbf480693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbf600061f0 tx=0x7fbf60008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:21.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.377+0000 7fbf597fa700 1 -- 172.21.15.60:0/1465147179 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf54053170 con 0x7fbf640b29f0 2023-10-06T04:28:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:21.626+0000 7fbf6a39d700 1 -- 172.21.15.60:0/1465147179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbf6405f230 con 0x7fbf640b29f0 2023-10-06T04:28:22.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.340+0000 7fbf597fa700 1 -- 172.21.15.60:0/1465147179 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbf54056790 con 0x7fbf640b29f0 2023-10-06T04:28:22.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.344+0000 7fbf6a39d700 1 -- 172.21.15.60:0/1465147179 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf48066f30 msgr2=0x7fbf480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:22.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.344+0000 7fbf6a39d700 1 --2- 172.21.15.60:0/1465147179 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf48066f30 0x7fbf480693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbf600061f0 tx=0x7fbf60008040 comp rx=0 tx=0).stop 2023-10-06T04:28:22.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.344+0000 7fbf6a39d700 1 -- 172.21.15.60:0/1465147179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf640b29f0 msgr2=0x7fbf6415b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:22.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.344+0000 7fbf6a39d700 1 --2- 172.21.15.60:0/1465147179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf640b29f0 0x7fbf6415b300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbf6406fcc0 tx=0x7fbf54017000 comp rx=0 tx=0).stop 2023-10-06T04:28:22.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.344+0000 7fbf6a39d700 1 -- 172.21.15.60:0/1465147179 shutdown_connections 2023-10-06T04:28:22.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.344+0000 7fbf6a39d700 1 --2- 172.21.15.60:0/1465147179 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf48066f30 0x7fbf480693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:22.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.344+0000 7fbf6a39d700 1 --2- 172.21.15.60:0/1465147179 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf640ceaa0 0x7fbf640cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:22.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.344+0000 7fbf6a39d700 1 --2- 172.21.15.60:0/1465147179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf640b2620 0x7fbf6414cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:22.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.344+0000 7fbf6a39d700 1 --2- 172.21.15.60:0/1465147179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf640b29f0 0x7fbf6415b300 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:22.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.344+0000 7fbf6a39d700 1 -- 172.21.15.60:0/1465147179 >> 172.21.15.60:0/1465147179 conn(0x7fbf64099520 msgr2=0x7fbf64068e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:22.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.344+0000 7fbf6a39d700 1 -- 172.21.15.60:0/1465147179 shutdown_connections 2023-10-06T04:28:22.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.345+0000 7fbf6a39d700 1 -- 172.21.15.60:0/1465147179 wait complete. 2023-10-06T04:28:22.368 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T04:28:22.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.560+0000 7f966f59d700 1 Processor -- start 2023-10-06T04:28:22.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.561+0000 7f966f59d700 1 -- start start 2023-10-06T04:28:22.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.562+0000 7f966f59d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f96681560f0 0x7f9668159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:22.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.562+0000 7f966f59d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96680acad0 con 0x7f96680ae0b0 2023-10-06T04:28:22.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.562+0000 7f966f59d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96681564c0 con 0x7f966806e160 2023-10-06T04:28:22.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.562+0000 7f966f59d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966815a2d0 con 0x7f96681560f0 2023-10-06T04:28:22.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.562+0000 7f966dd9a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f96680ae0b0 0x7f96680c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55172/0 (socket says 172.21.15.60:55172) 2023-10-06T04:28:22.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.562+0000 7f966dd9a700 1 -- 172.21.15.60:0/3880728656 learned_addr learned my addr 172.21.15.60:0/3880728656 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:22.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.563+0000 7f966e59b700 1 --2- 172.21.15.60:0/3880728656 >> v2:172.21.15.135:3300/0 conn(0x7f96681560f0 0x7f9668159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:22.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.563+0000 7f966d599700 1 -- 172.21.15.60:0/3880728656 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107971288 0 0) 0x7f96680acad0 con 0x7f96680ae0b0 2023-10-06T04:28:22.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.563+0000 7f966d599700 1 -- 172.21.15.60:0/3880728656 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9654003570 con 0x7f96680ae0b0 2023-10-06T04:28:22.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.563+0000 7f966d599700 1 -- 172.21.15.60:0/3880728656 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1806129974 0 0) 0x7f9654003570 con 0x7f96680ae0b0 2023-10-06T04:28:22.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.563+0000 7f966d599700 1 -- 172.21.15.60:0/3880728656 >> v2:172.21.15.135:3300/0 conn(0x7f96681560f0 msgr2=0x7f9668159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:22.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.563+0000 7f966d599700 1 --2- 172.21.15.60:0/3880728656 >> v2:172.21.15.135:3300/0 conn(0x7f96681560f0 0x7f9668159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:22.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.563+0000 7f966d599700 1 -- 172.21.15.60:0/3880728656 >> v1:172.21.15.135:6789/0 conn(0x7f966806e160 legacy=0x7f966806e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:22.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.563+0000 7f966d599700 1 -- 172.21.15.60:0/3880728656 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966815a5b0 con 0x7f96680ae0b0 2023-10-06T04:28:22.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.563+0000 7f966d599700 1 -- 172.21.15.60:0/3880728656 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7f9658001470 con 0x7f96680ae0b0 2023-10-06T04:28:22.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.563+0000 7f966e59b700 1 --2- 172.21.15.60:0/3880728656 >> v2:172.21.15.135:3300/0 conn(0x7f96681560f0 0x7f9668159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:22.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.563+0000 7f966d599700 1 -- 172.21.15.60:0/3880728656 >> v1:172.21.15.60:6789/0 conn(0x7f96680ae0b0 legacy=0x7f96680c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:22.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.563+0000 7f966d599700 1 --2- 172.21.15.60:0/3880728656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9654003a60 0x7f9654003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:22.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.563+0000 7f966d599700 1 --2- 172.21.15.60:0/3880728656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9654004810 0x7f9654004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:22.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.563+0000 7f966d599700 1 --2- 172.21.15.60:0/3880728656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96540051c0 0x7f965400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:22.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.563+0000 7f966d599700 1 -- 172.21.15.60:0/3880728656 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966815a2d0 con 0x7f9654003a60 2023-10-06T04:28:22.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.563+0000 7f966d599700 1 -- 172.21.15.60:0/3880728656 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965400c0d0 con 0x7f96540051c0 2023-10-06T04:28:22.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.563+0000 7f966d599700 1 -- 172.21.15.60:0/3880728656 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965400e4a0 con 0x7f9654004810 2023-10-06T04:28:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.564+0000 7f966e59b700 1 --2- 172.21.15.60:0/3880728656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9654003a60 0x7f9654003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.564+0000 7f966ed9c700 1 --2- 172.21.15.60:0/3880728656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96540051c0 0x7f965400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.564+0000 7f966dd9a700 1 --2- 172.21.15.60:0/3880728656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9654004810 0x7f9654004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.564+0000 7f966e59b700 1 -- 172.21.15.60:0/3880728656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9654004810 msgr2=0x7f9654004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.564+0000 7f966e59b700 1 --2- 172.21.15.60:0/3880728656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9654004810 0x7f9654004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.564+0000 7f966e59b700 1 -- 172.21.15.60:0/3880728656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96540051c0 msgr2=0x7f965400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.564+0000 7f966e59b700 1 --2- 172.21.15.60:0/3880728656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96540051c0 0x7f965400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.564+0000 7f966e59b700 1 -- 172.21.15.60:0/3880728656 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9654003570 con 0x7f9654003a60 2023-10-06T04:28:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.564+0000 7f966ed9c700 1 --2- 172.21.15.60:0/3880728656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96540051c0 0x7f965400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.564+0000 7f966ed9c700 1 -- 172.21.15.60:0/3880728656 reap_dead start 2023-10-06T04:28:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.564+0000 7f966e59b700 1 --2- 172.21.15.60:0/3880728656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9654003a60 0x7f9654003e70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9664009df0 tx=0x7f96640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0dffd275f4d789a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.564+0000 7f966d599700 1 -- 172.21.15.60:0/3880728656 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9664009740 con 0x7f9654003a60 2023-10-06T04:28:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.564+0000 7f966d599700 1 -- 172.21.15.60:0/3880728656 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966400e920 con 0x7f9654003a60 2023-10-06T04:28:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.564+0000 7f966d599700 1 -- 172.21.15.60:0/3880728656 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966400ece0 con 0x7f9654003a60 2023-10-06T04:28:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.565+0000 7f966f59d700 1 -- 172.21.15.60:0/3880728656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9654003a60 msgr2=0x7f9654003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.565+0000 7f966f59d700 1 --2- 172.21.15.60:0/3880728656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9654003a60 0x7f9654003e70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9664009df0 tx=0x7f96640091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.565+0000 7f966f59d700 1 -- 172.21.15.60:0/3880728656 shutdown_connections 2023-10-06T04:28:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.565+0000 7f966f59d700 1 --2- 172.21.15.60:0/3880728656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9654003a60 0x7f9654003e70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.565+0000 7f966f59d700 1 -- 172.21.15.60:0/3880728656 >> 172.21.15.60:0/3880728656 conn(0x7f96680cbed0 msgr2=0x7f96680cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.565+0000 7f966f59d700 1 -- 172.21.15.60:0/3880728656 shutdown_connections 2023-10-06T04:28:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.565+0000 7f966f59d700 1 -- 172.21.15.60:0/3880728656 wait complete. 2023-10-06T04:28:22.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.567+0000 7f966f59d700 1 Processor -- start 2023-10-06T04:28:22.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.567+0000 7f966f59d700 1 -- start start 2023-10-06T04:28:22.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.568+0000 7f966f59d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9654003a60 0x7f9668152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:22.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.568+0000 7f966f59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9668169980 0x7f96681544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:22.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.568+0000 7f966f59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9668154a30 0x7f96680c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:22.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.568+0000 7f966f59d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9668154ed0 con 0x7f9654003a60 2023-10-06T04:28:22.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.568+0000 7f966f59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9668156850 con 0x7f9668169980 2023-10-06T04:28:22.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.568+0000 7f966f59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96680c96a0 con 0x7f9668154a30 2023-10-06T04:28:22.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.568+0000 7f966e59b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9654003a60 0x7f9668152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:22.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.568+0000 7f966e59b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9654003a60 0x7f9668152b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55994/0 (socket says 172.21.15.60:55994) 2023-10-06T04:28:22.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.568+0000 7f966e59b700 1 -- 172.21.15.60:0/384702399 learned_addr learned my addr 172.21.15.60:0/384702399 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:22.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.568+0000 7f966ed9c700 1 --2- 172.21.15.60:0/384702399 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9668154a30 0x7f96680c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:22.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.568+0000 7f966dd9a700 1 --2- 172.21.15.60:0/384702399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9668169980 0x7f96681544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:22.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.568+0000 7f966e59b700 1 -- 172.21.15.60:0/384702399 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9668154a30 msgr2=0x7f96680c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:22.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.568+0000 7f966e59b700 1 --2- 172.21.15.60:0/384702399 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9668154a30 0x7f96680c5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:22.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.568+0000 7f966e59b700 1 -- 172.21.15.60:0/384702399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9668169980 msgr2=0x7f96681544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:22.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.568+0000 7f966e59b700 1 --2- 172.21.15.60:0/384702399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9668169980 0x7f96681544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:22.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.568+0000 7f966e59b700 1 -- 172.21.15.60:0/384702399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9668153080 con 0x7f9654003a60 2023-10-06T04:28:22.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.568+0000 7f966dd9a700 1 --2- 172.21.15.60:0/384702399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9668169980 0x7f96681544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:22.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.569+0000 7f966e59b700 1 --2- 172.21.15.60:0/384702399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9654003a60 0x7f9668152b40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f965400c0a0 tx=0x7f966401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:22.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.569+0000 7f965e7fc700 1 -- 172.21.15.60:0/384702399 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9664022070 con 0x7f9654003a60 2023-10-06T04:28:22.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.569+0000 7f965e7fc700 1 -- 172.21.15.60:0/384702399 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9664009740 con 0x7f9654003a60 2023-10-06T04:28:22.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.569+0000 7f965e7fc700 1 -- 172.21.15.60:0/384702399 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966401c450 con 0x7f9654003a60 2023-10-06T04:28:22.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.569+0000 7f966f59d700 1 -- 172.21.15.60:0/384702399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96680c8a90 con 0x7f9654003a60 2023-10-06T04:28:22.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.569+0000 7f966f59d700 1 -- 172.21.15.60:0/384702399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96680c9050 con 0x7f9654003a60 2023-10-06T04:28:22.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.570+0000 7f966f59d700 1 -- 172.21.15.60:0/384702399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9668154e30 con 0x7f9654003a60 2023-10-06T04:28:22.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.571+0000 7f965e7fc700 1 -- 172.21.15.60:0/384702399 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9664026070 con 0x7f9654003a60 2023-10-06T04:28:22.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.572+0000 7f965e7fc700 1 --2- 172.21.15.60:0/384702399 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f964c066f30 0x7f964c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:22.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.572+0000 7f965e7fc700 1 -- 172.21.15.60:0/384702399 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9664086090 con 0x7f9654003a60 2023-10-06T04:28:22.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.572+0000 7f966dd9a700 1 --2- 172.21.15.60:0/384702399 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f964c066f30 0x7f964c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:22.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.572+0000 7f966dd9a700 1 --2- 172.21.15.60:0/384702399 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f964c066f30 0x7f964c0693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f96681603d0 tx=0x7f9658009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:22.581 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.576+0000 7f965e7fc700 1 -- 172.21.15.60:0/384702399 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9664052f10 con 0x7f9654003a60 2023-10-06T04:28:22.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:22.824+0000 7f966f59d700 1 -- 172.21.15.60:0/384702399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f966805f230 con 0x7f9654003a60 2023-10-06T04:28:23.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.346+0000 7f965e7fc700 1 -- 172.21.15.60:0/384702399 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f96640564f0 con 0x7f9654003a60 2023-10-06T04:28:23.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.349+0000 7f966f59d700 1 -- 172.21.15.60:0/384702399 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f964c066f30 msgr2=0x7f964c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:23.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.349+0000 7f966f59d700 1 --2- 172.21.15.60:0/384702399 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f964c066f30 0x7f964c0693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f96681603d0 tx=0x7f9658009040 comp rx=0 tx=0).stop 2023-10-06T04:28:23.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.349+0000 7f966f59d700 1 -- 172.21.15.60:0/384702399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9654003a60 msgr2=0x7f9668152b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:23.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.349+0000 7f966f59d700 1 --2- 172.21.15.60:0/384702399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9654003a60 0x7f9668152b40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f965400c0a0 tx=0x7f966401a000 comp rx=0 tx=0).stop 2023-10-06T04:28:23.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.349+0000 7f966f59d700 1 -- 172.21.15.60:0/384702399 shutdown_connections 2023-10-06T04:28:23.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.349+0000 7f966f59d700 1 --2- 172.21.15.60:0/384702399 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f964c066f30 0x7f964c0693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:23.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.349+0000 7f966f59d700 1 --2- 172.21.15.60:0/384702399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9654003a60 0x7f9668152b40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:23.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.349+0000 7f966f59d700 1 --2- 172.21.15.60:0/384702399 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9668154a30 0x7f96680c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:23.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.349+0000 7f966f59d700 1 --2- 172.21.15.60:0/384702399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9668169980 0x7f96681544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:23.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.349+0000 7f966f59d700 1 -- 172.21.15.60:0/384702399 >> 172.21.15.60:0/384702399 conn(0x7f96680cbed0 msgr2=0x7f966815aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:23.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.349+0000 7f966f59d700 1 -- 172.21.15.60:0/384702399 shutdown_connections 2023-10-06T04:28:23.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.350+0000 7f966f59d700 1 -- 172.21.15.60:0/384702399 wait complete. 2023-10-06T04:28:23.372 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:28:23.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.560+0000 7f5d4d59d700 1 Processor -- start 2023-10-06T04:28:23.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.560+0000 7f5d4d59d700 1 -- start start 2023-10-06T04:28:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.561+0000 7f5d4d59d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5d4806a590 0x7f5d481536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.562+0000 7f5d4d59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d4806e660 0x7f5d48153c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.562+0000 7f5d4d59d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d480c9cc0 con 0x7f5d4806a960 2023-10-06T04:28:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.562+0000 7f5d4d59d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d4806f560 con 0x7f5d4806a590 2023-10-06T04:28:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.562+0000 7f5d4d59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4806eac0 con 0x7f5d4806e660 2023-10-06T04:28:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.562+0000 7f5d477fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5d4806a960 0x7f5d4806df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56960/0 (socket says 172.21.15.60:56960) 2023-10-06T04:28:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.562+0000 7f5d477fe700 1 -- 172.21.15.60:0/2148057987 learned_addr learned my addr 172.21.15.60:0/2148057987 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.562+0000 7f5d47fff700 1 --2- 172.21.15.60:0/2148057987 >> v2:172.21.15.135:3300/0 conn(0x7f5d4806a590 0x7f5d481536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.562+0000 7f5d4cd9c700 1 --2- 172.21.15.60:0/2148057987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d4806e660 0x7f5d48153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.562+0000 7f5d46ffd700 1 -- 172.21.15.60:0/2148057987 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981302512 0 0) 0x7f5d480c9cc0 con 0x7f5d4806a960 2023-10-06T04:28:23.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.562+0000 7f5d46ffd700 1 -- 172.21.15.60:0/2148057987 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d30003570 con 0x7f5d4806a960 2023-10-06T04:28:23.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.563+0000 7f5d47fff700 1 -- 172.21.15.60:0/2148057987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d4806e660 msgr2=0x7f5d48153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:23.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.563+0000 7f5d47fff700 1 --2- 172.21.15.60:0/2148057987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d4806e660 0x7f5d48153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:23.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.563+0000 7f5d47fff700 1 -- 172.21.15.60:0/2148057987 >> v1:172.21.15.60:6789/0 conn(0x7f5d4806a960 legacy=0x7f5d4806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:23.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.563+0000 7f5d47fff700 1 -- 172.21.15.60:0/2148057987 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d480c6710 con 0x7f5d4806a590 2023-10-06T04:28:23.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.563+0000 7f5d47fff700 1 --2- 172.21.15.60:0/2148057987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d4806a590 0x7f5d481536f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5d38009910 tx=0x7f5d380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74327c6d6c45bf96 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:23.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.563+0000 7f5d46ffd700 1 -- 172.21.15.60:0/2148057987 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38011630 con 0x7f5d4806a590 2023-10-06T04:28:23.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.563+0000 7f5d46ffd700 1 -- 172.21.15.60:0/2148057987 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d38011790 con 0x7f5d4806a590 2023-10-06T04:28:23.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.563+0000 7f5d46ffd700 1 -- 172.21.15.60:0/2148057987 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38011b30 con 0x7f5d4806a590 2023-10-06T04:28:23.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.564+0000 7f5d4d59d700 1 -- 172.21.15.60:0/2148057987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d4806a590 msgr2=0x7f5d481536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:23.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.564+0000 7f5d4d59d700 1 --2- 172.21.15.60:0/2148057987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d4806a590 0x7f5d481536f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5d38009910 tx=0x7f5d380091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:23.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.564+0000 7f5d4d59d700 1 -- 172.21.15.60:0/2148057987 shutdown_connections 2023-10-06T04:28:23.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.564+0000 7f5d4d59d700 1 --2- 172.21.15.60:0/2148057987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d4806e660 0x7f5d48153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:23.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.564+0000 7f5d4d59d700 1 --2- 172.21.15.60:0/2148057987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d4806a590 0x7f5d481536f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:23.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.564+0000 7f5d4d59d700 1 -- 172.21.15.60:0/2148057987 >> 172.21.15.60:0/2148057987 conn(0x7f5d48068080 msgr2=0x7f5d480cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:23.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.564+0000 7f5d4d59d700 1 -- 172.21.15.60:0/2148057987 shutdown_connections 2023-10-06T04:28:23.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.564+0000 7f5d4d59d700 1 -- 172.21.15.60:0/2148057987 wait complete. 2023-10-06T04:28:23.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.565+0000 7f5d4d59d700 1 Processor -- start 2023-10-06T04:28:23.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.565+0000 7f5d4d59d700 1 -- start start 2023-10-06T04:28:23.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.566+0000 7f5d4d59d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d4806a590 0x7f5d48148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:23.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.566+0000 7f5d4d59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d4806a960 0x7f5d4816d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:23.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.566+0000 7f5d4d59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d4806e660 0x7f5d48147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:23.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.566+0000 7f5d4d59d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d481544b0 con 0x7f5d4806a590 2023-10-06T04:28:23.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.566+0000 7f5d4d59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d48149530 con 0x7f5d4806a960 2023-10-06T04:28:23.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.566+0000 7f5d4d59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d48148c90 con 0x7f5d4806e660 2023-10-06T04:28:23.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.567+0000 7f5d47fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d4806a590 0x7f5d48148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:23.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.567+0000 7f5d47fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d4806a590 0x7f5d48148600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51802/0 (socket says 172.21.15.60:51802) 2023-10-06T04:28:23.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.567+0000 7f5d47fff700 1 -- 172.21.15.60:0/57272666 learned_addr learned my addr 172.21.15.60:0/57272666 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:23.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.567+0000 7f5d477fe700 1 --2- 172.21.15.60:0/57272666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d4806a960 0x7f5d4816d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:23.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.567+0000 7f5d4cd9c700 1 --2- 172.21.15.60:0/57272666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d4806e660 0x7f5d48147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:23.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.567+0000 7f5d47fff700 1 -- 172.21.15.60:0/57272666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d4806e660 msgr2=0x7f5d48147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:23.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.567+0000 7f5d47fff700 1 --2- 172.21.15.60:0/57272666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d4806e660 0x7f5d48147280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:23.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.567+0000 7f5d47fff700 1 -- 172.21.15.60:0/57272666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d4806a960 msgr2=0x7f5d4816d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:23.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.567+0000 7f5d47fff700 1 --2- 172.21.15.60:0/57272666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d4806a960 0x7f5d4816d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:23.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.567+0000 7f5d47fff700 1 -- 172.21.15.60:0/57272666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d38009420 con 0x7f5d4806a590 2023-10-06T04:28:23.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.567+0000 7f5d47fff700 1 --2- 172.21.15.60:0/57272666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d4806a590 0x7f5d48148600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5d38009f00 tx=0x7f5d38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:23.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.568+0000 7f5d2ffff700 1 -- 172.21.15.60:0/57272666 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38000c40 con 0x7f5d4806a590 2023-10-06T04:28:23.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.568+0000 7f5d2ffff700 1 -- 172.21.15.60:0/57272666 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d38011900 con 0x7f5d4806a590 2023-10-06T04:28:23.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.568+0000 7f5d4d59d700 1 -- 172.21.15.60:0/57272666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d48148f70 con 0x7f5d4806a590 2023-10-06T04:28:23.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.568+0000 7f5d2ffff700 1 -- 172.21.15.60:0/57272666 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38025420 con 0x7f5d4806a590 2023-10-06T04:28:23.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.568+0000 7f5d4d59d700 1 -- 172.21.15.60:0/57272666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d481477c0 con 0x7f5d4806a590 2023-10-06T04:28:23.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.569+0000 7f5d4d59d700 1 -- 172.21.15.60:0/57272666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d4805f230 con 0x7f5d4806a590 2023-10-06T04:28:23.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.570+0000 7f5d2ffff700 1 -- 172.21.15.60:0/57272666 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d38023070 con 0x7f5d4806a590 2023-10-06T04:28:23.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.571+0000 7f5d2ffff700 1 --2- 172.21.15.60:0/57272666 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5d34066f30 0x7f5d340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:23.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.571+0000 7f5d2ffff700 1 -- 172.21.15.60:0/57272666 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5d38085e40 con 0x7f5d4806a590 2023-10-06T04:28:23.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.571+0000 7f5d477fe700 1 --2- 172.21.15.60:0/57272666 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5d34066f30 0x7f5d340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:23.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.571+0000 7f5d477fe700 1 --2- 172.21.15.60:0/57272666 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5d34066f30 0x7f5d340693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5d481530d0 tx=0x7f5d3c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:23.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.575+0000 7f5d2ffff700 1 -- 172.21.15.60:0/57272666 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d38052c60 con 0x7f5d4806a590 2023-10-06T04:28:23.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.821+0000 7f5d4d59d700 1 -- 172.21.15.60:0/57272666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d480c7f40 con 0x7f5d4806a590 2023-10-06T04:28:23.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.822+0000 7f5d2ffff700 1 -- 172.21.15.60:0/57272666 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f5d3802a090 con 0x7f5d4806a590 2023-10-06T04:28:23.824 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:23.824 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3950892589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3950892589},{"type":"v1","addr":"172.21.15.60:6837","nonce":3950892589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1381681252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1381681252},{"type":"v1","addr":"172.21.15.135:6834","nonce":1381681252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1306947344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1306947344},{"type":"v1","addr":"172.21.15.135:6835","nonce":1306947344}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:28:06.242656+0000","modified":"2023-10-06T04:28:23.340411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/1424722915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1424722915},{"type":"v1","addr":"172.21.15.60:6836","nonce":1424722915}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:28:23.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.824+0000 7f5d4d59d700 1 -- 172.21.15.60:0/57272666 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5d34066f30 msgr2=0x7f5d340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:23.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.824+0000 7f5d4d59d700 1 --2- 172.21.15.60:0/57272666 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5d34066f30 0x7f5d340693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5d481530d0 tx=0x7f5d3c009040 comp rx=0 tx=0).stop 2023-10-06T04:28:23.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.824+0000 7f5d4d59d700 1 -- 172.21.15.60:0/57272666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d4806a590 msgr2=0x7f5d48148600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:23.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.824+0000 7f5d4d59d700 1 --2- 172.21.15.60:0/57272666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d4806a590 0x7f5d48148600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5d38009f00 tx=0x7f5d38017000 comp rx=0 tx=0).stop 2023-10-06T04:28:23.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.824+0000 7f5d4d59d700 1 -- 172.21.15.60:0/57272666 shutdown_connections 2023-10-06T04:28:23.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.824+0000 7f5d4d59d700 1 --2- 172.21.15.60:0/57272666 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5d34066f30 0x7f5d340693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:23.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.824+0000 7f5d4d59d700 1 --2- 172.21.15.60:0/57272666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d4806a590 0x7f5d48148600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:23.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.824+0000 7f5d4d59d700 1 --2- 172.21.15.60:0/57272666 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d4806e660 0x7f5d48147280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:23.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.824+0000 7f5d4d59d700 1 --2- 172.21.15.60:0/57272666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d4806a960 0x7f5d4816d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:23.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.824+0000 7f5d4d59d700 1 -- 172.21.15.60:0/57272666 >> 172.21.15.60:0/57272666 conn(0x7f5d48068080 msgr2=0x7f5d480c2400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:23.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.824+0000 7f5d4d59d700 1 -- 172.21.15.60:0/57272666 shutdown_connections 2023-10-06T04:28:23.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:23.824+0000 7f5d4d59d700 1 -- 172.21.15.60:0/57272666 wait complete. 2023-10-06T04:28:23.828 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 9 2023-10-06T04:28:23.844 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:28:24.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.027+0000 7f0591d9d700 1 Processor -- start 2023-10-06T04:28:24.030 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.028+0000 7f0591d9d700 1 -- start start 2023-10-06T04:28:24.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.029+0000 7f0591d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f058c159390 0x7f058c0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:24.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.029+0000 7f0591d9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058c0686c0 con 0x7f058c0ab410 2023-10-06T04:28:24.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.029+0000 7f0591d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058c068c80 con 0x7f058c159760 2023-10-06T04:28:24.031 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.029+0000 7f0591d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058c0ace20 con 0x7f058c159390 2023-10-06T04:28:24.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.029+0000 7f059159c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f058c0ab410 0x7f058c0aeb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56962/0 (socket says 172.21.15.60:56962) 2023-10-06T04:28:24.032 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.029+0000 7f059159c700 1 -- 172.21.15.60:0/2541918377 learned_addr learned my addr 172.21.15.60:0/2541918377 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:24.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.029+0000 7f0590d9b700 1 --2- 172.21.15.60:0/2541918377 >> v2:172.21.15.135:3300/0 conn(0x7f058c159390 0x7f058c0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:24.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.030+0000 7f058b7fe700 1 -- 172.21.15.60:0/2541918377 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000066627 0 0) 0x7f058c0686c0 con 0x7f058c0ab410 2023-10-06T04:28:24.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.030+0000 7f058b7fe700 1 -- 172.21.15.60:0/2541918377 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f057c003570 con 0x7f058c0ab410 2023-10-06T04:28:24.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.030+0000 7f0590d9b700 1 -- 172.21.15.60:0/2541918377 >> v1:172.21.15.135:6789/0 conn(0x7f058c159760 legacy=0x7f058c0aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:24.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.030+0000 7f0590d9b700 1 -- 172.21.15.60:0/2541918377 >> v1:172.21.15.60:6789/0 conn(0x7f058c0ab410 legacy=0x7f058c0aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:24.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.030+0000 7f0590d9b700 1 -- 172.21.15.60:0/2541918377 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c0ad0f0 con 0x7f058c159390 2023-10-06T04:28:24.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.030+0000 7f0590d9b700 1 --2- 172.21.15.60:0/2541918377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f058c159390 0x7f058c0ac8e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f05800098e0 tx=0x7f05800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe84a2107149217a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:24.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.030+0000 7f058b7fe700 1 -- 172.21.15.60:0/2541918377 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058000b640 con 0x7f058c159390 2023-10-06T04:28:24.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.030+0000 7f058b7fe700 1 -- 172.21.15.60:0/2541918377 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058000b7a0 con 0x7f058c159390 2023-10-06T04:28:24.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.030+0000 7f058b7fe700 1 -- 172.21.15.60:0/2541918377 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058000bb20 con 0x7f058c159390 2023-10-06T04:28:24.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.031+0000 7f0591d9d700 1 -- 172.21.15.60:0/2541918377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f058c159390 msgr2=0x7f058c0ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:24.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.031+0000 7f0591d9d700 1 --2- 172.21.15.60:0/2541918377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f058c159390 0x7f058c0ac8e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f05800098e0 tx=0x7f05800091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:24.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.031+0000 7f0591d9d700 1 -- 172.21.15.60:0/2541918377 shutdown_connections 2023-10-06T04:28:24.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.031+0000 7f0591d9d700 1 --2- 172.21.15.60:0/2541918377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f058c159390 0x7f058c0ac8e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:24.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.031+0000 7f0591d9d700 1 -- 172.21.15.60:0/2541918377 >> 172.21.15.60:0/2541918377 conn(0x7f058c097410 msgr2=0x7f058c067d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:24.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.031+0000 7f0591d9d700 1 -- 172.21.15.60:0/2541918377 shutdown_connections 2023-10-06T04:28:24.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.031+0000 7f0591d9d700 1 -- 172.21.15.60:0/2541918377 wait complete. 2023-10-06T04:28:24.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.032+0000 7f0591d9d700 1 Processor -- start 2023-10-06T04:28:24.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.033+0000 7f0591d9d700 1 -- start start 2023-10-06T04:28:24.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.033+0000 7f0591d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f058c0ab410 0x7f058c06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:24.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.033+0000 7f0591d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f058c159390 0x7f058c099230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:24.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.033+0000 7f0591d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f058c159760 0x7f058c1479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:24.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.033+0000 7f0591d9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0b1440 con 0x7f058c159390 2023-10-06T04:28:24.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.033+0000 7f0591d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0b1720 con 0x7f058c159760 2023-10-06T04:28:24.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.033+0000 7f0591d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0b1a00 con 0x7f058c0ab410 2023-10-06T04:28:24.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.034+0000 7f058bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f058c159390 0x7f058c099230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:24.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.034+0000 7f058bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f058c159390 0x7f058c099230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51818/0 (socket says 172.21.15.60:51818) 2023-10-06T04:28:24.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.034+0000 7f058bfff700 1 -- 172.21.15.60:0/4251469959 learned_addr learned my addr 172.21.15.60:0/4251469959 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:24.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.034+0000 7f059159c700 1 --2- 172.21.15.60:0/4251469959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f058c159760 0x7f058c1479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:24.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.034+0000 7f0590d9b700 1 --2- 172.21.15.60:0/4251469959 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f058c0ab410 0x7f058c06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:24.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.034+0000 7f058bfff700 1 -- 172.21.15.60:0/4251469959 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f058c0ab410 msgr2=0x7f058c06cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:24.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.034+0000 7f058bfff700 1 --2- 172.21.15.60:0/4251469959 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f058c0ab410 0x7f058c06cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:24.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.034+0000 7f058bfff700 1 -- 172.21.15.60:0/4251469959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f058c159760 msgr2=0x7f058c1479f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:24.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.034+0000 7f058bfff700 1 --2- 172.21.15.60:0/4251469959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f058c159760 0x7f058c1479f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:24.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.034+0000 7f058bfff700 1 -- 172.21.15.60:0/4251469959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0580009420 con 0x7f058c159390 2023-10-06T04:28:24.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.034+0000 7f059159c700 1 --2- 172.21.15.60:0/4251469959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f058c159760 0x7f058c1479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:24.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.034+0000 7f058bfff700 1 --2- 172.21.15.60:0/4251469959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f058c159390 0x7f058c099230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f057800c590 tx=0x7f0578007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:24.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.035+0000 7f0588ff9700 1 -- 172.21.15.60:0/4251469959 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0578011590 con 0x7f058c159390 2023-10-06T04:28:24.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.035+0000 7f0588ff9700 1 -- 172.21.15.60:0/4251469959 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0578011730 con 0x7f058c159390 2023-10-06T04:28:24.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.035+0000 7f0588ff9700 1 -- 172.21.15.60:0/4251469959 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0578011af0 con 0x7f058c159390 2023-10-06T04:28:24.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.035+0000 7f0591d9d700 1 -- 172.21.15.60:0/4251469959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058c0b1ce0 con 0x7f058c159390 2023-10-06T04:28:24.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.035+0000 7f0591d9d700 1 -- 172.21.15.60:0/4251469959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058c099770 con 0x7f058c159390 2023-10-06T04:28:24.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.036+0000 7f0591d9d700 1 -- 172.21.15.60:0/4251469959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058c0b2200 con 0x7f058c159390 2023-10-06T04:28:24.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.037+0000 7f0588ff9700 1 -- 172.21.15.60:0/4251469959 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0578012420 con 0x7f058c159390 2023-10-06T04:28:24.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.037+0000 7f0588ff9700 1 --2- 172.21.15.60:0/4251469959 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0570066f30 0x7f05700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:24.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.038+0000 7f0588ff9700 1 -- 172.21.15.60:0/4251469959 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0578083d40 con 0x7f058c159390 2023-10-06T04:28:24.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.038+0000 7f0590d9b700 1 --2- 172.21.15.60:0/4251469959 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0570066f30 0x7f05700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:24.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.038+0000 7f0590d9b700 1 --2- 172.21.15.60:0/4251469959 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0570066f30 0x7f05700693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05800093f0 tx=0x7f0580017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:24.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.042+0000 7f0588ff9700 1 -- 172.21.15.60:0/4251469959 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f057804b5a0 con 0x7f058c159390 2023-10-06T04:28:24.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.247+0000 7f0591d9d700 1 -- 172.21.15.60:0/4251469959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f058c05f230 con 0x7f058c159390 2023-10-06T04:28:24.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.248+0000 7f0588ff9700 1 -- 172.21.15.60:0/4251469959 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f0578017070 con 0x7f058c159390 2023-10-06T04:28:24.251 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:24.251 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:28:11.290557+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:28:04.355358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:28:05.208550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:28:08.791979+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:28:24.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.250+0000 7f0591d9d700 1 -- 172.21.15.60:0/4251469959 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0570066f30 msgr2=0x7f05700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:24.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.250+0000 7f0591d9d700 1 --2- 172.21.15.60:0/4251469959 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0570066f30 0x7f05700693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05800093f0 tx=0x7f0580017000 comp rx=0 tx=0).stop 2023-10-06T04:28:24.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.250+0000 7f0591d9d700 1 -- 172.21.15.60:0/4251469959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f058c159390 msgr2=0x7f058c099230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:24.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.250+0000 7f0591d9d700 1 --2- 172.21.15.60:0/4251469959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f058c159390 0x7f058c099230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f057800c590 tx=0x7f0578007f30 comp rx=0 tx=0).stop 2023-10-06T04:28:24.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.250+0000 7f0591d9d700 1 -- 172.21.15.60:0/4251469959 shutdown_connections 2023-10-06T04:28:24.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.250+0000 7f0591d9d700 1 --2- 172.21.15.60:0/4251469959 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0570066f30 0x7f05700693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:24.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.250+0000 7f0591d9d700 1 --2- 172.21.15.60:0/4251469959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f058c159760 0x7f058c1479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:24.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.250+0000 7f0591d9d700 1 --2- 172.21.15.60:0/4251469959 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f058c0ab410 0x7f058c06cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:24.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.250+0000 7f0591d9d700 1 --2- 172.21.15.60:0/4251469959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f058c159390 0x7f058c099230 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:24.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.250+0000 7f0591d9d700 1 -- 172.21.15.60:0/4251469959 >> 172.21.15.60:0/4251469959 conn(0x7f058c097410 msgr2=0x7f058c155b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:24.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.250+0000 7f0591d9d700 1 -- 172.21.15.60:0/4251469959 shutdown_connections 2023-10-06T04:28:24.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.250+0000 7f0591d9d700 1 -- 172.21.15.60:0/4251469959 wait complete. 2023-10-06T04:28:24.270 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T04:28:24.271 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:28:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.457+0000 7fe910d9d700 1 Processor -- start 2023-10-06T04:28:24.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.457+0000 7fe910d9d700 1 -- start start 2023-10-06T04:28:24.463 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.458+0000 7fe910d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe90c153e00 0x7fe90c06df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:24.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.458+0000 7fe910d9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe90c0c9cc0 con 0x7fe90c06a590 2023-10-06T04:28:24.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.458+0000 7fe910d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe90c0c6710 con 0x7fe90c06a960 2023-10-06T04:28:24.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.458+0000 7fe910d9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe90c06f560 con 0x7fe90c153e00 2023-10-06T04:28:24.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.458+0000 7fe90b7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe90c06a590 0x7fe90c1536f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56966/0 (socket says 172.21.15.60:56966) 2023-10-06T04:28:24.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.458+0000 7fe90b7fe700 1 -- 172.21.15.60:0/1495992199 learned_addr learned my addr 172.21.15.60:0/1495992199 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:24.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.458+0000 7fe90affd700 1 --2- 172.21.15.60:0/1495992199 >> v2:172.21.15.60:3300/0 conn(0x7fe90c153e00 0x7fe90c06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:24.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.459+0000 7fe90a7fc700 1 -- 172.21.15.60:0/1495992199 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475965212 0 0) 0x7fe90c0c9cc0 con 0x7fe90c06a590 2023-10-06T04:28:24.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.459+0000 7fe90a7fc700 1 -- 172.21.15.60:0/1495992199 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8f4003570 con 0x7fe90c06a590 2023-10-06T04:28:24.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.459+0000 7fe90a7fc700 1 -- 172.21.15.60:0/1495992199 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760231912 0 0) 0x7fe90c0c6710 con 0x7fe90c06a960 2023-10-06T04:28:24.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.459+0000 7fe90affd700 1 -- 172.21.15.60:0/1495992199 >> v1:172.21.15.135:6789/0 conn(0x7fe90c06a960 legacy=0x7fe90c06e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:24.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.459+0000 7fe90affd700 1 -- 172.21.15.60:0/1495992199 >> v1:172.21.15.60:6789/0 conn(0x7fe90c06a590 legacy=0x7fe90c1536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:24.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.459+0000 7fe90affd700 1 -- 172.21.15.60:0/1495992199 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90c06ecc0 con 0x7fe90c153e00 2023-10-06T04:28:24.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.459+0000 7fe90affd700 1 --2- 172.21.15.60:0/1495992199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe90c153e00 0x7fe90c06df50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe9000098e0 tx=0x7fe9000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1ad2306350557f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:24.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.460+0000 7fe90a7fc700 1 -- 172.21.15.60:0/1495992199 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90000f6b0 con 0x7fe90c153e00 2023-10-06T04:28:24.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.460+0000 7fe90a7fc700 1 -- 172.21.15.60:0/1495992199 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90000f810 con 0x7fe90c153e00 2023-10-06T04:28:24.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.460+0000 7fe90a7fc700 1 -- 172.21.15.60:0/1495992199 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90000fbb0 con 0x7fe90c153e00 2023-10-06T04:28:24.466 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.460+0000 7fe910d9d700 1 -- 172.21.15.60:0/1495992199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe90c153e00 msgr2=0x7fe90c06df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:24.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.460+0000 7fe910d9d700 1 --2- 172.21.15.60:0/1495992199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe90c153e00 0x7fe90c06df50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe9000098e0 tx=0x7fe9000091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:24.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.460+0000 7fe910d9d700 1 -- 172.21.15.60:0/1495992199 shutdown_connections 2023-10-06T04:28:24.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.460+0000 7fe910d9d700 1 --2- 172.21.15.60:0/1495992199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe90c153e00 0x7fe90c06df50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:24.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.460+0000 7fe910d9d700 1 -- 172.21.15.60:0/1495992199 >> 172.21.15.60:0/1495992199 conn(0x7fe90c068080 msgr2=0x7fe90c0cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:24.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.460+0000 7fe910d9d700 1 -- 172.21.15.60:0/1495992199 shutdown_connections 2023-10-06T04:28:24.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.460+0000 7fe910d9d700 1 -- 172.21.15.60:0/1495992199 wait complete. 2023-10-06T04:28:24.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.462+0000 7fe910d9d700 1 Processor -- start 2023-10-06T04:28:24.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.462+0000 7fe910d9d700 1 -- start start 2023-10-06T04:28:24.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.463+0000 7fe910d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe90c06a590 0x7fe90c14c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:24.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.463+0000 7fe910d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe90c06a960 0x7fe90c0afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:24.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.463+0000 7fe910d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe90c153e00 0x7fe90c0c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:24.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.463+0000 7fe910d9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c0b0e20 con 0x7fe90c06a960 2023-10-06T04:28:24.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.463+0000 7fe910d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c0c4b60 con 0x7fe90c06a590 2023-10-06T04:28:24.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.463+0000 7fe910d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c0b0580 con 0x7fe90c153e00 2023-10-06T04:28:24.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.463+0000 7fe90affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe90c06a960 0x7fe90c0afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:24.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.463+0000 7fe90affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe90c06a960 0x7fe90c0afc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51830/0 (socket says 172.21.15.60:51830) 2023-10-06T04:28:24.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.463+0000 7fe90affd700 1 -- 172.21.15.60:0/550788679 learned_addr learned my addr 172.21.15.60:0/550788679 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:24.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.463+0000 7fe90b7fe700 1 --2- 172.21.15.60:0/550788679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe90c06a590 0x7fe90c14c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:24.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.463+0000 7fe90bfff700 1 --2- 172.21.15.60:0/550788679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe90c153e00 0x7fe90c0c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:24.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.463+0000 7fe90affd700 1 -- 172.21.15.60:0/550788679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe90c153e00 msgr2=0x7fe90c0c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:24.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.463+0000 7fe90affd700 1 --2- 172.21.15.60:0/550788679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe90c153e00 0x7fe90c0c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:24.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.463+0000 7fe90affd700 1 -- 172.21.15.60:0/550788679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe90c06a590 msgr2=0x7fe90c14c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:24.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.463+0000 7fe90affd700 1 --2- 172.21.15.60:0/550788679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe90c06a590 0x7fe90c14c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:24.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.463+0000 7fe90affd700 1 -- 172.21.15.60:0/550788679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe900009420 con 0x7fe90c06a960 2023-10-06T04:28:24.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.464+0000 7fe90affd700 1 --2- 172.21.15.60:0/550788679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe90c06a960 0x7fe90c0afc30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe9000091e0 tx=0x7fe900019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:24.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.464+0000 7fe8f37fe700 1 -- 172.21.15.60:0/550788679 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe900000bc0 con 0x7fe90c06a960 2023-10-06T04:28:24.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.464+0000 7fe8f37fe700 1 -- 172.21.15.60:0/550788679 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90000f980 con 0x7fe90c06a960 2023-10-06T04:28:24.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.464+0000 7fe910d9d700 1 -- 172.21.15.60:0/550788679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe90c0b0860 con 0x7fe90c06a960 2023-10-06T04:28:24.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.464+0000 7fe8f37fe700 1 -- 172.21.15.60:0/550788679 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe900000d20 con 0x7fe90c06a960 2023-10-06T04:28:24.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.464+0000 7fe910d9d700 1 -- 172.21.15.60:0/550788679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe90c0b0170 con 0x7fe90c06a960 2023-10-06T04:28:24.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.465+0000 7fe910d9d700 1 -- 172.21.15.60:0/550788679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe90c05f230 con 0x7fe90c06a960 2023-10-06T04:28:24.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.466+0000 7fe8f37fe700 1 -- 172.21.15.60:0/550788679 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe900022070 con 0x7fe90c06a960 2023-10-06T04:28:24.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.467+0000 7fe8f37fe700 1 --2- 172.21.15.60:0/550788679 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe8f8066fb0 0x7fe8f8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:24.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.467+0000 7fe8f37fe700 1 -- 172.21.15.60:0/550788679 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe900014070 con 0x7fe90c06a960 2023-10-06T04:28:24.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.467+0000 7fe90b7fe700 1 --2- 172.21.15.60:0/550788679 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe8f8066fb0 0x7fe8f8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:24.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.468+0000 7fe90b7fe700 1 --2- 172.21.15.60:0/550788679 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe8f8066fb0 0x7fe8f8069460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe90c063c20 tx=0x7fe8fc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:24.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.471+0000 7fe8f37fe700 1 -- 172.21.15.60:0/550788679 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe900052a40 con 0x7fe90c06a960 2023-10-06T04:28:24.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.670+0000 7fe910d9d700 1 -- 172.21.15.60:0/550788679 --> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe90c0b0360 con 0x7fe8f8066fb0 2023-10-06T04:28:24.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.683+0000 7fe8f37fe700 1 -- 172.21.15.60:0/550788679 <== mgr.4098 v2:172.21.15.60:6832/85285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367629 (secure 0 0 0) 0x7fe8fc00f620 con 0x7fe8f8066fb0 2023-10-06T04:28:24.691 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:24.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.688+0000 7fe910d9d700 1 -- 172.21.15.60:0/550788679 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe8f8066fb0 msgr2=0x7fe8f8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:24.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.688+0000 7fe910d9d700 1 --2- 172.21.15.60:0/550788679 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe8f8066fb0 0x7fe8f8069460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe90c063c20 tx=0x7fe8fc009040 comp rx=0 tx=0).stop 2023-10-06T04:28:24.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.688+0000 7fe910d9d700 1 -- 172.21.15.60:0/550788679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe90c06a960 msgr2=0x7fe90c0afc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:24.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.688+0000 7fe910d9d700 1 --2- 172.21.15.60:0/550788679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe90c06a960 0x7fe90c0afc30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe9000091e0 tx=0x7fe900019000 comp rx=0 tx=0).stop 2023-10-06T04:28:24.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.688+0000 7fe910d9d700 1 -- 172.21.15.60:0/550788679 shutdown_connections 2023-10-06T04:28:24.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.688+0000 7fe910d9d700 1 --2- 172.21.15.60:0/550788679 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe8f8066fb0 0x7fe8f8069460 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:24.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.688+0000 7fe910d9d700 1 --2- 172.21.15.60:0/550788679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe90c153e00 0x7fe90c0c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:24.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.688+0000 7fe910d9d700 1 --2- 172.21.15.60:0/550788679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe90c06a590 0x7fe90c14c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:24.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.688+0000 7fe910d9d700 1 --2- 172.21.15.60:0/550788679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe90c06a960 0x7fe90c0afc30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:24.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.688+0000 7fe910d9d700 1 -- 172.21.15.60:0/550788679 >> 172.21.15.60:0/550788679 conn(0x7fe90c068080 msgr2=0x7fe90c0c13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:24.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.688+0000 7fe910d9d700 1 -- 172.21.15.60:0/550788679 shutdown_connections 2023-10-06T04:28:24.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:24.689+0000 7fe910d9d700 1 -- 172.21.15.60:0/550788679 wait complete. 2023-10-06T04:28:24.695 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-06T04:28:24.709 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2023-10-06T04:28:23.313814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593127,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":205,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397972,"kb_used_data":3284,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752576748,"statfs":{"total":773094113280,"available":770638589952,"internally_reserved":0,"allocated":3362816,"data_stored":2056575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":453,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.991800"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.767703+0000","last_change":"2023-10-06T04:28:06.333183+0000","last_active":"2023-10-06T04:28:10.767703+0000","last_peered":"2023-10-06T04:28:10.767703+0000","last_clean":"2023-10-06T04:28:10.767703+0000","last_became_active":"2023-10-06T04:28:06.332860+0000","last_became_peered":"2023-10-06T04:28:06.332860+0000","last_unstale":"2023-10-06T04:28:10.767703+0000","last_undegraded":"2023-10-06T04:28:10.767703+0000","last_fullsized":"2023-10-06T04:28:10.767703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:32.786074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.778681+0000","last_change":"2023-10-06T04:28:06.344458+0000","last_active":"2023-10-06T04:28:10.778681+0000","last_peered":"2023-10-06T04:28:10.778681+0000","last_clean":"2023-10-06T04:28:10.778681+0000","last_became_active":"2023-10-06T04:28:06.344197+0000","last_became_peered":"2023-10-06T04:28:06.344197+0000","last_unstale":"2023-10-06T04:28:10.778681+0000","last_undegraded":"2023-10-06T04:28:10.778681+0000","last_fullsized":"2023-10-06T04:28:10.778681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:34.925929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769634+0000","last_change":"2023-10-06T04:28:06.349096+0000","last_active":"2023-10-06T04:28:10.769634+0000","last_peered":"2023-10-06T04:28:10.769634+0000","last_clean":"2023-10-06T04:28:10.769634+0000","last_became_active":"2023-10-06T04:28:06.348569+0000","last_became_peered":"2023-10-06T04:28:06.348569+0000","last_unstale":"2023-10-06T04:28:10.769634+0000","last_undegraded":"2023-10-06T04:28:10.769634+0000","last_fullsized":"2023-10-06T04:28:10.769634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:32.246348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768718+0000","last_change":"2023-10-06T04:28:06.343369+0000","last_active":"2023-10-06T04:28:10.768718+0000","last_peered":"2023-10-06T04:28:10.768718+0000","last_clean":"2023-10-06T04:28:10.768718+0000","last_became_active":"2023-10-06T04:28:06.342720+0000","last_became_peered":"2023-10-06T04:28:06.342720+0000","last_unstale":"2023-10-06T04:28:10.768718+0000","last_undegraded":"2023-10-06T04:28:10.768718+0000","last_fullsized":"2023-10-06T04:28:10.768718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:25.121736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772088+0000","last_change":"2023-10-06T04:28:06.340210+0000","last_active":"2023-10-06T04:28:10.772088+0000","last_peered":"2023-10-06T04:28:10.772088+0000","last_clean":"2023-10-06T04:28:10.772088+0000","last_became_active":"2023-10-06T04:28:06.339725+0000","last_became_peered":"2023-10-06T04:28:06.339725+0000","last_unstale":"2023-10-06T04:28:10.772088+0000","last_undegraded":"2023-10-06T04:28:10.772088+0000","last_fullsized":"2023-10-06T04:28:10.772088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:59.952485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770264+0000","last_change":"2023-10-06T04:28:06.348877+0000","last_active":"2023-10-06T04:28:10.770264+0000","last_peered":"2023-10-06T04:28:10.770264+0000","last_clean":"2023-10-06T04:28:10.770264+0000","last_became_active":"2023-10-06T04:28:06.348593+0000","last_became_peered":"2023-10-06T04:28:06.348593+0000","last_unstale":"2023-10-06T04:28:10.770264+0000","last_undegraded":"2023-10-06T04:28:10.770264+0000","last_fullsized":"2023-10-06T04:28:10.770264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:58.373238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774127+0000","last_change":"2023-10-06T04:28:06.341608+0000","last_active":"2023-10-06T04:28:10.774127+0000","last_peered":"2023-10-06T04:28:10.774127+0000","last_clean":"2023-10-06T04:28:10.774127+0000","last_became_active":"2023-10-06T04:28:06.341341+0000","last_became_peered":"2023-10-06T04:28:06.341341+0000","last_unstale":"2023-10-06T04:28:10.774127+0000","last_undegraded":"2023-10-06T04:28:10.774127+0000","last_fullsized":"2023-10-06T04:28:10.774127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:25.299896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.775047+0000","last_change":"2023-10-06T04:28:06.352230+0000","last_active":"2023-10-06T04:28:10.775047+0000","last_peered":"2023-10-06T04:28:10.775047+0000","last_clean":"2023-10-06T04:28:10.775047+0000","last_became_active":"2023-10-06T04:28:06.351946+0000","last_became_peered":"2023-10-06T04:28:06.351946+0000","last_unstale":"2023-10-06T04:28:10.775047+0000","last_undegraded":"2023-10-06T04:28:10.775047+0000","last_fullsized":"2023-10-06T04:28:10.775047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:39.187212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769280+0000","last_change":"2023-10-06T04:28:06.349388+0000","last_active":"2023-10-06T04:28:10.769280+0000","last_peered":"2023-10-06T04:28:10.769280+0000","last_clean":"2023-10-06T04:28:10.769280+0000","last_became_active":"2023-10-06T04:28:06.349059+0000","last_became_peered":"2023-10-06T04:28:06.349059+0000","last_unstale":"2023-10-06T04:28:10.769280+0000","last_undegraded":"2023-10-06T04:28:10.769280+0000","last_fullsized":"2023-10-06T04:28:10.769280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:17.928102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.778830+0000","last_change":"2023-10-06T04:28:06.346835+0000","last_active":"2023-10-06T04:28:10.778830+0000","last_peered":"2023-10-06T04:28:10.778830+0000","last_clean":"2023-10-06T04:28:10.778830+0000","last_became_active":"2023-10-06T04:28:06.346555+0000","last_became_peered":"2023-10-06T04:28:06.346555+0000","last_unstale":"2023-10-06T04:28:10.778830+0000","last_undegraded":"2023-10-06T04:28:10.778830+0000","last_fullsized":"2023-10-06T04:28:10.778830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:27.073025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769556+0000","last_change":"2023-10-06T04:28:06.349715+0000","last_active":"2023-10-06T04:28:10.769556+0000","last_peered":"2023-10-06T04:28:10.769556+0000","last_clean":"2023-10-06T04:28:10.769556+0000","last_became_active":"2023-10-06T04:28:06.347463+0000","last_became_peered":"2023-10-06T04:28:06.347463+0000","last_unstale":"2023-10-06T04:28:10.769556+0000","last_undegraded":"2023-10-06T04:28:10.769556+0000","last_fullsized":"2023-10-06T04:28:10.769556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:20.864954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.766598+0000","last_change":"2023-10-06T04:28:06.352759+0000","last_active":"2023-10-06T04:28:10.766598+0000","last_peered":"2023-10-06T04:28:10.766598+0000","last_clean":"2023-10-06T04:28:10.766598+0000","last_became_active":"2023-10-06T04:28:06.352427+0000","last_became_peered":"2023-10-06T04:28:06.352427+0000","last_unstale":"2023-10-06T04:28:10.766598+0000","last_undegraded":"2023-10-06T04:28:10.766598+0000","last_fullsized":"2023-10-06T04:28:10.766598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:14.134133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768223+0000","last_change":"2023-10-06T04:28:06.331950+0000","last_active":"2023-10-06T04:28:10.768223+0000","last_peered":"2023-10-06T04:28:10.768223+0000","last_clean":"2023-10-06T04:28:10.768223+0000","last_became_active":"2023-10-06T04:28:06.331660+0000","last_became_peered":"2023-10-06T04:28:06.331660+0000","last_unstale":"2023-10-06T04:28:10.768223+0000","last_undegraded":"2023-10-06T04:28:10.768223+0000","last_fullsized":"2023-10-06T04:28:10.768223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:01:34.147816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.775071+0000","last_change":"2023-10-06T04:28:06.344093+0000","last_active":"2023-10-06T04:28:10.775071+0000","last_peered":"2023-10-06T04:28:10.775071+0000","last_clean":"2023-10-06T04:28:10.775071+0000","last_became_active":"2023-10-06T04:28:06.343647+0000","last_became_peered":"2023-10-06T04:28:06.343647+0000","last_unstale":"2023-10-06T04:28:10.775071+0000","last_undegraded":"2023-10-06T04:28:10.775071+0000","last_fullsized":"2023-10-06T04:28:10.775071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:25.299896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.773879+0000","last_change":"2023-10-06T04:28:06.341653+0000","last_active":"2023-10-06T04:28:10.773879+0000","last_peered":"2023-10-06T04:28:10.773879+0000","last_clean":"2023-10-06T04:28:10.773879+0000","last_became_active":"2023-10-06T04:28:06.341377+0000","last_became_peered":"2023-10-06T04:28:06.341377+0000","last_unstale":"2023-10-06T04:28:10.773879+0000","last_undegraded":"2023-10-06T04:28:10.773879+0000","last_fullsized":"2023-10-06T04:28:10.773879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:15.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770685+0000","last_change":"2023-10-06T04:28:06.348854+0000","last_active":"2023-10-06T04:28:10.770685+0000","last_peered":"2023-10-06T04:28:10.770685+0000","last_clean":"2023-10-06T04:28:10.770685+0000","last_became_active":"2023-10-06T04:28:06.348503+0000","last_became_peered":"2023-10-06T04:28:06.348503+0000","last_unstale":"2023-10-06T04:28:10.770685+0000","last_undegraded":"2023-10-06T04:28:10.770685+0000","last_fullsized":"2023-10-06T04:28:10.770685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:28.999532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769974+0000","last_change":"2023-10-06T04:28:06.344544+0000","last_active":"2023-10-06T04:28:10.769974+0000","last_peered":"2023-10-06T04:28:10.769974+0000","last_clean":"2023-10-06T04:28:10.769974+0000","last_became_active":"2023-10-06T04:28:06.342776+0000","last_became_peered":"2023-10-06T04:28:06.342776+0000","last_unstale":"2023-10-06T04:28:10.769974+0000","last_undegraded":"2023-10-06T04:28:10.769974+0000","last_fullsized":"2023-10-06T04:28:10.769974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:14.542716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769109+0000","last_change":"2023-10-06T04:28:06.352912+0000","last_active":"2023-10-06T04:28:10.769109+0000","last_peered":"2023-10-06T04:28:10.769109+0000","last_clean":"2023-10-06T04:28:10.769109+0000","last_became_active":"2023-10-06T04:28:06.352449+0000","last_became_peered":"2023-10-06T04:28:06.352449+0000","last_unstale":"2023-10-06T04:28:10.769109+0000","last_undegraded":"2023-10-06T04:28:10.769109+0000","last_fullsized":"2023-10-06T04:28:10.769109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:07.389056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768234+0000","last_change":"2023-10-06T04:28:06.339688+0000","last_active":"2023-10-06T04:28:10.768234+0000","last_peered":"2023-10-06T04:28:10.768234+0000","last_clean":"2023-10-06T04:28:10.768234+0000","last_became_active":"2023-10-06T04:28:06.339427+0000","last_became_peered":"2023-10-06T04:28:06.339427+0000","last_unstale":"2023-10-06T04:28:10.768234+0000","last_undegraded":"2023-10-06T04:28:10.768234+0000","last_fullsized":"2023-10-06T04:28:10.768234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:25.189214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771104+0000","last_change":"2023-10-06T04:28:06.351544+0000","last_active":"2023-10-06T04:28:10.771104+0000","last_peered":"2023-10-06T04:28:10.771104+0000","last_clean":"2023-10-06T04:28:10.771104+0000","last_became_active":"2023-10-06T04:28:06.351250+0000","last_became_peered":"2023-10-06T04:28:06.351250+0000","last_unstale":"2023-10-06T04:28:10.771104+0000","last_undegraded":"2023-10-06T04:28:10.771104+0000","last_fullsized":"2023-10-06T04:28:10.771104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:20.083329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776616+0000","last_change":"2023-10-06T04:28:06.339922+0000","last_active":"2023-10-06T04:28:10.776616+0000","last_peered":"2023-10-06T04:28:10.776616+0000","last_clean":"2023-10-06T04:28:10.776616+0000","last_became_active":"2023-10-06T04:28:06.339645+0000","last_became_peered":"2023-10-06T04:28:06.339645+0000","last_unstale":"2023-10-06T04:28:10.776616+0000","last_undegraded":"2023-10-06T04:28:10.776616+0000","last_fullsized":"2023-10-06T04:28:10.776616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:34.925929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769587+0000","last_change":"2023-10-06T04:28:06.340838+0000","last_active":"2023-10-06T04:28:10.769587+0000","last_peered":"2023-10-06T04:28:10.769587+0000","last_clean":"2023-10-06T04:28:10.769587+0000","last_became_active":"2023-10-06T04:28:06.340585+0000","last_became_peered":"2023-10-06T04:28:06.340585+0000","last_unstale":"2023-10-06T04:28:10.769587+0000","last_undegraded":"2023-10-06T04:28:10.769587+0000","last_fullsized":"2023-10-06T04:28:10.769587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:15.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772671+0000","last_change":"2023-10-06T04:28:06.341897+0000","last_active":"2023-10-06T04:28:10.772671+0000","last_peered":"2023-10-06T04:28:10.772671+0000","last_clean":"2023-10-06T04:28:10.772671+0000","last_became_active":"2023-10-06T04:28:06.341660+0000","last_became_peered":"2023-10-06T04:28:06.341660+0000","last_unstale":"2023-10-06T04:28:10.772671+0000","last_undegraded":"2023-10-06T04:28:10.772671+0000","last_fullsized":"2023-10-06T04:28:10.772671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:20.864954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.777630+0000","last_change":"2023-10-06T04:28:06.351307+0000","last_active":"2023-10-06T04:28:10.777630+0000","last_peered":"2023-10-06T04:28:10.777630+0000","last_clean":"2023-10-06T04:28:10.777630+0000","last_became_active":"2023-10-06T04:28:06.351018+0000","last_became_peered":"2023-10-06T04:28:06.351018+0000","last_unstale":"2023-10-06T04:28:10.777630+0000","last_undegraded":"2023-10-06T04:28:10.777630+0000","last_fullsized":"2023-10-06T04:28:10.777630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:39.187212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.773769+0000","last_change":"2023-10-06T04:28:06.335571+0000","last_active":"2023-10-06T04:28:10.773769+0000","last_peered":"2023-10-06T04:28:10.773769+0000","last_clean":"2023-10-06T04:28:10.773769+0000","last_became_active":"2023-10-06T04:28:06.335306+0000","last_became_peered":"2023-10-06T04:28:06.335306+0000","last_unstale":"2023-10-06T04:28:10.773769+0000","last_undegraded":"2023-10-06T04:28:10.773769+0000","last_fullsized":"2023-10-06T04:28:10.773769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:13.160015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.781232+0000","last_change":"2023-10-06T04:28:06.334344+0000","last_active":"2023-10-06T04:28:10.781232+0000","last_peered":"2023-10-06T04:28:10.781232+0000","last_clean":"2023-10-06T04:28:10.781232+0000","last_became_active":"2023-10-06T04:28:06.334085+0000","last_became_peered":"2023-10-06T04:28:06.334085+0000","last_unstale":"2023-10-06T04:28:10.781232+0000","last_undegraded":"2023-10-06T04:28:10.781232+0000","last_fullsized":"2023-10-06T04:28:10.781232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:30.857061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779760+0000","last_change":"2023-10-06T04:28:06.347690+0000","last_active":"2023-10-06T04:28:10.779760+0000","last_peered":"2023-10-06T04:28:10.779760+0000","last_clean":"2023-10-06T04:28:10.779760+0000","last_became_active":"2023-10-06T04:28:06.347352+0000","last_became_peered":"2023-10-06T04:28:06.347352+0000","last_unstale":"2023-10-06T04:28:10.779760+0000","last_undegraded":"2023-10-06T04:28:10.779760+0000","last_fullsized":"2023-10-06T04:28:10.779760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:15.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802995+0000","last_change":"2023-10-06T04:28:10.801453+0000","last_active":"2023-10-06T04:28:10.802995+0000","last_peered":"2023-10-06T04:28:10.802995+0000","last_clean":"2023-10-06T04:28:10.802995+0000","last_became_active":"2023-10-06T04:28:10.801079+0000","last_became_peered":"2023-10-06T04:28:10.801079+0000","last_unstale":"2023-10-06T04:28:10.802995+0000","last_undegraded":"2023-10-06T04:28:10.802995+0000","last_fullsized":"2023-10-06T04:28:10.802995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:36.131936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770166+0000","last_change":"2023-10-06T04:28:05.761188+0000","last_active":"2023-10-06T04:28:10.770166+0000","last_peered":"2023-10-06T04:28:10.770166+0000","last_clean":"2023-10-06T04:28:10.770166+0000","last_became_active":"2023-10-06T04:28:05.760899+0000","last_became_peered":"2023-10-06T04:28:05.760899+0000","last_unstale":"2023-10-06T04:28:10.770166+0000","last_undegraded":"2023-10-06T04:28:10.770166+0000","last_fullsized":"2023-10-06T04:28:10.770166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:01:33.139108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770473+0000","last_change":"2023-10-06T04:28:06.341518+0000","last_active":"2023-10-06T04:28:10.770473+0000","last_peered":"2023-10-06T04:28:10.770473+0000","last_clean":"2023-10-06T04:28:10.770473+0000","last_became_active":"2023-10-06T04:28:06.341202+0000","last_became_peered":"2023-10-06T04:28:06.341202+0000","last_unstale":"2023-10-06T04:28:10.770473+0000","last_undegraded":"2023-10-06T04:28:10.770473+0000","last_fullsized":"2023-10-06T04:28:10.770473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:59.952485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.801053+0000","last_change":"2023-10-06T04:28:10.795457+0000","last_active":"2023-10-06T04:28:10.801053+0000","last_peered":"2023-10-06T04:28:10.801053+0000","last_clean":"2023-10-06T04:28:10.801053+0000","last_became_active":"2023-10-06T04:28:10.795098+0000","last_became_peered":"2023-10-06T04:28:10.795098+0000","last_unstale":"2023-10-06T04:28:10.801053+0000","last_undegraded":"2023-10-06T04:28:10.801053+0000","last_fullsized":"2023-10-06T04:28:10.801053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:13.098060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776901+0000","last_change":"2023-10-06T04:28:05.756129+0000","last_active":"2023-10-06T04:28:10.776901+0000","last_peered":"2023-10-06T04:28:10.776901+0000","last_clean":"2023-10-06T04:28:10.776901+0000","last_became_active":"2023-10-06T04:28:05.755795+0000","last_became_peered":"2023-10-06T04:28:05.755795+0000","last_unstale":"2023-10-06T04:28:10.776901+0000","last_undegraded":"2023-10-06T04:28:10.776901+0000","last_fullsized":"2023-10-06T04:28:10.776901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:31.777366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769931+0000","last_change":"2023-10-06T04:28:06.345205+0000","last_active":"2023-10-06T04:28:10.769931+0000","last_peered":"2023-10-06T04:28:10.769931+0000","last_clean":"2023-10-06T04:28:10.769931+0000","last_became_active":"2023-10-06T04:28:06.342334+0000","last_became_peered":"2023-10-06T04:28:06.342334+0000","last_unstale":"2023-10-06T04:28:10.769931+0000","last_undegraded":"2023-10-06T04:28:10.769931+0000","last_fullsized":"2023-10-06T04:28:10.769931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:27.073025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.793941+0000","last_change":"2023-10-06T04:28:10.792492+0000","last_active":"2023-10-06T04:28:10.793941+0000","last_peered":"2023-10-06T04:28:10.793941+0000","last_clean":"2023-10-06T04:28:10.793941+0000","last_became_active":"2023-10-06T04:28:10.791665+0000","last_became_peered":"2023-10-06T04:28:10.791665+0000","last_unstale":"2023-10-06T04:28:10.793941+0000","last_undegraded":"2023-10-06T04:28:10.793941+0000","last_fullsized":"2023-10-06T04:28:10.793941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:52.113969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771973+0000","last_change":"2023-10-06T04:28:05.766695+0000","last_active":"2023-10-06T04:28:10.771973+0000","last_peered":"2023-10-06T04:28:10.771973+0000","last_clean":"2023-10-06T04:28:10.771973+0000","last_became_active":"2023-10-06T04:28:05.766394+0000","last_became_peered":"2023-10-06T04:28:05.766394+0000","last_unstale":"2023-10-06T04:28:10.771973+0000","last_undegraded":"2023-10-06T04:28:10.771973+0000","last_fullsized":"2023-10-06T04:28:10.771973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:01.869120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769616+0000","last_change":"2023-10-06T04:28:06.340699+0000","last_active":"2023-10-06T04:28:10.769616+0000","last_peered":"2023-10-06T04:28:10.769616+0000","last_clean":"2023-10-06T04:28:10.769616+0000","last_became_active":"2023-10-06T04:28:06.339789+0000","last_became_peered":"2023-10-06T04:28:06.339789+0000","last_unstale":"2023-10-06T04:28:10.769616+0000","last_undegraded":"2023-10-06T04:28:10.769616+0000","last_fullsized":"2023-10-06T04:28:10.769616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:30.857061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.807709+0000","last_change":"2023-10-06T04:28:10.804204+0000","last_active":"2023-10-06T04:28:10.807709+0000","last_peered":"2023-10-06T04:28:10.807709+0000","last_clean":"2023-10-06T04:28:10.807709+0000","last_became_active":"2023-10-06T04:28:10.803790+0000","last_became_peered":"2023-10-06T04:28:10.803790+0000","last_unstale":"2023-10-06T04:28:10.807709+0000","last_undegraded":"2023-10-06T04:28:10.807709+0000","last_fullsized":"2023-10-06T04:28:10.807709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:24.109196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770090+0000","last_change":"2023-10-06T04:28:05.755711+0000","last_active":"2023-10-06T04:28:10.770090+0000","last_peered":"2023-10-06T04:28:10.770090+0000","last_clean":"2023-10-06T04:28:10.770090+0000","last_became_active":"2023-10-06T04:28:05.755078+0000","last_became_peered":"2023-10-06T04:28:05.755078+0000","last_unstale":"2023-10-06T04:28:10.770090+0000","last_undegraded":"2023-10-06T04:28:10.770090+0000","last_fullsized":"2023-10-06T04:28:10.770090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:13.125425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771897+0000","last_change":"2023-10-06T04:28:06.341424+0000","last_active":"2023-10-06T04:28:10.771897+0000","last_peered":"2023-10-06T04:28:10.771897+0000","last_clean":"2023-10-06T04:28:10.771897+0000","last_became_active":"2023-10-06T04:28:06.341143+0000","last_became_peered":"2023-10-06T04:28:06.341143+0000","last_unstale":"2023-10-06T04:28:10.771897+0000","last_undegraded":"2023-10-06T04:28:10.771897+0000","last_fullsized":"2023-10-06T04:28:10.771897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:58.373238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802044+0000","last_change":"2023-10-06T04:28:10.795677+0000","last_active":"2023-10-06T04:28:10.802044+0000","last_peered":"2023-10-06T04:28:10.802044+0000","last_clean":"2023-10-06T04:28:10.802044+0000","last_became_active":"2023-10-06T04:28:10.795322+0000","last_became_peered":"2023-10-06T04:28:10.795322+0000","last_unstale":"2023-10-06T04:28:10.802044+0000","last_undegraded":"2023-10-06T04:28:10.802044+0000","last_fullsized":"2023-10-06T04:28:10.802044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:43.446834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.778777+0000","last_change":"2023-10-06T04:28:05.755211+0000","last_active":"2023-10-06T04:28:10.778777+0000","last_peered":"2023-10-06T04:28:10.778777+0000","last_clean":"2023-10-06T04:28:10.778777+0000","last_became_active":"2023-10-06T04:28:05.754921+0000","last_became_peered":"2023-10-06T04:28:05.754921+0000","last_unstale":"2023-10-06T04:28:10.778777+0000","last_undegraded":"2023-10-06T04:28:10.778777+0000","last_fullsized":"2023-10-06T04:28:10.778777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:24.180507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772506+0000","last_change":"2023-10-06T04:28:06.337449+0000","last_active":"2023-10-06T04:28:10.772506+0000","last_peered":"2023-10-06T04:28:10.772506+0000","last_clean":"2023-10-06T04:28:10.772506+0000","last_became_active":"2023-10-06T04:28:06.337164+0000","last_became_peered":"2023-10-06T04:28:06.337164+0000","last_unstale":"2023-10-06T04:28:10.772506+0000","last_undegraded":"2023-10-06T04:28:10.772506+0000","last_fullsized":"2023-10-06T04:28:10.772506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:39.187212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.809084+0000","last_change":"2023-10-06T04:28:10.805106+0000","last_active":"2023-10-06T04:28:10.809084+0000","last_peered":"2023-10-06T04:28:10.809084+0000","last_clean":"2023-10-06T04:28:10.809084+0000","last_became_active":"2023-10-06T04:28:10.804660+0000","last_became_peered":"2023-10-06T04:28:10.804660+0000","last_unstale":"2023-10-06T04:28:10.809084+0000","last_undegraded":"2023-10-06T04:28:10.809084+0000","last_fullsized":"2023-10-06T04:28:10.809084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:33:06.767121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779391+0000","last_change":"2023-10-06T04:28:05.763511+0000","last_active":"2023-10-06T04:28:10.779391+0000","last_peered":"2023-10-06T04:28:10.779391+0000","last_clean":"2023-10-06T04:28:10.779391+0000","last_became_active":"2023-10-06T04:28:05.763165+0000","last_became_peered":"2023-10-06T04:28:05.763165+0000","last_unstale":"2023-10-06T04:28:10.779391+0000","last_undegraded":"2023-10-06T04:28:10.779391+0000","last_fullsized":"2023-10-06T04:28:10.779391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:58.212679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.780725+0000","last_change":"2023-10-06T04:28:06.335419+0000","last_active":"2023-10-06T04:28:10.780725+0000","last_peered":"2023-10-06T04:28:10.780725+0000","last_clean":"2023-10-06T04:28:10.780725+0000","last_became_active":"2023-10-06T04:28:06.335165+0000","last_became_peered":"2023-10-06T04:28:06.335165+0000","last_unstale":"2023-10-06T04:28:10.780725+0000","last_undegraded":"2023-10-06T04:28:10.780725+0000","last_fullsized":"2023-10-06T04:28:10.780725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:15.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.795671+0000","last_change":"2023-10-06T04:28:10.791897+0000","last_active":"2023-10-06T04:28:10.795671+0000","last_peered":"2023-10-06T04:28:10.795671+0000","last_clean":"2023-10-06T04:28:10.795671+0000","last_became_active":"2023-10-06T04:28:10.791427+0000","last_became_peered":"2023-10-06T04:28:10.791427+0000","last_unstale":"2023-10-06T04:28:10.795671+0000","last_undegraded":"2023-10-06T04:28:10.795671+0000","last_fullsized":"2023-10-06T04:28:10.795671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:23.024555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'7","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T04:28:11.325695+0000","last_change":"2023-10-06T04:28:05.756961+0000","last_active":"2023-10-06T04:28:11.325695+0000","last_peered":"2023-10-06T04:28:11.325695+0000","last_clean":"2023-10-06T04:28:11.325695+0000","last_became_active":"2023-10-06T04:28:05.756443+0000","last_became_peered":"2023-10-06T04:28:05.756443+0000","last_unstale":"2023-10-06T04:28:11.325695+0000","last_undegraded":"2023-10-06T04:28:11.325695+0000","last_fullsized":"2023-10-06T04:28:11.325695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:15.728042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1989,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768364+0000","last_change":"2023-10-06T04:28:06.350205+0000","last_active":"2023-10-06T04:28:10.768364+0000","last_peered":"2023-10-06T04:28:10.768364+0000","last_clean":"2023-10-06T04:28:10.768364+0000","last_became_active":"2023-10-06T04:28:06.347777+0000","last_became_peered":"2023-10-06T04:28:06.347777+0000","last_unstale":"2023-10-06T04:28:10.768364+0000","last_undegraded":"2023-10-06T04:28:10.768364+0000","last_fullsized":"2023-10-06T04:28:10.768364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:24:58.690599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.800408+0000","last_change":"2023-10-06T04:28:10.799162+0000","last_active":"2023-10-06T04:28:10.800408+0000","last_peered":"2023-10-06T04:28:10.800408+0000","last_clean":"2023-10-06T04:28:10.800408+0000","last_became_active":"2023-10-06T04:28:10.798723+0000","last_became_peered":"2023-10-06T04:28:10.798723+0000","last_unstale":"2023-10-06T04:28:10.800408+0000","last_undegraded":"2023-10-06T04:28:10.800408+0000","last_fullsized":"2023-10-06T04:28:10.800408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:57.373019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776524+0000","last_change":"2023-10-06T04:28:05.762181+0000","last_active":"2023-10-06T04:28:10.776524+0000","last_peered":"2023-10-06T04:28:10.776524+0000","last_clean":"2023-10-06T04:28:10.776524+0000","last_became_active":"2023-10-06T04:28:05.761833+0000","last_became_peered":"2023-10-06T04:28:05.761833+0000","last_unstale":"2023-10-06T04:28:10.776524+0000","last_undegraded":"2023-10-06T04:28:10.776524+0000","last_fullsized":"2023-10-06T04:28:10.776524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:31.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770860+0000","last_change":"2023-10-06T04:28:06.340906+0000","last_active":"2023-10-06T04:28:10.770860+0000","last_peered":"2023-10-06T04:28:10.770860+0000","last_clean":"2023-10-06T04:28:10.770860+0000","last_became_active":"2023-10-06T04:28:06.340662+0000","last_became_peered":"2023-10-06T04:28:06.340662+0000","last_unstale":"2023-10-06T04:28:10.770860+0000","last_undegraded":"2023-10-06T04:28:10.770860+0000","last_fullsized":"2023-10-06T04:28:10.770860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:17.928102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.809048+0000","last_change":"2023-10-06T04:28:10.804183+0000","last_active":"2023-10-06T04:28:10.809048+0000","last_peered":"2023-10-06T04:28:10.809048+0000","last_clean":"2023-10-06T04:28:10.809048+0000","last_became_active":"2023-10-06T04:28:10.803784+0000","last_became_peered":"2023-10-06T04:28:10.803784+0000","last_unstale":"2023-10-06T04:28:10.809048+0000","last_undegraded":"2023-10-06T04:28:10.809048+0000","last_fullsized":"2023-10-06T04:28:10.809048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:31.800551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769741+0000","last_change":"2023-10-06T04:28:05.750972+0000","last_active":"2023-10-06T04:28:10.769741+0000","last_peered":"2023-10-06T04:28:10.769741+0000","last_clean":"2023-10-06T04:28:10.769741+0000","last_became_active":"2023-10-06T04:28:05.750669+0000","last_became_peered":"2023-10-06T04:28:05.750669+0000","last_unstale":"2023-10-06T04:28:10.769741+0000","last_undegraded":"2023-10-06T04:28:10.769741+0000","last_fullsized":"2023-10-06T04:28:10.769741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:24.180507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779676+0000","last_change":"2023-10-06T04:28:06.347817+0000","last_active":"2023-10-06T04:28:10.779676+0000","last_peered":"2023-10-06T04:28:10.779676+0000","last_clean":"2023-10-06T04:28:10.779676+0000","last_became_active":"2023-10-06T04:28:06.347502+0000","last_became_peered":"2023-10-06T04:28:06.347502+0000","last_unstale":"2023-10-06T04:28:10.779676+0000","last_undegraded":"2023-10-06T04:28:10.779676+0000","last_fullsized":"2023-10-06T04:28:10.779676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:13.160015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.809120+0000","last_change":"2023-10-06T04:28:10.805867+0000","last_active":"2023-10-06T04:28:10.809120+0000","last_peered":"2023-10-06T04:28:10.809120+0000","last_clean":"2023-10-06T04:28:10.809120+0000","last_became_active":"2023-10-06T04:28:10.805292+0000","last_became_peered":"2023-10-06T04:28:10.805292+0000","last_unstale":"2023-10-06T04:28:10.809120+0000","last_undegraded":"2023-10-06T04:28:10.809120+0000","last_fullsized":"2023-10-06T04:28:10.809120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:21.459093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774023+0000","last_change":"2023-10-06T04:28:05.758582+0000","last_active":"2023-10-06T04:28:10.774023+0000","last_peered":"2023-10-06T04:28:10.774023+0000","last_clean":"2023-10-06T04:28:10.774023+0000","last_became_active":"2023-10-06T04:28:05.758300+0000","last_became_peered":"2023-10-06T04:28:05.758300+0000","last_unstale":"2023-10-06T04:28:10.774023+0000","last_undegraded":"2023-10-06T04:28:10.774023+0000","last_fullsized":"2023-10-06T04:28:10.774023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:46.282985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770173+0000","last_change":"2023-10-06T04:28:06.347051+0000","last_active":"2023-10-06T04:28:10.770173+0000","last_peered":"2023-10-06T04:28:10.770173+0000","last_clean":"2023-10-06T04:28:10.770173+0000","last_became_active":"2023-10-06T04:28:06.346605+0000","last_became_peered":"2023-10-06T04:28:06.346605+0000","last_unstale":"2023-10-06T04:28:10.770173+0000","last_undegraded":"2023-10-06T04:28:10.770173+0000","last_fullsized":"2023-10-06T04:28:10.770173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:28.999532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.799625+0000","last_change":"2023-10-06T04:28:10.797651+0000","last_active":"2023-10-06T04:28:10.799625+0000","last_peered":"2023-10-06T04:28:10.799625+0000","last_clean":"2023-10-06T04:28:10.799625+0000","last_became_active":"2023-10-06T04:28:10.797232+0000","last_became_peered":"2023-10-06T04:28:10.797232+0000","last_unstale":"2023-10-06T04:28:10.799625+0000","last_undegraded":"2023-10-06T04:28:10.799625+0000","last_fullsized":"2023-10-06T04:28:10.799625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:11.414923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769762+0000","last_change":"2023-10-06T04:28:05.742570+0000","last_active":"2023-10-06T04:28:10.769762+0000","last_peered":"2023-10-06T04:28:10.769762+0000","last_clean":"2023-10-06T04:28:10.769762+0000","last_became_active":"2023-10-06T04:28:05.742241+0000","last_became_peered":"2023-10-06T04:28:05.742241+0000","last_unstale":"2023-10-06T04:28:10.769762+0000","last_undegraded":"2023-10-06T04:28:10.769762+0000","last_fullsized":"2023-10-06T04:28:10.769762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:13.125425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770855+0000","last_change":"2023-10-06T04:28:06.337353+0000","last_active":"2023-10-06T04:28:10.770855+0000","last_peered":"2023-10-06T04:28:10.770855+0000","last_clean":"2023-10-06T04:28:10.770855+0000","last_became_active":"2023-10-06T04:28:06.337087+0000","last_became_peered":"2023-10-06T04:28:06.337087+0000","last_unstale":"2023-10-06T04:28:10.770855+0000","last_undegraded":"2023-10-06T04:28:10.770855+0000","last_fullsized":"2023-10-06T04:28:10.770855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:36.507036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802188+0000","last_change":"2023-10-06T04:28:10.800008+0000","last_active":"2023-10-06T04:28:10.802188+0000","last_peered":"2023-10-06T04:28:10.802188+0000","last_clean":"2023-10-06T04:28:10.802188+0000","last_became_active":"2023-10-06T04:28:10.799373+0000","last_became_peered":"2023-10-06T04:28:10.799373+0000","last_unstale":"2023-10-06T04:28:10.802188+0000","last_undegraded":"2023-10-06T04:28:10.802188+0000","last_fullsized":"2023-10-06T04:28:10.802188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:23.024555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.780048+0000","last_change":"2023-10-06T04:28:05.762026+0000","last_active":"2023-10-06T04:28:10.780048+0000","last_peered":"2023-10-06T04:28:10.780048+0000","last_clean":"2023-10-06T04:28:10.780048+0000","last_became_active":"2023-10-06T04:28:05.761745+0000","last_became_peered":"2023-10-06T04:28:05.761745+0000","last_unstale":"2023-10-06T04:28:10.780048+0000","last_undegraded":"2023-10-06T04:28:10.780048+0000","last_fullsized":"2023-10-06T04:28:10.780048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:25.024995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774954+0000","last_change":"2023-10-06T04:28:06.346072+0000","last_active":"2023-10-06T04:28:10.774954+0000","last_peered":"2023-10-06T04:28:10.774954+0000","last_clean":"2023-10-06T04:28:10.774954+0000","last_became_active":"2023-10-06T04:28:06.345770+0000","last_became_peered":"2023-10-06T04:28:06.345770+0000","last_unstale":"2023-10-06T04:28:10.774954+0000","last_undegraded":"2023-10-06T04:28:10.774954+0000","last_fullsized":"2023-10-06T04:28:10.774954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:53.248928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.785697+0000","last_change":"2023-10-06T04:28:10.784166+0000","last_active":"2023-10-06T04:28:10.785697+0000","last_peered":"2023-10-06T04:28:10.785697+0000","last_clean":"2023-10-06T04:28:10.785697+0000","last_became_active":"2023-10-06T04:28:10.783671+0000","last_became_peered":"2023-10-06T04:28:10.783671+0000","last_unstale":"2023-10-06T04:28:10.785697+0000","last_undegraded":"2023-10-06T04:28:10.785697+0000","last_fullsized":"2023-10-06T04:28:10.785697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:18.568583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776289+0000","last_change":"2023-10-06T04:28:05.762151+0000","last_active":"2023-10-06T04:28:10.776289+0000","last_peered":"2023-10-06T04:28:10.776289+0000","last_clean":"2023-10-06T04:28:10.776289+0000","last_became_active":"2023-10-06T04:28:05.761792+0000","last_became_peered":"2023-10-06T04:28:05.761792+0000","last_unstale":"2023-10-06T04:28:10.776289+0000","last_undegraded":"2023-10-06T04:28:10.776289+0000","last_fullsized":"2023-10-06T04:28:10.776289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:01.869120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769462+0000","last_change":"2023-10-06T04:28:06.350312+0000","last_active":"2023-10-06T04:28:10.769462+0000","last_peered":"2023-10-06T04:28:10.769462+0000","last_clean":"2023-10-06T04:28:10.769462+0000","last_became_active":"2023-10-06T04:28:06.349971+0000","last_became_peered":"2023-10-06T04:28:06.349971+0000","last_unstale":"2023-10-06T04:28:10.769462+0000","last_undegraded":"2023-10-06T04:28:10.769462+0000","last_fullsized":"2023-10-06T04:28:10.769462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:03.824145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.782164+0000","last_change":"2023-10-06T04:28:10.780132+0000","last_active":"2023-10-06T04:28:10.782164+0000","last_peered":"2023-10-06T04:28:10.782164+0000","last_clean":"2023-10-06T04:28:10.782164+0000","last_became_active":"2023-10-06T04:28:10.779808+0000","last_became_peered":"2023-10-06T04:28:10.779808+0000","last_unstale":"2023-10-06T04:28:10.782164+0000","last_undegraded":"2023-10-06T04:28:10.782164+0000","last_fullsized":"2023-10-06T04:28:10.782164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:36.272215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779299+0000","last_change":"2023-10-06T04:28:05.756128+0000","last_active":"2023-10-06T04:28:10.779299+0000","last_peered":"2023-10-06T04:28:10.779299+0000","last_clean":"2023-10-06T04:28:10.779299+0000","last_became_active":"2023-10-06T04:28:05.755749+0000","last_became_peered":"2023-10-06T04:28:05.755749+0000","last_unstale":"2023-10-06T04:28:10.779299+0000","last_undegraded":"2023-10-06T04:28:10.779299+0000","last_fullsized":"2023-10-06T04:28:10.779299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:53.511624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768694+0000","last_change":"2023-10-06T04:28:06.340325+0000","last_active":"2023-10-06T04:28:10.768694+0000","last_peered":"2023-10-06T04:28:10.768694+0000","last_clean":"2023-10-06T04:28:10.768694+0000","last_became_active":"2023-10-06T04:28:06.339640+0000","last_became_peered":"2023-10-06T04:28:06.339640+0000","last_unstale":"2023-10-06T04:28:10.768694+0000","last_undegraded":"2023-10-06T04:28:10.768694+0000","last_fullsized":"2023-10-06T04:28:10.768694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:13.160015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802745+0000","last_change":"2023-10-06T04:28:10.797879+0000","last_active":"2023-10-06T04:28:10.802745+0000","last_peered":"2023-10-06T04:28:10.802745+0000","last_clean":"2023-10-06T04:28:10.802745+0000","last_became_active":"2023-10-06T04:28:10.797454+0000","last_became_peered":"2023-10-06T04:28:10.797454+0000","last_unstale":"2023-10-06T04:28:10.802745+0000","last_undegraded":"2023-10-06T04:28:10.802745+0000","last_fullsized":"2023-10-06T04:28:10.802745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:21.953970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776131+0000","last_change":"2023-10-06T04:28:05.763894+0000","last_active":"2023-10-06T04:28:10.776131+0000","last_peered":"2023-10-06T04:28:10.776131+0000","last_clean":"2023-10-06T04:28:10.776131+0000","last_became_active":"2023-10-06T04:28:05.763596+0000","last_became_peered":"2023-10-06T04:28:05.763596+0000","last_unstale":"2023-10-06T04:28:10.776131+0000","last_undegraded":"2023-10-06T04:28:10.776131+0000","last_fullsized":"2023-10-06T04:28:10.776131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:31.777366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772230+0000","last_change":"2023-10-06T04:28:06.342227+0000","last_active":"2023-10-06T04:28:10.772230+0000","last_peered":"2023-10-06T04:28:10.772230+0000","last_clean":"2023-10-06T04:28:10.772230+0000","last_became_active":"2023-10-06T04:28:06.341974+0000","last_became_peered":"2023-10-06T04:28:06.341974+0000","last_unstale":"2023-10-06T04:28:10.772230+0000","last_undegraded":"2023-10-06T04:28:10.772230+0000","last_fullsized":"2023-10-06T04:28:10.772230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:34.925929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.795509+0000","last_change":"2023-10-06T04:28:10.790497+0000","last_active":"2023-10-06T04:28:10.795509+0000","last_peered":"2023-10-06T04:28:10.795509+0000","last_clean":"2023-10-06T04:28:10.795509+0000","last_became_active":"2023-10-06T04:28:10.790006+0000","last_became_peered":"2023-10-06T04:28:10.790006+0000","last_unstale":"2023-10-06T04:28:10.795509+0000","last_undegraded":"2023-10-06T04:28:10.795509+0000","last_fullsized":"2023-10-06T04:28:10.795509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:33.025399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771405+0000","last_change":"2023-10-06T04:28:05.762781+0000","last_active":"2023-10-06T04:28:10.771405+0000","last_peered":"2023-10-06T04:28:10.771405+0000","last_clean":"2023-10-06T04:28:10.771405+0000","last_became_active":"2023-10-06T04:28:05.762020+0000","last_became_peered":"2023-10-06T04:28:05.762020+0000","last_unstale":"2023-10-06T04:28:10.771405+0000","last_undegraded":"2023-10-06T04:28:10.771405+0000","last_fullsized":"2023-10-06T04:28:10.771405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:25.024995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770971+0000","last_change":"2023-10-06T04:28:06.349404+0000","last_active":"2023-10-06T04:28:10.770971+0000","last_peered":"2023-10-06T04:28:10.770971+0000","last_clean":"2023-10-06T04:28:10.770971+0000","last_became_active":"2023-10-06T04:28:06.349122+0000","last_became_peered":"2023-10-06T04:28:06.349122+0000","last_unstale":"2023-10-06T04:28:10.770971+0000","last_undegraded":"2023-10-06T04:28:10.770971+0000","last_fullsized":"2023-10-06T04:28:10.770971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:59.952485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.801165+0000","last_change":"2023-10-06T04:28:10.796293+0000","last_active":"2023-10-06T04:28:10.801165+0000","last_peered":"2023-10-06T04:28:10.801165+0000","last_clean":"2023-10-06T04:28:10.801165+0000","last_became_active":"2023-10-06T04:28:10.795652+0000","last_became_peered":"2023-10-06T04:28:10.795652+0000","last_unstale":"2023-10-06T04:28:10.801165+0000","last_undegraded":"2023-10-06T04:28:10.801165+0000","last_fullsized":"2023-10-06T04:28:10.801165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:32.517736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768694+0000","last_change":"2023-10-06T04:28:05.758453+0000","last_active":"2023-10-06T04:28:10.768694+0000","last_peered":"2023-10-06T04:28:10.768694+0000","last_clean":"2023-10-06T04:28:10.768694+0000","last_became_active":"2023-10-06T04:28:05.758154+0000","last_became_peered":"2023-10-06T04:28:05.758154+0000","last_unstale":"2023-10-06T04:28:10.768694+0000","last_undegraded":"2023-10-06T04:28:10.768694+0000","last_fullsized":"2023-10-06T04:28:10.768694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:24.180507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769342+0000","last_change":"2023-10-06T04:28:06.353299+0000","last_active":"2023-10-06T04:28:10.769342+0000","last_peered":"2023-10-06T04:28:10.769342+0000","last_clean":"2023-10-06T04:28:10.769342+0000","last_became_active":"2023-10-06T04:28:06.352474+0000","last_became_peered":"2023-10-06T04:28:06.352474+0000","last_unstale":"2023-10-06T04:28:10.769342+0000","last_undegraded":"2023-10-06T04:28:10.769342+0000","last_fullsized":"2023-10-06T04:28:10.769342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:28.491869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.798862+0000","last_change":"2023-10-06T04:28:10.792443+0000","last_active":"2023-10-06T04:28:10.798862+0000","last_peered":"2023-10-06T04:28:10.798862+0000","last_clean":"2023-10-06T04:28:10.798862+0000","last_became_active":"2023-10-06T04:28:10.791995+0000","last_became_peered":"2023-10-06T04:28:10.791995+0000","last_unstale":"2023-10-06T04:28:10.798862+0000","last_undegraded":"2023-10-06T04:28:10.798862+0000","last_fullsized":"2023-10-06T04:28:10.798862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:12.226268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769340+0000","last_change":"2023-10-06T04:28:05.757101+0000","last_active":"2023-10-06T04:28:10.769340+0000","last_peered":"2023-10-06T04:28:10.769340+0000","last_clean":"2023-10-06T04:28:10.769340+0000","last_became_active":"2023-10-06T04:28:05.756775+0000","last_became_peered":"2023-10-06T04:28:05.756775+0000","last_unstale":"2023-10-06T04:28:10.769340+0000","last_undegraded":"2023-10-06T04:28:10.769340+0000","last_fullsized":"2023-10-06T04:28:10.769340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:37.282042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769202+0000","last_change":"2023-10-06T04:28:06.351787+0000","last_active":"2023-10-06T04:28:10.769202+0000","last_peered":"2023-10-06T04:28:10.769202+0000","last_clean":"2023-10-06T04:28:10.769202+0000","last_became_active":"2023-10-06T04:28:06.351250+0000","last_became_peered":"2023-10-06T04:28:06.351250+0000","last_unstale":"2023-10-06T04:28:10.769202+0000","last_undegraded":"2023-10-06T04:28:10.769202+0000","last_fullsized":"2023-10-06T04:28:10.769202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:09.072192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802887+0000","last_change":"2023-10-06T04:28:10.798603+0000","last_active":"2023-10-06T04:28:10.802887+0000","last_peered":"2023-10-06T04:28:10.802887+0000","last_clean":"2023-10-06T04:28:10.802887+0000","last_became_active":"2023-10-06T04:28:10.798140+0000","last_became_peered":"2023-10-06T04:28:10.798140+0000","last_unstale":"2023-10-06T04:28:10.802887+0000","last_undegraded":"2023-10-06T04:28:10.802887+0000","last_fullsized":"2023-10-06T04:28:10.802887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:13.693194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771821+0000","last_change":"2023-10-06T04:28:05.761077+0000","last_active":"2023-10-06T04:28:10.771821+0000","last_peered":"2023-10-06T04:28:10.771821+0000","last_clean":"2023-10-06T04:28:10.771821+0000","last_became_active":"2023-10-06T04:28:05.760800+0000","last_became_peered":"2023-10-06T04:28:05.760800+0000","last_unstale":"2023-10-06T04:28:10.771821+0000","last_undegraded":"2023-10-06T04:28:10.771821+0000","last_fullsized":"2023-10-06T04:28:10.771821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:24.180507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776545+0000","last_change":"2023-10-06T04:28:06.338307+0000","last_active":"2023-10-06T04:28:10.776545+0000","last_peered":"2023-10-06T04:28:10.776545+0000","last_clean":"2023-10-06T04:28:10.776545+0000","last_became_active":"2023-10-06T04:28:06.338025+0000","last_became_peered":"2023-10-06T04:28:06.338025+0000","last_unstale":"2023-10-06T04:28:10.776545+0000","last_undegraded":"2023-10-06T04:28:10.776545+0000","last_fullsized":"2023-10-06T04:28:10.776545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:25.299896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802825+0000","last_change":"2023-10-06T04:28:10.796279+0000","last_active":"2023-10-06T04:28:10.802825+0000","last_peered":"2023-10-06T04:28:10.802825+0000","last_clean":"2023-10-06T04:28:10.802825+0000","last_became_active":"2023-10-06T04:28:10.795554+0000","last_became_peered":"2023-10-06T04:28:10.795554+0000","last_unstale":"2023-10-06T04:28:10.802825+0000","last_undegraded":"2023-10-06T04:28:10.802825+0000","last_fullsized":"2023-10-06T04:28:10.802825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:52.320723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770652+0000","last_change":"2023-10-06T04:28:05.754602+0000","last_active":"2023-10-06T04:28:10.770652+0000","last_peered":"2023-10-06T04:28:10.770652+0000","last_clean":"2023-10-06T04:28:10.770652+0000","last_became_active":"2023-10-06T04:28:05.754262+0000","last_became_peered":"2023-10-06T04:28:05.754262+0000","last_unstale":"2023-10-06T04:28:10.770652+0000","last_undegraded":"2023-10-06T04:28:10.770652+0000","last_fullsized":"2023-10-06T04:28:10.770652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:15.728042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769463+0000","last_change":"2023-10-06T04:28:00.325832+0000","last_active":"2023-10-06T04:28:10.769463+0000","last_peered":"2023-10-06T04:28:10.769463+0000","last_clean":"2023-10-06T04:28:10.769463+0000","last_became_active":"2023-10-06T04:28:00.325466+0000","last_became_peered":"2023-10-06T04:28:00.325466+0000","last_unstale":"2023-10-06T04:28:10.769463+0000","last_undegraded":"2023-10-06T04:28:10.769463+0000","last_fullsized":"2023-10-06T04:28:10.769463+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771741+0000","last_change":"2023-10-06T04:28:06.347871+0000","last_active":"2023-10-06T04:28:10.771741+0000","last_peered":"2023-10-06T04:28:10.771741+0000","last_clean":"2023-10-06T04:28:10.771741+0000","last_became_active":"2023-10-06T04:28:06.347598+0000","last_became_peered":"2023-10-06T04:28:06.347598+0000","last_unstale":"2023-10-06T04:28:10.771741+0000","last_undegraded":"2023-10-06T04:28:10.771741+0000","last_fullsized":"2023-10-06T04:28:10.771741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:03.824145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.809116+0000","last_change":"2023-10-06T04:28:10.805828+0000","last_active":"2023-10-06T04:28:10.809116+0000","last_peered":"2023-10-06T04:28:10.809116+0000","last_clean":"2023-10-06T04:28:10.809116+0000","last_became_active":"2023-10-06T04:28:10.805391+0000","last_became_peered":"2023-10-06T04:28:10.805391+0000","last_unstale":"2023-10-06T04:28:10.809116+0000","last_undegraded":"2023-10-06T04:28:10.809116+0000","last_fullsized":"2023-10-06T04:28:10.809116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:12.226268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770768+0000","last_change":"2023-10-06T04:28:00.175241+0000","last_active":"2023-10-06T04:28:10.770768+0000","last_peered":"2023-10-06T04:28:10.770768+0000","last_clean":"2023-10-06T04:28:10.770768+0000","last_became_active":"2023-10-06T04:28:00.174814+0000","last_became_peered":"2023-10-06T04:28:00.174814+0000","last_unstale":"2023-10-06T04:28:10.770768+0000","last_undegraded":"2023-10-06T04:28:10.770768+0000","last_fullsized":"2023-10-06T04:28:10.770768+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769844+0000","last_change":"2023-10-06T04:28:05.759716+0000","last_active":"2023-10-06T04:28:10.769844+0000","last_peered":"2023-10-06T04:28:10.769844+0000","last_clean":"2023-10-06T04:28:10.769844+0000","last_became_active":"2023-10-06T04:28:05.759378+0000","last_became_peered":"2023-10-06T04:28:05.759378+0000","last_unstale":"2023-10-06T04:28:10.769844+0000","last_undegraded":"2023-10-06T04:28:10.769844+0000","last_fullsized":"2023-10-06T04:28:10.769844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:31.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769414+0000","last_change":"2023-10-06T04:28:06.345648+0000","last_active":"2023-10-06T04:28:10.769414+0000","last_peered":"2023-10-06T04:28:10.769414+0000","last_clean":"2023-10-06T04:28:10.769414+0000","last_became_active":"2023-10-06T04:28:06.345327+0000","last_became_peered":"2023-10-06T04:28:06.345327+0000","last_unstale":"2023-10-06T04:28:10.769414+0000","last_undegraded":"2023-10-06T04:28:10.769414+0000","last_fullsized":"2023-10-06T04:28:10.769414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:30.857061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.799671+0000","last_change":"2023-10-06T04:28:10.798759+0000","last_active":"2023-10-06T04:28:10.799671+0000","last_peered":"2023-10-06T04:28:10.799671+0000","last_clean":"2023-10-06T04:28:10.799671+0000","last_became_active":"2023-10-06T04:28:10.798359+0000","last_became_peered":"2023-10-06T04:28:10.798359+0000","last_unstale":"2023-10-06T04:28:10.799671+0000","last_undegraded":"2023-10-06T04:28:10.799671+0000","last_fullsized":"2023-10-06T04:28:10.799671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:21.459093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.773701+0000","last_change":"2023-10-06T04:28:00.175086+0000","last_active":"2023-10-06T04:28:10.773701+0000","last_peered":"2023-10-06T04:28:10.773701+0000","last_clean":"2023-10-06T04:28:10.773701+0000","last_became_active":"2023-10-06T04:28:00.174735+0000","last_became_peered":"2023-10-06T04:28:00.174735+0000","last_unstale":"2023-10-06T04:28:10.773701+0000","last_undegraded":"2023-10-06T04:28:10.773701+0000","last_fullsized":"2023-10-06T04:28:10.773701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.777992+0000","last_change":"2023-10-06T04:28:01.176177+0000","last_active":"2023-10-06T04:28:10.777992+0000","last_peered":"2023-10-06T04:28:10.777992+0000","last_clean":"2023-10-06T04:28:10.777992+0000","last_became_active":"2023-10-06T04:28:01.175255+0000","last_became_peered":"2023-10-06T04:28:01.175255+0000","last_unstale":"2023-10-06T04:28:10.777992+0000","last_undegraded":"2023-10-06T04:28:10.777992+0000","last_fullsized":"2023-10-06T04:28:10.777992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:00.161020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:00.161020+0000","last_clean_scrub_stamp":"2023-10-06T04:28:00.161020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:29.208067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769407+0000","last_change":"2023-10-06T04:28:05.748512+0000","last_active":"2023-10-06T04:28:10.769407+0000","last_peered":"2023-10-06T04:28:10.769407+0000","last_clean":"2023-10-06T04:28:10.769407+0000","last_became_active":"2023-10-06T04:28:05.748197+0000","last_became_peered":"2023-10-06T04:28:05.748197+0000","last_unstale":"2023-10-06T04:28:10.769407+0000","last_undegraded":"2023-10-06T04:28:10.769407+0000","last_fullsized":"2023-10-06T04:28:10.769407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:31.777366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770089+0000","last_change":"2023-10-06T04:28:06.346860+0000","last_active":"2023-10-06T04:28:10.770089+0000","last_peered":"2023-10-06T04:28:10.770089+0000","last_clean":"2023-10-06T04:28:10.770089+0000","last_became_active":"2023-10-06T04:28:06.346244+0000","last_became_peered":"2023-10-06T04:28:06.346244+0000","last_unstale":"2023-10-06T04:28:10.770089+0000","last_undegraded":"2023-10-06T04:28:10.770089+0000","last_fullsized":"2023-10-06T04:28:10.770089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:25.299896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.799239+0000","last_change":"2023-10-06T04:28:10.796043+0000","last_active":"2023-10-06T04:28:10.799239+0000","last_peered":"2023-10-06T04:28:10.799239+0000","last_clean":"2023-10-06T04:28:10.799239+0000","last_became_active":"2023-10-06T04:28:10.794267+0000","last_became_peered":"2023-10-06T04:28:10.794267+0000","last_unstale":"2023-10-06T04:28:10.799239+0000","last_undegraded":"2023-10-06T04:28:10.799239+0000","last_fullsized":"2023-10-06T04:28:10.799239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:13.098060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776644+0000","last_change":"2023-10-06T04:28:00.344573+0000","last_active":"2023-10-06T04:28:10.776644+0000","last_peered":"2023-10-06T04:28:10.776644+0000","last_clean":"2023-10-06T04:28:10.776644+0000","last_became_active":"2023-10-06T04:28:00.344324+0000","last_became_peered":"2023-10-06T04:28:00.344324+0000","last_unstale":"2023-10-06T04:28:10.776644+0000","last_undegraded":"2023-10-06T04:28:10.776644+0000","last_fullsized":"2023-10-06T04:28:10.776644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:24.184826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.775065+0000","last_change":"2023-10-06T04:28:05.757315+0000","last_active":"2023-10-06T04:28:10.775065+0000","last_peered":"2023-10-06T04:28:10.775065+0000","last_clean":"2023-10-06T04:28:10.775065+0000","last_became_active":"2023-10-06T04:28:05.756903+0000","last_became_peered":"2023-10-06T04:28:05.756903+0000","last_unstale":"2023-10-06T04:28:10.775065+0000","last_undegraded":"2023-10-06T04:28:10.775065+0000","last_fullsized":"2023-10-06T04:28:10.775065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:37.282042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.773864+0000","last_change":"2023-10-06T04:28:06.346567+0000","last_active":"2023-10-06T04:28:10.773864+0000","last_peered":"2023-10-06T04:28:10.773864+0000","last_clean":"2023-10-06T04:28:10.773864+0000","last_became_active":"2023-10-06T04:28:06.343751+0000","last_became_peered":"2023-10-06T04:28:06.343751+0000","last_unstale":"2023-10-06T04:28:10.773864+0000","last_undegraded":"2023-10-06T04:28:10.773864+0000","last_fullsized":"2023-10-06T04:28:10.773864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:53.248928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.798693+0000","last_change":"2023-10-06T04:28:10.788813+0000","last_active":"2023-10-06T04:28:10.798693+0000","last_peered":"2023-10-06T04:28:10.798693+0000","last_clean":"2023-10-06T04:28:10.798693+0000","last_became_active":"2023-10-06T04:28:10.788350+0000","last_became_peered":"2023-10-06T04:28:10.788350+0000","last_unstale":"2023-10-06T04:28:10.798693+0000","last_undegraded":"2023-10-06T04:28:10.798693+0000","last_fullsized":"2023-10-06T04:28:10.798693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:02.062950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.777569+0000","last_change":"2023-10-06T04:28:00.343571+0000","last_active":"2023-10-06T04:28:10.777569+0000","last_peered":"2023-10-06T04:28:10.777569+0000","last_clean":"2023-10-06T04:28:10.777569+0000","last_became_active":"2023-10-06T04:28:00.343268+0000","last_became_peered":"2023-10-06T04:28:00.343268+0000","last_unstale":"2023-10-06T04:28:10.777569+0000","last_undegraded":"2023-10-06T04:28:10.777569+0000","last_fullsized":"2023-10-06T04:28:10.777569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:00.931419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770595+0000","last_change":"2023-10-06T04:28:05.760969+0000","last_active":"2023-10-06T04:28:10.770595+0000","last_peered":"2023-10-06T04:28:10.770595+0000","last_clean":"2023-10-06T04:28:10.770595+0000","last_became_active":"2023-10-06T04:28:05.758813+0000","last_became_peered":"2023-10-06T04:28:05.758813+0000","last_unstale":"2023-10-06T04:28:10.770595+0000","last_undegraded":"2023-10-06T04:28:10.770595+0000","last_fullsized":"2023-10-06T04:28:10.770595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:13.125425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769104+0000","last_change":"2023-10-06T04:28:06.354285+0000","last_active":"2023-10-06T04:28:10.769104+0000","last_peered":"2023-10-06T04:28:10.769104+0000","last_clean":"2023-10-06T04:28:10.769104+0000","last_became_active":"2023-10-06T04:28:06.354002+0000","last_became_peered":"2023-10-06T04:28:06.354002+0000","last_unstale":"2023-10-06T04:28:10.769104+0000","last_undegraded":"2023-10-06T04:28:10.769104+0000","last_fullsized":"2023-10-06T04:28:10.769104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:15.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.793988+0000","last_change":"2023-10-06T04:28:10.792299+0000","last_active":"2023-10-06T04:28:10.793988+0000","last_peered":"2023-10-06T04:28:10.793988+0000","last_clean":"2023-10-06T04:28:10.793988+0000","last_became_active":"2023-10-06T04:28:10.791854+0000","last_became_peered":"2023-10-06T04:28:10.791854+0000","last_unstale":"2023-10-06T04:28:10.793988+0000","last_undegraded":"2023-10-06T04:28:10.793988+0000","last_fullsized":"2023-10-06T04:28:10.793988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:08.567157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774747+0000","last_change":"2023-10-06T04:28:00.344460+0000","last_active":"2023-10-06T04:28:10.774747+0000","last_peered":"2023-10-06T04:28:10.774747+0000","last_clean":"2023-10-06T04:28:10.774747+0000","last_became_active":"2023-10-06T04:28:00.343280+0000","last_became_peered":"2023-10-06T04:28:00.343280+0000","last_unstale":"2023-10-06T04:28:10.774747+0000","last_undegraded":"2023-10-06T04:28:10.774747+0000","last_fullsized":"2023-10-06T04:28:10.774747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768452+0000","last_change":"2023-10-06T04:28:05.757503+0000","last_active":"2023-10-06T04:28:10.768452+0000","last_peered":"2023-10-06T04:28:10.768452+0000","last_clean":"2023-10-06T04:28:10.768452+0000","last_became_active":"2023-10-06T04:28:05.757218+0000","last_became_peered":"2023-10-06T04:28:05.757218+0000","last_unstale":"2023-10-06T04:28:10.768452+0000","last_undegraded":"2023-10-06T04:28:10.768452+0000","last_fullsized":"2023-10-06T04:28:10.768452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:31.777366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774659+0000","last_change":"2023-10-06T04:28:06.334345+0000","last_active":"2023-10-06T04:28:10.774659+0000","last_peered":"2023-10-06T04:28:10.774659+0000","last_clean":"2023-10-06T04:28:10.774659+0000","last_became_active":"2023-10-06T04:28:06.334114+0000","last_became_peered":"2023-10-06T04:28:06.334114+0000","last_unstale":"2023-10-06T04:28:10.774659+0000","last_undegraded":"2023-10-06T04:28:10.774659+0000","last_fullsized":"2023-10-06T04:28:10.774659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:34.925929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.786275+0000","last_change":"2023-10-06T04:28:10.782630+0000","last_active":"2023-10-06T04:28:10.786275+0000","last_peered":"2023-10-06T04:28:10.786275+0000","last_clean":"2023-10-06T04:28:10.786275+0000","last_became_active":"2023-10-06T04:28:10.782267+0000","last_became_peered":"2023-10-06T04:28:10.782267+0000","last_unstale":"2023-10-06T04:28:10.786275+0000","last_undegraded":"2023-10-06T04:28:10.786275+0000","last_fullsized":"2023-10-06T04:28:10.786275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:11.414923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769001+0000","last_change":"2023-10-06T04:28:00.343592+0000","last_active":"2023-10-06T04:28:10.769001+0000","last_peered":"2023-10-06T04:28:10.769001+0000","last_clean":"2023-10-06T04:28:10.769001+0000","last_became_active":"2023-10-06T04:28:00.343313+0000","last_became_peered":"2023-10-06T04:28:00.343313+0000","last_unstale":"2023-10-06T04:28:10.769001+0000","last_undegraded":"2023-10-06T04:28:10.769001+0000","last_fullsized":"2023-10-06T04:28:10.769001+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:24.184826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774880+0000","last_change":"2023-10-06T04:28:05.760166+0000","last_active":"2023-10-06T04:28:10.774880+0000","last_peered":"2023-10-06T04:28:10.774880+0000","last_clean":"2023-10-06T04:28:10.774880+0000","last_became_active":"2023-10-06T04:28:05.759837+0000","last_became_peered":"2023-10-06T04:28:05.759837+0000","last_unstale":"2023-10-06T04:28:10.774880+0000","last_undegraded":"2023-10-06T04:28:10.774880+0000","last_fullsized":"2023-10-06T04:28:10.774880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:01:33.139108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772008+0000","last_change":"2023-10-06T04:28:06.340003+0000","last_active":"2023-10-06T04:28:10.772008+0000","last_peered":"2023-10-06T04:28:10.772008+0000","last_clean":"2023-10-06T04:28:10.772008+0000","last_became_active":"2023-10-06T04:28:06.339372+0000","last_became_peered":"2023-10-06T04:28:06.339372+0000","last_unstale":"2023-10-06T04:28:10.772008+0000","last_undegraded":"2023-10-06T04:28:10.772008+0000","last_fullsized":"2023-10-06T04:28:10.772008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:39.187212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.791694+0000","last_change":"2023-10-06T04:28:10.788742+0000","last_active":"2023-10-06T04:28:10.791694+0000","last_peered":"2023-10-06T04:28:10.791694+0000","last_clean":"2023-10-06T04:28:10.791694+0000","last_became_active":"2023-10-06T04:28:10.788218+0000","last_became_peered":"2023-10-06T04:28:10.788218+0000","last_unstale":"2023-10-06T04:28:10.791694+0000","last_undegraded":"2023-10-06T04:28:10.791694+0000","last_fullsized":"2023-10-06T04:28:10.791694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.241552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769530+0000","last_change":"2023-10-06T04:28:00.174563+0000","last_active":"2023-10-06T04:28:10.769530+0000","last_peered":"2023-10-06T04:28:10.769530+0000","last_clean":"2023-10-06T04:28:10.769530+0000","last_became_active":"2023-10-06T04:28:00.174265+0000","last_became_peered":"2023-10-06T04:28:00.174265+0000","last_unstale":"2023-10-06T04:28:10.769530+0000","last_undegraded":"2023-10-06T04:28:10.769530+0000","last_fullsized":"2023-10-06T04:28:10.769530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:00.931419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779588+0000","last_change":"2023-10-06T04:28:05.764045+0000","last_active":"2023-10-06T04:28:10.779588+0000","last_peered":"2023-10-06T04:28:10.779588+0000","last_clean":"2023-10-06T04:28:10.779588+0000","last_became_active":"2023-10-06T04:28:05.763751+0000","last_became_peered":"2023-10-06T04:28:05.763751+0000","last_unstale":"2023-10-06T04:28:10.779588+0000","last_undegraded":"2023-10-06T04:28:10.779588+0000","last_fullsized":"2023-10-06T04:28:10.779588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:31.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.780519+0000","last_change":"2023-10-06T04:28:06.341910+0000","last_active":"2023-10-06T04:28:10.780519+0000","last_peered":"2023-10-06T04:28:10.780519+0000","last_clean":"2023-10-06T04:28:10.780519+0000","last_became_active":"2023-10-06T04:28:06.340194+0000","last_became_peered":"2023-10-06T04:28:06.340194+0000","last_unstale":"2023-10-06T04:28:10.780519+0000","last_undegraded":"2023-10-06T04:28:10.780519+0000","last_fullsized":"2023-10-06T04:28:10.780519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:25.121736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.796035+0000","last_change":"2023-10-06T04:28:10.794957+0000","last_active":"2023-10-06T04:28:10.796035+0000","last_peered":"2023-10-06T04:28:10.796035+0000","last_clean":"2023-10-06T04:28:10.796035+0000","last_became_active":"2023-10-06T04:28:10.793329+0000","last_became_peered":"2023-10-06T04:28:10.793329+0000","last_unstale":"2023-10-06T04:28:10.796035+0000","last_undegraded":"2023-10-06T04:28:10.796035+0000","last_fullsized":"2023-10-06T04:28:10.796035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:11.414923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771921+0000","last_change":"2023-10-06T04:28:05.759061+0000","last_active":"2023-10-06T04:28:10.771921+0000","last_peered":"2023-10-06T04:28:10.771921+0000","last_clean":"2023-10-06T04:28:10.771921+0000","last_became_active":"2023-10-06T04:28:05.757716+0000","last_became_peered":"2023-10-06T04:28:05.757716+0000","last_unstale":"2023-10-06T04:28:10.771921+0000","last_undegraded":"2023-10-06T04:28:10.771921+0000","last_fullsized":"2023-10-06T04:28:10.771921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:37.282042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.766753+0000","last_change":"2023-10-06T04:28:06.339102+0000","last_active":"2023-10-06T04:28:10.766753+0000","last_peered":"2023-10-06T04:28:10.766753+0000","last_clean":"2023-10-06T04:28:10.766753+0000","last_became_active":"2023-10-06T04:28:06.338781+0000","last_became_peered":"2023-10-06T04:28:06.338781+0000","last_unstale":"2023-10-06T04:28:10.766753+0000","last_undegraded":"2023-10-06T04:28:10.766753+0000","last_fullsized":"2023-10-06T04:28:10.766753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:32.169844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.801878+0000","last_change":"2023-10-06T04:28:10.795685+0000","last_active":"2023-10-06T04:28:10.801878+0000","last_peered":"2023-10-06T04:28:10.801878+0000","last_clean":"2023-10-06T04:28:10.801878+0000","last_became_active":"2023-10-06T04:28:10.795281+0000","last_became_peered":"2023-10-06T04:28:10.795281+0000","last_unstale":"2023-10-06T04:28:10.801878+0000","last_undegraded":"2023-10-06T04:28:10.801878+0000","last_fullsized":"2023-10-06T04:28:10.801878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:11.414923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774978+0000","last_change":"2023-10-06T04:28:05.760540+0000","last_active":"2023-10-06T04:28:10.774978+0000","last_peered":"2023-10-06T04:28:10.774978+0000","last_clean":"2023-10-06T04:28:10.774978+0000","last_became_active":"2023-10-06T04:28:05.760213+0000","last_became_peered":"2023-10-06T04:28:05.760213+0000","last_unstale":"2023-10-06T04:28:10.774978+0000","last_undegraded":"2023-10-06T04:28:10.774978+0000","last_fullsized":"2023-10-06T04:28:10.774978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:13.125425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768541+0000","last_change":"2023-10-06T04:28:06.351862+0000","last_active":"2023-10-06T04:28:10.768541+0000","last_peered":"2023-10-06T04:28:10.768541+0000","last_clean":"2023-10-06T04:28:10.768541+0000","last_became_active":"2023-10-06T04:28:06.351613+0000","last_became_peered":"2023-10-06T04:28:06.351613+0000","last_unstale":"2023-10-06T04:28:10.768541+0000","last_undegraded":"2023-10-06T04:28:10.768541+0000","last_fullsized":"2023-10-06T04:28:10.768541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:36.507036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.798917+0000","last_change":"2023-10-06T04:28:10.791630+0000","last_active":"2023-10-06T04:28:10.798917+0000","last_peered":"2023-10-06T04:28:10.798917+0000","last_clean":"2023-10-06T04:28:10.798917+0000","last_became_active":"2023-10-06T04:28:10.791196+0000","last_became_peered":"2023-10-06T04:28:10.791196+0000","last_unstale":"2023-10-06T04:28:10.798917+0000","last_undegraded":"2023-10-06T04:28:10.798917+0000","last_fullsized":"2023-10-06T04:28:10.798917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.241552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779937+0000","last_change":"2023-10-06T04:28:05.761937+0000","last_active":"2023-10-06T04:28:10.779937+0000","last_peered":"2023-10-06T04:28:10.779937+0000","last_clean":"2023-10-06T04:28:10.779937+0000","last_became_active":"2023-10-06T04:28:05.761666+0000","last_became_peered":"2023-10-06T04:28:05.761666+0000","last_unstale":"2023-10-06T04:28:10.779937+0000","last_undegraded":"2023-10-06T04:28:10.779937+0000","last_fullsized":"2023-10-06T04:28:10.779937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:15.728042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770368+0000","last_change":"2023-10-06T04:28:06.350532+0000","last_active":"2023-10-06T04:28:10.770368+0000","last_peered":"2023-10-06T04:28:10.770368+0000","last_clean":"2023-10-06T04:28:10.770368+0000","last_became_active":"2023-10-06T04:28:06.349418+0000","last_became_peered":"2023-10-06T04:28:06.349418+0000","last_unstale":"2023-10-06T04:28:10.770368+0000","last_undegraded":"2023-10-06T04:28:10.770368+0000","last_fullsized":"2023-10-06T04:28:10.770368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:17.928102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802894+0000","last_change":"2023-10-06T04:28:10.798677+0000","last_active":"2023-10-06T04:28:10.802894+0000","last_peered":"2023-10-06T04:28:10.802894+0000","last_clean":"2023-10-06T04:28:10.802894+0000","last_became_active":"2023-10-06T04:28:10.798151+0000","last_became_peered":"2023-10-06T04:28:10.798151+0000","last_unstale":"2023-10-06T04:28:10.802894+0000","last_undegraded":"2023-10-06T04:28:10.802894+0000","last_fullsized":"2023-10-06T04:28:10.802894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:41.693487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.773597+0000","last_change":"2023-10-06T04:28:05.763239+0000","last_active":"2023-10-06T04:28:10.773597+0000","last_peered":"2023-10-06T04:28:10.773597+0000","last_clean":"2023-10-06T04:28:10.773597+0000","last_became_active":"2023-10-06T04:28:05.762943+0000","last_became_peered":"2023-10-06T04:28:05.762943+0000","last_unstale":"2023-10-06T04:28:10.773597+0000","last_undegraded":"2023-10-06T04:28:10.773597+0000","last_fullsized":"2023-10-06T04:28:10.773597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:31.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772811+0000","last_change":"2023-10-06T04:28:06.333362+0000","last_active":"2023-10-06T04:28:10.772811+0000","last_peered":"2023-10-06T04:28:10.772811+0000","last_clean":"2023-10-06T04:28:10.772811+0000","last_became_active":"2023-10-06T04:28:06.333122+0000","last_became_peered":"2023-10-06T04:28:06.333122+0000","last_unstale":"2023-10-06T04:28:10.772811+0000","last_undegraded":"2023-10-06T04:28:10.772811+0000","last_fullsized":"2023-10-06T04:28:10.772811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:14.542716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.795717+0000","last_change":"2023-10-06T04:28:10.791565+0000","last_active":"2023-10-06T04:28:10.795717+0000","last_peered":"2023-10-06T04:28:10.795717+0000","last_clean":"2023-10-06T04:28:10.795717+0000","last_became_active":"2023-10-06T04:28:10.791139+0000","last_became_peered":"2023-10-06T04:28:10.791139+0000","last_unstale":"2023-10-06T04:28:10.795717+0000","last_undegraded":"2023-10-06T04:28:10.795717+0000","last_fullsized":"2023-10-06T04:28:10.795717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:43.446834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770222+0000","last_change":"2023-10-06T04:28:05.755877+0000","last_active":"2023-10-06T04:28:10.770222+0000","last_peered":"2023-10-06T04:28:10.770222+0000","last_clean":"2023-10-06T04:28:10.770222+0000","last_became_active":"2023-10-06T04:28:05.755458+0000","last_became_peered":"2023-10-06T04:28:05.755458+0000","last_unstale":"2023-10-06T04:28:10.770222+0000","last_undegraded":"2023-10-06T04:28:10.770222+0000","last_fullsized":"2023-10-06T04:28:10.770222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:25.024995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770660+0000","last_change":"2023-10-06T04:28:06.344756+0000","last_active":"2023-10-06T04:28:10.770660+0000","last_peered":"2023-10-06T04:28:10.770660+0000","last_clean":"2023-10-06T04:28:10.770660+0000","last_became_active":"2023-10-06T04:28:06.344479+0000","last_became_peered":"2023-10-06T04:28:06.344479+0000","last_unstale":"2023-10-06T04:28:10.770660+0000","last_undegraded":"2023-10-06T04:28:10.770660+0000","last_fullsized":"2023-10-06T04:28:10.770660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:14.542716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769743+0000","last_change":"2023-10-06T04:28:06.332177+0000","last_active":"2023-10-06T04:28:10.769743+0000","last_peered":"2023-10-06T04:28:10.769743+0000","last_clean":"2023-10-06T04:28:10.769743+0000","last_became_active":"2023-10-06T04:28:06.331845+0000","last_became_peered":"2023-10-06T04:28:06.331845+0000","last_unstale":"2023-10-06T04:28:10.769743+0000","last_undegraded":"2023-10-06T04:28:10.769743+0000","last_fullsized":"2023-10-06T04:28:10.769743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:25.837873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772592+0000","last_change":"2023-10-06T04:28:06.341336+0000","last_active":"2023-10-06T04:28:10.772592+0000","last_peered":"2023-10-06T04:28:10.772592+0000","last_clean":"2023-10-06T04:28:10.772592+0000","last_became_active":"2023-10-06T04:28:06.341066+0000","last_became_peered":"2023-10-06T04:28:06.341066+0000","last_unstale":"2023-10-06T04:28:10.772592+0000","last_undegraded":"2023-10-06T04:28:10.772592+0000","last_fullsized":"2023-10-06T04:28:10.772592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:28.999532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770451+0000","last_change":"2023-10-06T04:28:06.346211+0000","last_active":"2023-10-06T04:28:10.770451+0000","last_peered":"2023-10-06T04:28:10.770451+0000","last_clean":"2023-10-06T04:28:10.770451+0000","last_became_active":"2023-10-06T04:28:06.345932+0000","last_became_peered":"2023-10-06T04:28:06.345932+0000","last_unstale":"2023-10-06T04:28:10.770451+0000","last_undegraded":"2023-10-06T04:28:10.770451+0000","last_fullsized":"2023-10-06T04:28:10.770451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:47.925435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771314+0000","last_change":"2023-10-06T04:28:06.337534+0000","last_active":"2023-10-06T04:28:10.771314+0000","last_peered":"2023-10-06T04:28:10.771314+0000","last_clean":"2023-10-06T04:28:10.771314+0000","last_became_active":"2023-10-06T04:28:06.337280+0000","last_became_peered":"2023-10-06T04:28:06.337280+0000","last_unstale":"2023-10-06T04:28:10.771314+0000","last_undegraded":"2023-10-06T04:28:10.771314+0000","last_fullsized":"2023-10-06T04:28:10.771314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:27.073025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774746+0000","last_change":"2023-10-06T04:28:06.336249+0000","last_active":"2023-10-06T04:28:10.774746+0000","last_peered":"2023-10-06T04:28:10.774746+0000","last_clean":"2023-10-06T04:28:10.774746+0000","last_became_active":"2023-10-06T04:28:06.335726+0000","last_became_peered":"2023-10-06T04:28:06.335726+0000","last_unstale":"2023-10-06T04:28:10.774746+0000","last_undegraded":"2023-10-06T04:28:10.774746+0000","last_fullsized":"2023-10-06T04:28:10.774746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:25.837873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2759,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":700600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302224,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069616,"statfs":{"total":96636764160,"available":96327286784,"internally_reserved":0,"allocated":860160,"data_stored":699826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":109034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301640,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070200,"statfs":{"total":96636764160,"available":96327884800,"internally_reserved":0,"allocated":262144,"data_stored":108480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":108570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":111503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":109104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:28:24.961 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:28:25.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.148+0000 7f2d4b59e700 1 Processor -- start 2023-10-06T04:28:25.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.148+0000 7f2d4b59e700 1 -- start start 2023-10-06T04:28:25.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.149+0000 7f2d4b59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2d4c15c920 0x7f2d4c0c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:25.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.149+0000 7f2d4b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d4c0c50a0 0x7f2d4c0ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:25.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.149+0000 7f2d4b59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4c0cf280 con 0x7f2d4c0cee20 2023-10-06T04:28:25.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.149+0000 7f2d4b59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d4c0cb550 con 0x7f2d4c15c920 2023-10-06T04:28:25.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.149+0000 7f2d4b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c0c67f0 con 0x7f2d4c0c50a0 2023-10-06T04:28:25.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.149+0000 7f2d4a59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2d4c15c920 0x7f2d4c0c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:25.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.149+0000 7f2d4a59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2d4c15c920 0x7f2d4c0c5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51842/0 (socket says 172.21.15.60:51842) 2023-10-06T04:28:25.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.149+0000 7f2d4a59c700 1 -- 172.21.15.60:0/1479231890 learned_addr learned my addr 172.21.15.60:0/1479231890 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:25.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.149+0000 7f2d49d9b700 1 --2- 172.21.15.60:0/1479231890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d4c0c50a0 0x7f2d4c0ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:25.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.150+0000 7f2d4a59c700 1 -- 172.21.15.60:0/1479231890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d4c0c50a0 msgr2=0x7f2d4c0ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:25.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.150+0000 7f2d4a59c700 1 --2- 172.21.15.60:0/1479231890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d4c0c50a0 0x7f2d4c0ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:25.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.150+0000 7f2d4a59c700 1 -- 172.21.15.60:0/1479231890 >> v1:172.21.15.60:6789/0 conn(0x7f2d4c0cee20 legacy=0x7f2d4c0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:25.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.150+0000 7f2d4a59c700 1 -- 172.21.15.60:0/1479231890 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c0c6ad0 con 0x7f2d4c15c920 2023-10-06T04:28:25.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.150+0000 7f2d4959a700 1 -- 172.21.15.60:0/1479231890 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 288571794 0 0) 0x7f2d44001490 con 0x7f2d4c0cee20 2023-10-06T04:28:25.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.150+0000 7f2d4a59c700 1 --2- 172.21.15.60:0/1479231890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d4c15c920 0x7f2d4c0c5fc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009990 tx=0x7f2d3c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4b868adfafba75 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:25.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.150+0000 7f2d4959a700 1 -- 172.21.15.60:0/1479231890 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c009e80 con 0x7f2d4c15c920 2023-10-06T04:28:25.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.150+0000 7f2d4959a700 1 -- 172.21.15.60:0/1479231890 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c005c10 con 0x7f2d4c15c920 2023-10-06T04:28:25.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.150+0000 7f2d4959a700 1 -- 172.21.15.60:0/1479231890 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c00b650 con 0x7f2d4c15c920 2023-10-06T04:28:25.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.151+0000 7f2d4b59e700 1 -- 172.21.15.60:0/1479231890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d4c15c920 msgr2=0x7f2d4c0c5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:25.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.151+0000 7f2d4b59e700 1 --2- 172.21.15.60:0/1479231890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d4c15c920 0x7f2d4c0c5fc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009990 tx=0x7f2d3c009220 comp rx=0 tx=0).stop 2023-10-06T04:28:25.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.151+0000 7f2d4b59e700 1 -- 172.21.15.60:0/1479231890 shutdown_connections 2023-10-06T04:28:25.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.151+0000 7f2d4b59e700 1 --2- 172.21.15.60:0/1479231890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d4c15c920 0x7f2d4c0c5fc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:25.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.151+0000 7f2d4b59e700 1 --2- 172.21.15.60:0/1479231890 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d4c0c50a0 0x7f2d4c0ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:25.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.151+0000 7f2d4b59e700 1 -- 172.21.15.60:0/1479231890 >> 172.21.15.60:0/1479231890 conn(0x7f2d4c0995c0 msgr2=0x7f2d4c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:25.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.151+0000 7f2d4b59e700 1 -- 172.21.15.60:0/1479231890 shutdown_connections 2023-10-06T04:28:25.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.151+0000 7f2d4b59e700 1 -- 172.21.15.60:0/1479231890 wait complete. 2023-10-06T04:28:25.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.153+0000 7f2d4b59e700 1 Processor -- start 2023-10-06T04:28:25.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.153+0000 7f2d4b59e700 1 -- start start 2023-10-06T04:28:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.154+0000 7f2d4b59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d4c0c50a0 0x7f2d4c14df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.154+0000 7f2d4b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d4c0cee20 0x7f2d4c150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.154+0000 7f2d4b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d4c15c920 0x7f2d4c151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.154+0000 7f2d4b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c15a720 con 0x7f2d4c15c920 2023-10-06T04:28:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.154+0000 7f2d4b59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c14e460 con 0x7f2d4c0c50a0 2023-10-06T04:28:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.154+0000 7f2d4b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c159b10 con 0x7f2d4c0cee20 2023-10-06T04:28:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.154+0000 7f2d4ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d4c15c920 0x7f2d4c151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.154+0000 7f2d4ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d4c15c920 0x7f2d4c151310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51848/0 (socket says 172.21.15.60:51848) 2023-10-06T04:28:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.154+0000 7f2d4ad9d700 1 -- 172.21.15.60:0/3243855915 learned_addr learned my addr 172.21.15.60:0/3243855915 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.154+0000 7f2d49d9b700 1 --2- 172.21.15.60:0/3243855915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d4c0cee20 0x7f2d4c150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.154+0000 7f2d4a59c700 1 --2- 172.21.15.60:0/3243855915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d4c0c50a0 0x7f2d4c14df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.155+0000 7f2d4ad9d700 1 -- 172.21.15.60:0/3243855915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d4c0cee20 msgr2=0x7f2d4c150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.155+0000 7f2d4ad9d700 1 --2- 172.21.15.60:0/3243855915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d4c0cee20 0x7f2d4c150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.155+0000 7f2d4ad9d700 1 -- 172.21.15.60:0/3243855915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d4c0c50a0 msgr2=0x7f2d4c14df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.155+0000 7f2d4ad9d700 1 --2- 172.21.15.60:0/3243855915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d4c0c50a0 0x7f2d4c14df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.155+0000 7f2d4ad9d700 1 -- 172.21.15.60:0/3243855915 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c009480 con 0x7f2d4c15c920 2023-10-06T04:28:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.155+0000 7f2d4a59c700 1 --2- 172.21.15.60:0/3243855915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d4c0c50a0 0x7f2d4c14df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.155+0000 7f2d4ad9d700 1 --2- 172.21.15.60:0/3243855915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d4c15c920 0x7f2d4c151310 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400c950 tx=0x7f2d44007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.155+0000 7f2d3a7fc700 1 -- 172.21.15.60:0/3243855915 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d44012630 con 0x7f2d4c15c920 2023-10-06T04:28:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.155+0000 7f2d3a7fc700 1 -- 172.21.15.60:0/3243855915 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d440127b0 con 0x7f2d4c15c920 2023-10-06T04:28:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.155+0000 7f2d4b59e700 1 -- 172.21.15.60:0/3243855915 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d4c159df0 con 0x7f2d4c15c920 2023-10-06T04:28:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.155+0000 7f2d3a7fc700 1 -- 172.21.15.60:0/3243855915 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d44012b70 con 0x7f2d4c15c920 2023-10-06T04:28:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.155+0000 7f2d4b59e700 1 -- 172.21.15.60:0/3243855915 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4c15a3b0 con 0x7f2d4c15c920 2023-10-06T04:28:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.156+0000 7f2d4b59e700 1 -- 172.21.15.60:0/3243855915 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4c15a8d0 con 0x7f2d4c15c920 2023-10-06T04:28:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.157+0000 7f2d3a7fc700 1 -- 172.21.15.60:0/3243855915 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d44003030 con 0x7f2d4c15c920 2023-10-06T04:28:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.158+0000 7f2d3a7fc700 1 --2- 172.21.15.60:0/3243855915 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2d2c066f30 0x7f2d2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.158+0000 7f2d3a7fc700 1 -- 172.21.15.60:0/3243855915 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2d44084900 con 0x7f2d4c15c920 2023-10-06T04:28:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.158+0000 7f2d4a59c700 1 --2- 172.21.15.60:0/3243855915 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2d2c066f30 0x7f2d2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.159+0000 7f2d4a59c700 1 --2- 172.21.15.60:0/3243855915 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2d2c066f30 0x7f2d2c0693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009260 tx=0x7f2d3c016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.162+0000 7f2d3a7fc700 1 -- 172.21.15.60:0/3243855915 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d4c15a8d0 con 0x7f2d4c15c920 2023-10-06T04:28:25.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.361+0000 7f2d4b59e700 1 -- 172.21.15.60:0/3243855915 --> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d4c0cf280 con 0x7f2d2c066f30 2023-10-06T04:28:25.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.372+0000 7f2d3a7fc700 1 -- 172.21.15.60:0/3243855915 <== mgr.4098 v2:172.21.15.60:6832/85285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367536 (secure 0 0 0) 0x7f2d4c0cf280 con 0x7f2d2c066f30 2023-10-06T04:28:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:25.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.377+0000 7f2d4b59e700 1 -- 172.21.15.60:0/3243855915 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2d2c066f30 msgr2=0x7f2d2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:25.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.377+0000 7f2d4b59e700 1 --2- 172.21.15.60:0/3243855915 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2d2c066f30 0x7f2d2c0693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009260 tx=0x7f2d3c016000 comp rx=0 tx=0).stop 2023-10-06T04:28:25.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.377+0000 7f2d4b59e700 1 -- 172.21.15.60:0/3243855915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d4c15c920 msgr2=0x7f2d4c151310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:25.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.377+0000 7f2d4b59e700 1 --2- 172.21.15.60:0/3243855915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d4c15c920 0x7f2d4c151310 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400c950 tx=0x7f2d44007f60 comp rx=0 tx=0).stop 2023-10-06T04:28:25.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.377+0000 7f2d4b59e700 1 -- 172.21.15.60:0/3243855915 shutdown_connections 2023-10-06T04:28:25.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.377+0000 7f2d4b59e700 1 --2- 172.21.15.60:0/3243855915 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2d2c066f30 0x7f2d2c0693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:25.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.377+0000 7f2d4b59e700 1 --2- 172.21.15.60:0/3243855915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d4c15c920 0x7f2d4c151310 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:25.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.377+0000 7f2d4b59e700 1 --2- 172.21.15.60:0/3243855915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d4c0c50a0 0x7f2d4c14df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:25.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.377+0000 7f2d4b59e700 1 --2- 172.21.15.60:0/3243855915 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2d4c0cee20 0x7f2d4c150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:25.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.377+0000 7f2d4b59e700 1 -- 172.21.15.60:0/3243855915 >> 172.21.15.60:0/3243855915 conn(0x7f2d4c0995c0 msgr2=0x7f2d4c069730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:25.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.377+0000 7f2d4b59e700 1 -- 172.21.15.60:0/3243855915 shutdown_connections 2023-10-06T04:28:25.384 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.377+0000 7f2d4b59e700 1 -- 172.21.15.60:0/3243855915 wait complete. 2023-10-06T04:28:25.384 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-06T04:28:25.397 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-10-06T04:28:25.314164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397972,"kb_used_data":3284,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752576748,"statfs":{"total":773094113280,"available":770638589952,"internally_reserved":0,"allocated":3362816,"data_stored":2060478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002413"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.767703+0000","last_change":"2023-10-06T04:28:06.333183+0000","last_active":"2023-10-06T04:28:10.767703+0000","last_peered":"2023-10-06T04:28:10.767703+0000","last_clean":"2023-10-06T04:28:10.767703+0000","last_became_active":"2023-10-06T04:28:06.332860+0000","last_became_peered":"2023-10-06T04:28:06.332860+0000","last_unstale":"2023-10-06T04:28:10.767703+0000","last_undegraded":"2023-10-06T04:28:10.767703+0000","last_fullsized":"2023-10-06T04:28:10.767703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:32.786074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.778681+0000","last_change":"2023-10-06T04:28:06.344458+0000","last_active":"2023-10-06T04:28:10.778681+0000","last_peered":"2023-10-06T04:28:10.778681+0000","last_clean":"2023-10-06T04:28:10.778681+0000","last_became_active":"2023-10-06T04:28:06.344197+0000","last_became_peered":"2023-10-06T04:28:06.344197+0000","last_unstale":"2023-10-06T04:28:10.778681+0000","last_undegraded":"2023-10-06T04:28:10.778681+0000","last_fullsized":"2023-10-06T04:28:10.778681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:34.925929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769634+0000","last_change":"2023-10-06T04:28:06.349096+0000","last_active":"2023-10-06T04:28:10.769634+0000","last_peered":"2023-10-06T04:28:10.769634+0000","last_clean":"2023-10-06T04:28:10.769634+0000","last_became_active":"2023-10-06T04:28:06.348569+0000","last_became_peered":"2023-10-06T04:28:06.348569+0000","last_unstale":"2023-10-06T04:28:10.769634+0000","last_undegraded":"2023-10-06T04:28:10.769634+0000","last_fullsized":"2023-10-06T04:28:10.769634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:32.246348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768718+0000","last_change":"2023-10-06T04:28:06.343369+0000","last_active":"2023-10-06T04:28:10.768718+0000","last_peered":"2023-10-06T04:28:10.768718+0000","last_clean":"2023-10-06T04:28:10.768718+0000","last_became_active":"2023-10-06T04:28:06.342720+0000","last_became_peered":"2023-10-06T04:28:06.342720+0000","last_unstale":"2023-10-06T04:28:10.768718+0000","last_undegraded":"2023-10-06T04:28:10.768718+0000","last_fullsized":"2023-10-06T04:28:10.768718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:25.121736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772088+0000","last_change":"2023-10-06T04:28:06.340210+0000","last_active":"2023-10-06T04:28:10.772088+0000","last_peered":"2023-10-06T04:28:10.772088+0000","last_clean":"2023-10-06T04:28:10.772088+0000","last_became_active":"2023-10-06T04:28:06.339725+0000","last_became_peered":"2023-10-06T04:28:06.339725+0000","last_unstale":"2023-10-06T04:28:10.772088+0000","last_undegraded":"2023-10-06T04:28:10.772088+0000","last_fullsized":"2023-10-06T04:28:10.772088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:59.952485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770264+0000","last_change":"2023-10-06T04:28:06.348877+0000","last_active":"2023-10-06T04:28:10.770264+0000","last_peered":"2023-10-06T04:28:10.770264+0000","last_clean":"2023-10-06T04:28:10.770264+0000","last_became_active":"2023-10-06T04:28:06.348593+0000","last_became_peered":"2023-10-06T04:28:06.348593+0000","last_unstale":"2023-10-06T04:28:10.770264+0000","last_undegraded":"2023-10-06T04:28:10.770264+0000","last_fullsized":"2023-10-06T04:28:10.770264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:58.373238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774127+0000","last_change":"2023-10-06T04:28:06.341608+0000","last_active":"2023-10-06T04:28:10.774127+0000","last_peered":"2023-10-06T04:28:10.774127+0000","last_clean":"2023-10-06T04:28:10.774127+0000","last_became_active":"2023-10-06T04:28:06.341341+0000","last_became_peered":"2023-10-06T04:28:06.341341+0000","last_unstale":"2023-10-06T04:28:10.774127+0000","last_undegraded":"2023-10-06T04:28:10.774127+0000","last_fullsized":"2023-10-06T04:28:10.774127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:25.299896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.775047+0000","last_change":"2023-10-06T04:28:06.352230+0000","last_active":"2023-10-06T04:28:10.775047+0000","last_peered":"2023-10-06T04:28:10.775047+0000","last_clean":"2023-10-06T04:28:10.775047+0000","last_became_active":"2023-10-06T04:28:06.351946+0000","last_became_peered":"2023-10-06T04:28:06.351946+0000","last_unstale":"2023-10-06T04:28:10.775047+0000","last_undegraded":"2023-10-06T04:28:10.775047+0000","last_fullsized":"2023-10-06T04:28:10.775047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:39.187212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769280+0000","last_change":"2023-10-06T04:28:06.349388+0000","last_active":"2023-10-06T04:28:10.769280+0000","last_peered":"2023-10-06T04:28:10.769280+0000","last_clean":"2023-10-06T04:28:10.769280+0000","last_became_active":"2023-10-06T04:28:06.349059+0000","last_became_peered":"2023-10-06T04:28:06.349059+0000","last_unstale":"2023-10-06T04:28:10.769280+0000","last_undegraded":"2023-10-06T04:28:10.769280+0000","last_fullsized":"2023-10-06T04:28:10.769280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:17.928102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.778830+0000","last_change":"2023-10-06T04:28:06.346835+0000","last_active":"2023-10-06T04:28:10.778830+0000","last_peered":"2023-10-06T04:28:10.778830+0000","last_clean":"2023-10-06T04:28:10.778830+0000","last_became_active":"2023-10-06T04:28:06.346555+0000","last_became_peered":"2023-10-06T04:28:06.346555+0000","last_unstale":"2023-10-06T04:28:10.778830+0000","last_undegraded":"2023-10-06T04:28:10.778830+0000","last_fullsized":"2023-10-06T04:28:10.778830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:27.073025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769556+0000","last_change":"2023-10-06T04:28:06.349715+0000","last_active":"2023-10-06T04:28:10.769556+0000","last_peered":"2023-10-06T04:28:10.769556+0000","last_clean":"2023-10-06T04:28:10.769556+0000","last_became_active":"2023-10-06T04:28:06.347463+0000","last_became_peered":"2023-10-06T04:28:06.347463+0000","last_unstale":"2023-10-06T04:28:10.769556+0000","last_undegraded":"2023-10-06T04:28:10.769556+0000","last_fullsized":"2023-10-06T04:28:10.769556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:20.864954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.766598+0000","last_change":"2023-10-06T04:28:06.352759+0000","last_active":"2023-10-06T04:28:10.766598+0000","last_peered":"2023-10-06T04:28:10.766598+0000","last_clean":"2023-10-06T04:28:10.766598+0000","last_became_active":"2023-10-06T04:28:06.352427+0000","last_became_peered":"2023-10-06T04:28:06.352427+0000","last_unstale":"2023-10-06T04:28:10.766598+0000","last_undegraded":"2023-10-06T04:28:10.766598+0000","last_fullsized":"2023-10-06T04:28:10.766598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:14.134133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768223+0000","last_change":"2023-10-06T04:28:06.331950+0000","last_active":"2023-10-06T04:28:10.768223+0000","last_peered":"2023-10-06T04:28:10.768223+0000","last_clean":"2023-10-06T04:28:10.768223+0000","last_became_active":"2023-10-06T04:28:06.331660+0000","last_became_peered":"2023-10-06T04:28:06.331660+0000","last_unstale":"2023-10-06T04:28:10.768223+0000","last_undegraded":"2023-10-06T04:28:10.768223+0000","last_fullsized":"2023-10-06T04:28:10.768223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:01:34.147816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.775071+0000","last_change":"2023-10-06T04:28:06.344093+0000","last_active":"2023-10-06T04:28:10.775071+0000","last_peered":"2023-10-06T04:28:10.775071+0000","last_clean":"2023-10-06T04:28:10.775071+0000","last_became_active":"2023-10-06T04:28:06.343647+0000","last_became_peered":"2023-10-06T04:28:06.343647+0000","last_unstale":"2023-10-06T04:28:10.775071+0000","last_undegraded":"2023-10-06T04:28:10.775071+0000","last_fullsized":"2023-10-06T04:28:10.775071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:25.299896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.773879+0000","last_change":"2023-10-06T04:28:06.341653+0000","last_active":"2023-10-06T04:28:10.773879+0000","last_peered":"2023-10-06T04:28:10.773879+0000","last_clean":"2023-10-06T04:28:10.773879+0000","last_became_active":"2023-10-06T04:28:06.341377+0000","last_became_peered":"2023-10-06T04:28:06.341377+0000","last_unstale":"2023-10-06T04:28:10.773879+0000","last_undegraded":"2023-10-06T04:28:10.773879+0000","last_fullsized":"2023-10-06T04:28:10.773879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:15.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770685+0000","last_change":"2023-10-06T04:28:06.348854+0000","last_active":"2023-10-06T04:28:10.770685+0000","last_peered":"2023-10-06T04:28:10.770685+0000","last_clean":"2023-10-06T04:28:10.770685+0000","last_became_active":"2023-10-06T04:28:06.348503+0000","last_became_peered":"2023-10-06T04:28:06.348503+0000","last_unstale":"2023-10-06T04:28:10.770685+0000","last_undegraded":"2023-10-06T04:28:10.770685+0000","last_fullsized":"2023-10-06T04:28:10.770685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:28.999532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769974+0000","last_change":"2023-10-06T04:28:06.344544+0000","last_active":"2023-10-06T04:28:10.769974+0000","last_peered":"2023-10-06T04:28:10.769974+0000","last_clean":"2023-10-06T04:28:10.769974+0000","last_became_active":"2023-10-06T04:28:06.342776+0000","last_became_peered":"2023-10-06T04:28:06.342776+0000","last_unstale":"2023-10-06T04:28:10.769974+0000","last_undegraded":"2023-10-06T04:28:10.769974+0000","last_fullsized":"2023-10-06T04:28:10.769974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:14.542716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769109+0000","last_change":"2023-10-06T04:28:06.352912+0000","last_active":"2023-10-06T04:28:10.769109+0000","last_peered":"2023-10-06T04:28:10.769109+0000","last_clean":"2023-10-06T04:28:10.769109+0000","last_became_active":"2023-10-06T04:28:06.352449+0000","last_became_peered":"2023-10-06T04:28:06.352449+0000","last_unstale":"2023-10-06T04:28:10.769109+0000","last_undegraded":"2023-10-06T04:28:10.769109+0000","last_fullsized":"2023-10-06T04:28:10.769109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:07.389056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768234+0000","last_change":"2023-10-06T04:28:06.339688+0000","last_active":"2023-10-06T04:28:10.768234+0000","last_peered":"2023-10-06T04:28:10.768234+0000","last_clean":"2023-10-06T04:28:10.768234+0000","last_became_active":"2023-10-06T04:28:06.339427+0000","last_became_peered":"2023-10-06T04:28:06.339427+0000","last_unstale":"2023-10-06T04:28:10.768234+0000","last_undegraded":"2023-10-06T04:28:10.768234+0000","last_fullsized":"2023-10-06T04:28:10.768234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:25.189214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771104+0000","last_change":"2023-10-06T04:28:06.351544+0000","last_active":"2023-10-06T04:28:10.771104+0000","last_peered":"2023-10-06T04:28:10.771104+0000","last_clean":"2023-10-06T04:28:10.771104+0000","last_became_active":"2023-10-06T04:28:06.351250+0000","last_became_peered":"2023-10-06T04:28:06.351250+0000","last_unstale":"2023-10-06T04:28:10.771104+0000","last_undegraded":"2023-10-06T04:28:10.771104+0000","last_fullsized":"2023-10-06T04:28:10.771104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:20.083329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776616+0000","last_change":"2023-10-06T04:28:06.339922+0000","last_active":"2023-10-06T04:28:10.776616+0000","last_peered":"2023-10-06T04:28:10.776616+0000","last_clean":"2023-10-06T04:28:10.776616+0000","last_became_active":"2023-10-06T04:28:06.339645+0000","last_became_peered":"2023-10-06T04:28:06.339645+0000","last_unstale":"2023-10-06T04:28:10.776616+0000","last_undegraded":"2023-10-06T04:28:10.776616+0000","last_fullsized":"2023-10-06T04:28:10.776616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:34.925929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769587+0000","last_change":"2023-10-06T04:28:06.340838+0000","last_active":"2023-10-06T04:28:10.769587+0000","last_peered":"2023-10-06T04:28:10.769587+0000","last_clean":"2023-10-06T04:28:10.769587+0000","last_became_active":"2023-10-06T04:28:06.340585+0000","last_became_peered":"2023-10-06T04:28:06.340585+0000","last_unstale":"2023-10-06T04:28:10.769587+0000","last_undegraded":"2023-10-06T04:28:10.769587+0000","last_fullsized":"2023-10-06T04:28:10.769587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:15.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772671+0000","last_change":"2023-10-06T04:28:06.341897+0000","last_active":"2023-10-06T04:28:10.772671+0000","last_peered":"2023-10-06T04:28:10.772671+0000","last_clean":"2023-10-06T04:28:10.772671+0000","last_became_active":"2023-10-06T04:28:06.341660+0000","last_became_peered":"2023-10-06T04:28:06.341660+0000","last_unstale":"2023-10-06T04:28:10.772671+0000","last_undegraded":"2023-10-06T04:28:10.772671+0000","last_fullsized":"2023-10-06T04:28:10.772671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:20.864954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.777630+0000","last_change":"2023-10-06T04:28:06.351307+0000","last_active":"2023-10-06T04:28:10.777630+0000","last_peered":"2023-10-06T04:28:10.777630+0000","last_clean":"2023-10-06T04:28:10.777630+0000","last_became_active":"2023-10-06T04:28:06.351018+0000","last_became_peered":"2023-10-06T04:28:06.351018+0000","last_unstale":"2023-10-06T04:28:10.777630+0000","last_undegraded":"2023-10-06T04:28:10.777630+0000","last_fullsized":"2023-10-06T04:28:10.777630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:39.187212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.773769+0000","last_change":"2023-10-06T04:28:06.335571+0000","last_active":"2023-10-06T04:28:10.773769+0000","last_peered":"2023-10-06T04:28:10.773769+0000","last_clean":"2023-10-06T04:28:10.773769+0000","last_became_active":"2023-10-06T04:28:06.335306+0000","last_became_peered":"2023-10-06T04:28:06.335306+0000","last_unstale":"2023-10-06T04:28:10.773769+0000","last_undegraded":"2023-10-06T04:28:10.773769+0000","last_fullsized":"2023-10-06T04:28:10.773769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:13.160015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.781232+0000","last_change":"2023-10-06T04:28:06.334344+0000","last_active":"2023-10-06T04:28:10.781232+0000","last_peered":"2023-10-06T04:28:10.781232+0000","last_clean":"2023-10-06T04:28:10.781232+0000","last_became_active":"2023-10-06T04:28:06.334085+0000","last_became_peered":"2023-10-06T04:28:06.334085+0000","last_unstale":"2023-10-06T04:28:10.781232+0000","last_undegraded":"2023-10-06T04:28:10.781232+0000","last_fullsized":"2023-10-06T04:28:10.781232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:30.857061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779760+0000","last_change":"2023-10-06T04:28:06.347690+0000","last_active":"2023-10-06T04:28:10.779760+0000","last_peered":"2023-10-06T04:28:10.779760+0000","last_clean":"2023-10-06T04:28:10.779760+0000","last_became_active":"2023-10-06T04:28:06.347352+0000","last_became_peered":"2023-10-06T04:28:06.347352+0000","last_unstale":"2023-10-06T04:28:10.779760+0000","last_undegraded":"2023-10-06T04:28:10.779760+0000","last_fullsized":"2023-10-06T04:28:10.779760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:15.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802995+0000","last_change":"2023-10-06T04:28:10.801453+0000","last_active":"2023-10-06T04:28:10.802995+0000","last_peered":"2023-10-06T04:28:10.802995+0000","last_clean":"2023-10-06T04:28:10.802995+0000","last_became_active":"2023-10-06T04:28:10.801079+0000","last_became_peered":"2023-10-06T04:28:10.801079+0000","last_unstale":"2023-10-06T04:28:10.802995+0000","last_undegraded":"2023-10-06T04:28:10.802995+0000","last_fullsized":"2023-10-06T04:28:10.802995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:36.131936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770166+0000","last_change":"2023-10-06T04:28:05.761188+0000","last_active":"2023-10-06T04:28:10.770166+0000","last_peered":"2023-10-06T04:28:10.770166+0000","last_clean":"2023-10-06T04:28:10.770166+0000","last_became_active":"2023-10-06T04:28:05.760899+0000","last_became_peered":"2023-10-06T04:28:05.760899+0000","last_unstale":"2023-10-06T04:28:10.770166+0000","last_undegraded":"2023-10-06T04:28:10.770166+0000","last_fullsized":"2023-10-06T04:28:10.770166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:01:33.139108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770473+0000","last_change":"2023-10-06T04:28:06.341518+0000","last_active":"2023-10-06T04:28:10.770473+0000","last_peered":"2023-10-06T04:28:10.770473+0000","last_clean":"2023-10-06T04:28:10.770473+0000","last_became_active":"2023-10-06T04:28:06.341202+0000","last_became_peered":"2023-10-06T04:28:06.341202+0000","last_unstale":"2023-10-06T04:28:10.770473+0000","last_undegraded":"2023-10-06T04:28:10.770473+0000","last_fullsized":"2023-10-06T04:28:10.770473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:59.952485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.801053+0000","last_change":"2023-10-06T04:28:10.795457+0000","last_active":"2023-10-06T04:28:10.801053+0000","last_peered":"2023-10-06T04:28:10.801053+0000","last_clean":"2023-10-06T04:28:10.801053+0000","last_became_active":"2023-10-06T04:28:10.795098+0000","last_became_peered":"2023-10-06T04:28:10.795098+0000","last_unstale":"2023-10-06T04:28:10.801053+0000","last_undegraded":"2023-10-06T04:28:10.801053+0000","last_fullsized":"2023-10-06T04:28:10.801053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:13.098060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776901+0000","last_change":"2023-10-06T04:28:05.756129+0000","last_active":"2023-10-06T04:28:10.776901+0000","last_peered":"2023-10-06T04:28:10.776901+0000","last_clean":"2023-10-06T04:28:10.776901+0000","last_became_active":"2023-10-06T04:28:05.755795+0000","last_became_peered":"2023-10-06T04:28:05.755795+0000","last_unstale":"2023-10-06T04:28:10.776901+0000","last_undegraded":"2023-10-06T04:28:10.776901+0000","last_fullsized":"2023-10-06T04:28:10.776901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:31.777366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769931+0000","last_change":"2023-10-06T04:28:06.345205+0000","last_active":"2023-10-06T04:28:10.769931+0000","last_peered":"2023-10-06T04:28:10.769931+0000","last_clean":"2023-10-06T04:28:10.769931+0000","last_became_active":"2023-10-06T04:28:06.342334+0000","last_became_peered":"2023-10-06T04:28:06.342334+0000","last_unstale":"2023-10-06T04:28:10.769931+0000","last_undegraded":"2023-10-06T04:28:10.769931+0000","last_fullsized":"2023-10-06T04:28:10.769931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:27.073025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.793941+0000","last_change":"2023-10-06T04:28:10.792492+0000","last_active":"2023-10-06T04:28:10.793941+0000","last_peered":"2023-10-06T04:28:10.793941+0000","last_clean":"2023-10-06T04:28:10.793941+0000","last_became_active":"2023-10-06T04:28:10.791665+0000","last_became_peered":"2023-10-06T04:28:10.791665+0000","last_unstale":"2023-10-06T04:28:10.793941+0000","last_undegraded":"2023-10-06T04:28:10.793941+0000","last_fullsized":"2023-10-06T04:28:10.793941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:52.113969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771973+0000","last_change":"2023-10-06T04:28:05.766695+0000","last_active":"2023-10-06T04:28:10.771973+0000","last_peered":"2023-10-06T04:28:10.771973+0000","last_clean":"2023-10-06T04:28:10.771973+0000","last_became_active":"2023-10-06T04:28:05.766394+0000","last_became_peered":"2023-10-06T04:28:05.766394+0000","last_unstale":"2023-10-06T04:28:10.771973+0000","last_undegraded":"2023-10-06T04:28:10.771973+0000","last_fullsized":"2023-10-06T04:28:10.771973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:01.869120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769616+0000","last_change":"2023-10-06T04:28:06.340699+0000","last_active":"2023-10-06T04:28:10.769616+0000","last_peered":"2023-10-06T04:28:10.769616+0000","last_clean":"2023-10-06T04:28:10.769616+0000","last_became_active":"2023-10-06T04:28:06.339789+0000","last_became_peered":"2023-10-06T04:28:06.339789+0000","last_unstale":"2023-10-06T04:28:10.769616+0000","last_undegraded":"2023-10-06T04:28:10.769616+0000","last_fullsized":"2023-10-06T04:28:10.769616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:30.857061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.807709+0000","last_change":"2023-10-06T04:28:10.804204+0000","last_active":"2023-10-06T04:28:10.807709+0000","last_peered":"2023-10-06T04:28:10.807709+0000","last_clean":"2023-10-06T04:28:10.807709+0000","last_became_active":"2023-10-06T04:28:10.803790+0000","last_became_peered":"2023-10-06T04:28:10.803790+0000","last_unstale":"2023-10-06T04:28:10.807709+0000","last_undegraded":"2023-10-06T04:28:10.807709+0000","last_fullsized":"2023-10-06T04:28:10.807709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:24.109196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770090+0000","last_change":"2023-10-06T04:28:05.755711+0000","last_active":"2023-10-06T04:28:10.770090+0000","last_peered":"2023-10-06T04:28:10.770090+0000","last_clean":"2023-10-06T04:28:10.770090+0000","last_became_active":"2023-10-06T04:28:05.755078+0000","last_became_peered":"2023-10-06T04:28:05.755078+0000","last_unstale":"2023-10-06T04:28:10.770090+0000","last_undegraded":"2023-10-06T04:28:10.770090+0000","last_fullsized":"2023-10-06T04:28:10.770090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:13.125425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771897+0000","last_change":"2023-10-06T04:28:06.341424+0000","last_active":"2023-10-06T04:28:10.771897+0000","last_peered":"2023-10-06T04:28:10.771897+0000","last_clean":"2023-10-06T04:28:10.771897+0000","last_became_active":"2023-10-06T04:28:06.341143+0000","last_became_peered":"2023-10-06T04:28:06.341143+0000","last_unstale":"2023-10-06T04:28:10.771897+0000","last_undegraded":"2023-10-06T04:28:10.771897+0000","last_fullsized":"2023-10-06T04:28:10.771897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:58.373238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802044+0000","last_change":"2023-10-06T04:28:10.795677+0000","last_active":"2023-10-06T04:28:10.802044+0000","last_peered":"2023-10-06T04:28:10.802044+0000","last_clean":"2023-10-06T04:28:10.802044+0000","last_became_active":"2023-10-06T04:28:10.795322+0000","last_became_peered":"2023-10-06T04:28:10.795322+0000","last_unstale":"2023-10-06T04:28:10.802044+0000","last_undegraded":"2023-10-06T04:28:10.802044+0000","last_fullsized":"2023-10-06T04:28:10.802044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:43.446834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.778777+0000","last_change":"2023-10-06T04:28:05.755211+0000","last_active":"2023-10-06T04:28:10.778777+0000","last_peered":"2023-10-06T04:28:10.778777+0000","last_clean":"2023-10-06T04:28:10.778777+0000","last_became_active":"2023-10-06T04:28:05.754921+0000","last_became_peered":"2023-10-06T04:28:05.754921+0000","last_unstale":"2023-10-06T04:28:10.778777+0000","last_undegraded":"2023-10-06T04:28:10.778777+0000","last_fullsized":"2023-10-06T04:28:10.778777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:24.180507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772506+0000","last_change":"2023-10-06T04:28:06.337449+0000","last_active":"2023-10-06T04:28:10.772506+0000","last_peered":"2023-10-06T04:28:10.772506+0000","last_clean":"2023-10-06T04:28:10.772506+0000","last_became_active":"2023-10-06T04:28:06.337164+0000","last_became_peered":"2023-10-06T04:28:06.337164+0000","last_unstale":"2023-10-06T04:28:10.772506+0000","last_undegraded":"2023-10-06T04:28:10.772506+0000","last_fullsized":"2023-10-06T04:28:10.772506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:39.187212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.809084+0000","last_change":"2023-10-06T04:28:10.805106+0000","last_active":"2023-10-06T04:28:10.809084+0000","last_peered":"2023-10-06T04:28:10.809084+0000","last_clean":"2023-10-06T04:28:10.809084+0000","last_became_active":"2023-10-06T04:28:10.804660+0000","last_became_peered":"2023-10-06T04:28:10.804660+0000","last_unstale":"2023-10-06T04:28:10.809084+0000","last_undegraded":"2023-10-06T04:28:10.809084+0000","last_fullsized":"2023-10-06T04:28:10.809084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:33:06.767121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779391+0000","last_change":"2023-10-06T04:28:05.763511+0000","last_active":"2023-10-06T04:28:10.779391+0000","last_peered":"2023-10-06T04:28:10.779391+0000","last_clean":"2023-10-06T04:28:10.779391+0000","last_became_active":"2023-10-06T04:28:05.763165+0000","last_became_peered":"2023-10-06T04:28:05.763165+0000","last_unstale":"2023-10-06T04:28:10.779391+0000","last_undegraded":"2023-10-06T04:28:10.779391+0000","last_fullsized":"2023-10-06T04:28:10.779391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:58.212679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.780725+0000","last_change":"2023-10-06T04:28:06.335419+0000","last_active":"2023-10-06T04:28:10.780725+0000","last_peered":"2023-10-06T04:28:10.780725+0000","last_clean":"2023-10-06T04:28:10.780725+0000","last_became_active":"2023-10-06T04:28:06.335165+0000","last_became_peered":"2023-10-06T04:28:06.335165+0000","last_unstale":"2023-10-06T04:28:10.780725+0000","last_undegraded":"2023-10-06T04:28:10.780725+0000","last_fullsized":"2023-10-06T04:28:10.780725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:15.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.795671+0000","last_change":"2023-10-06T04:28:10.791897+0000","last_active":"2023-10-06T04:28:10.795671+0000","last_peered":"2023-10-06T04:28:10.795671+0000","last_clean":"2023-10-06T04:28:10.795671+0000","last_became_active":"2023-10-06T04:28:10.791427+0000","last_became_peered":"2023-10-06T04:28:10.791427+0000","last_unstale":"2023-10-06T04:28:10.795671+0000","last_undegraded":"2023-10-06T04:28:10.795671+0000","last_fullsized":"2023-10-06T04:28:10.795671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:23.024555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T04:28:20.129303+0000","last_change":"2023-10-06T04:28:05.756961+0000","last_active":"2023-10-06T04:28:20.129303+0000","last_peered":"2023-10-06T04:28:20.129303+0000","last_clean":"2023-10-06T04:28:20.129303+0000","last_became_active":"2023-10-06T04:28:05.756443+0000","last_became_peered":"2023-10-06T04:28:05.756443+0000","last_unstale":"2023-10-06T04:28:20.129303+0000","last_undegraded":"2023-10-06T04:28:20.129303+0000","last_fullsized":"2023-10-06T04:28:20.129303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:15.728042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768364+0000","last_change":"2023-10-06T04:28:06.350205+0000","last_active":"2023-10-06T04:28:10.768364+0000","last_peered":"2023-10-06T04:28:10.768364+0000","last_clean":"2023-10-06T04:28:10.768364+0000","last_became_active":"2023-10-06T04:28:06.347777+0000","last_became_peered":"2023-10-06T04:28:06.347777+0000","last_unstale":"2023-10-06T04:28:10.768364+0000","last_undegraded":"2023-10-06T04:28:10.768364+0000","last_fullsized":"2023-10-06T04:28:10.768364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:24:58.690599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.800408+0000","last_change":"2023-10-06T04:28:10.799162+0000","last_active":"2023-10-06T04:28:10.800408+0000","last_peered":"2023-10-06T04:28:10.800408+0000","last_clean":"2023-10-06T04:28:10.800408+0000","last_became_active":"2023-10-06T04:28:10.798723+0000","last_became_peered":"2023-10-06T04:28:10.798723+0000","last_unstale":"2023-10-06T04:28:10.800408+0000","last_undegraded":"2023-10-06T04:28:10.800408+0000","last_fullsized":"2023-10-06T04:28:10.800408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:57.373019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776524+0000","last_change":"2023-10-06T04:28:05.762181+0000","last_active":"2023-10-06T04:28:10.776524+0000","last_peered":"2023-10-06T04:28:10.776524+0000","last_clean":"2023-10-06T04:28:10.776524+0000","last_became_active":"2023-10-06T04:28:05.761833+0000","last_became_peered":"2023-10-06T04:28:05.761833+0000","last_unstale":"2023-10-06T04:28:10.776524+0000","last_undegraded":"2023-10-06T04:28:10.776524+0000","last_fullsized":"2023-10-06T04:28:10.776524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:31.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770860+0000","last_change":"2023-10-06T04:28:06.340906+0000","last_active":"2023-10-06T04:28:10.770860+0000","last_peered":"2023-10-06T04:28:10.770860+0000","last_clean":"2023-10-06T04:28:10.770860+0000","last_became_active":"2023-10-06T04:28:06.340662+0000","last_became_peered":"2023-10-06T04:28:06.340662+0000","last_unstale":"2023-10-06T04:28:10.770860+0000","last_undegraded":"2023-10-06T04:28:10.770860+0000","last_fullsized":"2023-10-06T04:28:10.770860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:17.928102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.809048+0000","last_change":"2023-10-06T04:28:10.804183+0000","last_active":"2023-10-06T04:28:10.809048+0000","last_peered":"2023-10-06T04:28:10.809048+0000","last_clean":"2023-10-06T04:28:10.809048+0000","last_became_active":"2023-10-06T04:28:10.803784+0000","last_became_peered":"2023-10-06T04:28:10.803784+0000","last_unstale":"2023-10-06T04:28:10.809048+0000","last_undegraded":"2023-10-06T04:28:10.809048+0000","last_fullsized":"2023-10-06T04:28:10.809048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:31.800551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769741+0000","last_change":"2023-10-06T04:28:05.750972+0000","last_active":"2023-10-06T04:28:10.769741+0000","last_peered":"2023-10-06T04:28:10.769741+0000","last_clean":"2023-10-06T04:28:10.769741+0000","last_became_active":"2023-10-06T04:28:05.750669+0000","last_became_peered":"2023-10-06T04:28:05.750669+0000","last_unstale":"2023-10-06T04:28:10.769741+0000","last_undegraded":"2023-10-06T04:28:10.769741+0000","last_fullsized":"2023-10-06T04:28:10.769741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:24.180507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779676+0000","last_change":"2023-10-06T04:28:06.347817+0000","last_active":"2023-10-06T04:28:10.779676+0000","last_peered":"2023-10-06T04:28:10.779676+0000","last_clean":"2023-10-06T04:28:10.779676+0000","last_became_active":"2023-10-06T04:28:06.347502+0000","last_became_peered":"2023-10-06T04:28:06.347502+0000","last_unstale":"2023-10-06T04:28:10.779676+0000","last_undegraded":"2023-10-06T04:28:10.779676+0000","last_fullsized":"2023-10-06T04:28:10.779676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:13.160015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.809120+0000","last_change":"2023-10-06T04:28:10.805867+0000","last_active":"2023-10-06T04:28:10.809120+0000","last_peered":"2023-10-06T04:28:10.809120+0000","last_clean":"2023-10-06T04:28:10.809120+0000","last_became_active":"2023-10-06T04:28:10.805292+0000","last_became_peered":"2023-10-06T04:28:10.805292+0000","last_unstale":"2023-10-06T04:28:10.809120+0000","last_undegraded":"2023-10-06T04:28:10.809120+0000","last_fullsized":"2023-10-06T04:28:10.809120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:21.459093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774023+0000","last_change":"2023-10-06T04:28:05.758582+0000","last_active":"2023-10-06T04:28:10.774023+0000","last_peered":"2023-10-06T04:28:10.774023+0000","last_clean":"2023-10-06T04:28:10.774023+0000","last_became_active":"2023-10-06T04:28:05.758300+0000","last_became_peered":"2023-10-06T04:28:05.758300+0000","last_unstale":"2023-10-06T04:28:10.774023+0000","last_undegraded":"2023-10-06T04:28:10.774023+0000","last_fullsized":"2023-10-06T04:28:10.774023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:46.282985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770173+0000","last_change":"2023-10-06T04:28:06.347051+0000","last_active":"2023-10-06T04:28:10.770173+0000","last_peered":"2023-10-06T04:28:10.770173+0000","last_clean":"2023-10-06T04:28:10.770173+0000","last_became_active":"2023-10-06T04:28:06.346605+0000","last_became_peered":"2023-10-06T04:28:06.346605+0000","last_unstale":"2023-10-06T04:28:10.770173+0000","last_undegraded":"2023-10-06T04:28:10.770173+0000","last_fullsized":"2023-10-06T04:28:10.770173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:28.999532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.799625+0000","last_change":"2023-10-06T04:28:10.797651+0000","last_active":"2023-10-06T04:28:10.799625+0000","last_peered":"2023-10-06T04:28:10.799625+0000","last_clean":"2023-10-06T04:28:10.799625+0000","last_became_active":"2023-10-06T04:28:10.797232+0000","last_became_peered":"2023-10-06T04:28:10.797232+0000","last_unstale":"2023-10-06T04:28:10.799625+0000","last_undegraded":"2023-10-06T04:28:10.799625+0000","last_fullsized":"2023-10-06T04:28:10.799625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:11.414923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769762+0000","last_change":"2023-10-06T04:28:05.742570+0000","last_active":"2023-10-06T04:28:10.769762+0000","last_peered":"2023-10-06T04:28:10.769762+0000","last_clean":"2023-10-06T04:28:10.769762+0000","last_became_active":"2023-10-06T04:28:05.742241+0000","last_became_peered":"2023-10-06T04:28:05.742241+0000","last_unstale":"2023-10-06T04:28:10.769762+0000","last_undegraded":"2023-10-06T04:28:10.769762+0000","last_fullsized":"2023-10-06T04:28:10.769762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:13.125425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770855+0000","last_change":"2023-10-06T04:28:06.337353+0000","last_active":"2023-10-06T04:28:10.770855+0000","last_peered":"2023-10-06T04:28:10.770855+0000","last_clean":"2023-10-06T04:28:10.770855+0000","last_became_active":"2023-10-06T04:28:06.337087+0000","last_became_peered":"2023-10-06T04:28:06.337087+0000","last_unstale":"2023-10-06T04:28:10.770855+0000","last_undegraded":"2023-10-06T04:28:10.770855+0000","last_fullsized":"2023-10-06T04:28:10.770855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:36.507036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802188+0000","last_change":"2023-10-06T04:28:10.800008+0000","last_active":"2023-10-06T04:28:10.802188+0000","last_peered":"2023-10-06T04:28:10.802188+0000","last_clean":"2023-10-06T04:28:10.802188+0000","last_became_active":"2023-10-06T04:28:10.799373+0000","last_became_peered":"2023-10-06T04:28:10.799373+0000","last_unstale":"2023-10-06T04:28:10.802188+0000","last_undegraded":"2023-10-06T04:28:10.802188+0000","last_fullsized":"2023-10-06T04:28:10.802188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:23.024555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.780048+0000","last_change":"2023-10-06T04:28:05.762026+0000","last_active":"2023-10-06T04:28:10.780048+0000","last_peered":"2023-10-06T04:28:10.780048+0000","last_clean":"2023-10-06T04:28:10.780048+0000","last_became_active":"2023-10-06T04:28:05.761745+0000","last_became_peered":"2023-10-06T04:28:05.761745+0000","last_unstale":"2023-10-06T04:28:10.780048+0000","last_undegraded":"2023-10-06T04:28:10.780048+0000","last_fullsized":"2023-10-06T04:28:10.780048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:25.024995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774954+0000","last_change":"2023-10-06T04:28:06.346072+0000","last_active":"2023-10-06T04:28:10.774954+0000","last_peered":"2023-10-06T04:28:10.774954+0000","last_clean":"2023-10-06T04:28:10.774954+0000","last_became_active":"2023-10-06T04:28:06.345770+0000","last_became_peered":"2023-10-06T04:28:06.345770+0000","last_unstale":"2023-10-06T04:28:10.774954+0000","last_undegraded":"2023-10-06T04:28:10.774954+0000","last_fullsized":"2023-10-06T04:28:10.774954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:53.248928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.785697+0000","last_change":"2023-10-06T04:28:10.784166+0000","last_active":"2023-10-06T04:28:10.785697+0000","last_peered":"2023-10-06T04:28:10.785697+0000","last_clean":"2023-10-06T04:28:10.785697+0000","last_became_active":"2023-10-06T04:28:10.783671+0000","last_became_peered":"2023-10-06T04:28:10.783671+0000","last_unstale":"2023-10-06T04:28:10.785697+0000","last_undegraded":"2023-10-06T04:28:10.785697+0000","last_fullsized":"2023-10-06T04:28:10.785697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:18.568583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776289+0000","last_change":"2023-10-06T04:28:05.762151+0000","last_active":"2023-10-06T04:28:10.776289+0000","last_peered":"2023-10-06T04:28:10.776289+0000","last_clean":"2023-10-06T04:28:10.776289+0000","last_became_active":"2023-10-06T04:28:05.761792+0000","last_became_peered":"2023-10-06T04:28:05.761792+0000","last_unstale":"2023-10-06T04:28:10.776289+0000","last_undegraded":"2023-10-06T04:28:10.776289+0000","last_fullsized":"2023-10-06T04:28:10.776289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:01.869120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769462+0000","last_change":"2023-10-06T04:28:06.350312+0000","last_active":"2023-10-06T04:28:10.769462+0000","last_peered":"2023-10-06T04:28:10.769462+0000","last_clean":"2023-10-06T04:28:10.769462+0000","last_became_active":"2023-10-06T04:28:06.349971+0000","last_became_peered":"2023-10-06T04:28:06.349971+0000","last_unstale":"2023-10-06T04:28:10.769462+0000","last_undegraded":"2023-10-06T04:28:10.769462+0000","last_fullsized":"2023-10-06T04:28:10.769462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:03.824145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.782164+0000","last_change":"2023-10-06T04:28:10.780132+0000","last_active":"2023-10-06T04:28:10.782164+0000","last_peered":"2023-10-06T04:28:10.782164+0000","last_clean":"2023-10-06T04:28:10.782164+0000","last_became_active":"2023-10-06T04:28:10.779808+0000","last_became_peered":"2023-10-06T04:28:10.779808+0000","last_unstale":"2023-10-06T04:28:10.782164+0000","last_undegraded":"2023-10-06T04:28:10.782164+0000","last_fullsized":"2023-10-06T04:28:10.782164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:36.272215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779299+0000","last_change":"2023-10-06T04:28:05.756128+0000","last_active":"2023-10-06T04:28:10.779299+0000","last_peered":"2023-10-06T04:28:10.779299+0000","last_clean":"2023-10-06T04:28:10.779299+0000","last_became_active":"2023-10-06T04:28:05.755749+0000","last_became_peered":"2023-10-06T04:28:05.755749+0000","last_unstale":"2023-10-06T04:28:10.779299+0000","last_undegraded":"2023-10-06T04:28:10.779299+0000","last_fullsized":"2023-10-06T04:28:10.779299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:53.511624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768694+0000","last_change":"2023-10-06T04:28:06.340325+0000","last_active":"2023-10-06T04:28:10.768694+0000","last_peered":"2023-10-06T04:28:10.768694+0000","last_clean":"2023-10-06T04:28:10.768694+0000","last_became_active":"2023-10-06T04:28:06.339640+0000","last_became_peered":"2023-10-06T04:28:06.339640+0000","last_unstale":"2023-10-06T04:28:10.768694+0000","last_undegraded":"2023-10-06T04:28:10.768694+0000","last_fullsized":"2023-10-06T04:28:10.768694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:13.160015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802745+0000","last_change":"2023-10-06T04:28:10.797879+0000","last_active":"2023-10-06T04:28:10.802745+0000","last_peered":"2023-10-06T04:28:10.802745+0000","last_clean":"2023-10-06T04:28:10.802745+0000","last_became_active":"2023-10-06T04:28:10.797454+0000","last_became_peered":"2023-10-06T04:28:10.797454+0000","last_unstale":"2023-10-06T04:28:10.802745+0000","last_undegraded":"2023-10-06T04:28:10.802745+0000","last_fullsized":"2023-10-06T04:28:10.802745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:21.953970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776131+0000","last_change":"2023-10-06T04:28:05.763894+0000","last_active":"2023-10-06T04:28:10.776131+0000","last_peered":"2023-10-06T04:28:10.776131+0000","last_clean":"2023-10-06T04:28:10.776131+0000","last_became_active":"2023-10-06T04:28:05.763596+0000","last_became_peered":"2023-10-06T04:28:05.763596+0000","last_unstale":"2023-10-06T04:28:10.776131+0000","last_undegraded":"2023-10-06T04:28:10.776131+0000","last_fullsized":"2023-10-06T04:28:10.776131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:31.777366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772230+0000","last_change":"2023-10-06T04:28:06.342227+0000","last_active":"2023-10-06T04:28:10.772230+0000","last_peered":"2023-10-06T04:28:10.772230+0000","last_clean":"2023-10-06T04:28:10.772230+0000","last_became_active":"2023-10-06T04:28:06.341974+0000","last_became_peered":"2023-10-06T04:28:06.341974+0000","last_unstale":"2023-10-06T04:28:10.772230+0000","last_undegraded":"2023-10-06T04:28:10.772230+0000","last_fullsized":"2023-10-06T04:28:10.772230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:34.925929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.795509+0000","last_change":"2023-10-06T04:28:10.790497+0000","last_active":"2023-10-06T04:28:10.795509+0000","last_peered":"2023-10-06T04:28:10.795509+0000","last_clean":"2023-10-06T04:28:10.795509+0000","last_became_active":"2023-10-06T04:28:10.790006+0000","last_became_peered":"2023-10-06T04:28:10.790006+0000","last_unstale":"2023-10-06T04:28:10.795509+0000","last_undegraded":"2023-10-06T04:28:10.795509+0000","last_fullsized":"2023-10-06T04:28:10.795509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:33.025399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771405+0000","last_change":"2023-10-06T04:28:05.762781+0000","last_active":"2023-10-06T04:28:10.771405+0000","last_peered":"2023-10-06T04:28:10.771405+0000","last_clean":"2023-10-06T04:28:10.771405+0000","last_became_active":"2023-10-06T04:28:05.762020+0000","last_became_peered":"2023-10-06T04:28:05.762020+0000","last_unstale":"2023-10-06T04:28:10.771405+0000","last_undegraded":"2023-10-06T04:28:10.771405+0000","last_fullsized":"2023-10-06T04:28:10.771405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:25.024995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770971+0000","last_change":"2023-10-06T04:28:06.349404+0000","last_active":"2023-10-06T04:28:10.770971+0000","last_peered":"2023-10-06T04:28:10.770971+0000","last_clean":"2023-10-06T04:28:10.770971+0000","last_became_active":"2023-10-06T04:28:06.349122+0000","last_became_peered":"2023-10-06T04:28:06.349122+0000","last_unstale":"2023-10-06T04:28:10.770971+0000","last_undegraded":"2023-10-06T04:28:10.770971+0000","last_fullsized":"2023-10-06T04:28:10.770971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:59.952485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.801165+0000","last_change":"2023-10-06T04:28:10.796293+0000","last_active":"2023-10-06T04:28:10.801165+0000","last_peered":"2023-10-06T04:28:10.801165+0000","last_clean":"2023-10-06T04:28:10.801165+0000","last_became_active":"2023-10-06T04:28:10.795652+0000","last_became_peered":"2023-10-06T04:28:10.795652+0000","last_unstale":"2023-10-06T04:28:10.801165+0000","last_undegraded":"2023-10-06T04:28:10.801165+0000","last_fullsized":"2023-10-06T04:28:10.801165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:32.517736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768694+0000","last_change":"2023-10-06T04:28:05.758453+0000","last_active":"2023-10-06T04:28:10.768694+0000","last_peered":"2023-10-06T04:28:10.768694+0000","last_clean":"2023-10-06T04:28:10.768694+0000","last_became_active":"2023-10-06T04:28:05.758154+0000","last_became_peered":"2023-10-06T04:28:05.758154+0000","last_unstale":"2023-10-06T04:28:10.768694+0000","last_undegraded":"2023-10-06T04:28:10.768694+0000","last_fullsized":"2023-10-06T04:28:10.768694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:24.180507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769342+0000","last_change":"2023-10-06T04:28:06.353299+0000","last_active":"2023-10-06T04:28:10.769342+0000","last_peered":"2023-10-06T04:28:10.769342+0000","last_clean":"2023-10-06T04:28:10.769342+0000","last_became_active":"2023-10-06T04:28:06.352474+0000","last_became_peered":"2023-10-06T04:28:06.352474+0000","last_unstale":"2023-10-06T04:28:10.769342+0000","last_undegraded":"2023-10-06T04:28:10.769342+0000","last_fullsized":"2023-10-06T04:28:10.769342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:28.491869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.798862+0000","last_change":"2023-10-06T04:28:10.792443+0000","last_active":"2023-10-06T04:28:10.798862+0000","last_peered":"2023-10-06T04:28:10.798862+0000","last_clean":"2023-10-06T04:28:10.798862+0000","last_became_active":"2023-10-06T04:28:10.791995+0000","last_became_peered":"2023-10-06T04:28:10.791995+0000","last_unstale":"2023-10-06T04:28:10.798862+0000","last_undegraded":"2023-10-06T04:28:10.798862+0000","last_fullsized":"2023-10-06T04:28:10.798862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:12.226268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769340+0000","last_change":"2023-10-06T04:28:05.757101+0000","last_active":"2023-10-06T04:28:10.769340+0000","last_peered":"2023-10-06T04:28:10.769340+0000","last_clean":"2023-10-06T04:28:10.769340+0000","last_became_active":"2023-10-06T04:28:05.756775+0000","last_became_peered":"2023-10-06T04:28:05.756775+0000","last_unstale":"2023-10-06T04:28:10.769340+0000","last_undegraded":"2023-10-06T04:28:10.769340+0000","last_fullsized":"2023-10-06T04:28:10.769340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:37.282042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769202+0000","last_change":"2023-10-06T04:28:06.351787+0000","last_active":"2023-10-06T04:28:10.769202+0000","last_peered":"2023-10-06T04:28:10.769202+0000","last_clean":"2023-10-06T04:28:10.769202+0000","last_became_active":"2023-10-06T04:28:06.351250+0000","last_became_peered":"2023-10-06T04:28:06.351250+0000","last_unstale":"2023-10-06T04:28:10.769202+0000","last_undegraded":"2023-10-06T04:28:10.769202+0000","last_fullsized":"2023-10-06T04:28:10.769202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:09.072192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802887+0000","last_change":"2023-10-06T04:28:10.798603+0000","last_active":"2023-10-06T04:28:10.802887+0000","last_peered":"2023-10-06T04:28:10.802887+0000","last_clean":"2023-10-06T04:28:10.802887+0000","last_became_active":"2023-10-06T04:28:10.798140+0000","last_became_peered":"2023-10-06T04:28:10.798140+0000","last_unstale":"2023-10-06T04:28:10.802887+0000","last_undegraded":"2023-10-06T04:28:10.802887+0000","last_fullsized":"2023-10-06T04:28:10.802887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:13.693194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771821+0000","last_change":"2023-10-06T04:28:05.761077+0000","last_active":"2023-10-06T04:28:10.771821+0000","last_peered":"2023-10-06T04:28:10.771821+0000","last_clean":"2023-10-06T04:28:10.771821+0000","last_became_active":"2023-10-06T04:28:05.760800+0000","last_became_peered":"2023-10-06T04:28:05.760800+0000","last_unstale":"2023-10-06T04:28:10.771821+0000","last_undegraded":"2023-10-06T04:28:10.771821+0000","last_fullsized":"2023-10-06T04:28:10.771821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:24.180507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776545+0000","last_change":"2023-10-06T04:28:06.338307+0000","last_active":"2023-10-06T04:28:10.776545+0000","last_peered":"2023-10-06T04:28:10.776545+0000","last_clean":"2023-10-06T04:28:10.776545+0000","last_became_active":"2023-10-06T04:28:06.338025+0000","last_became_peered":"2023-10-06T04:28:06.338025+0000","last_unstale":"2023-10-06T04:28:10.776545+0000","last_undegraded":"2023-10-06T04:28:10.776545+0000","last_fullsized":"2023-10-06T04:28:10.776545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:25.299896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802825+0000","last_change":"2023-10-06T04:28:10.796279+0000","last_active":"2023-10-06T04:28:10.802825+0000","last_peered":"2023-10-06T04:28:10.802825+0000","last_clean":"2023-10-06T04:28:10.802825+0000","last_became_active":"2023-10-06T04:28:10.795554+0000","last_became_peered":"2023-10-06T04:28:10.795554+0000","last_unstale":"2023-10-06T04:28:10.802825+0000","last_undegraded":"2023-10-06T04:28:10.802825+0000","last_fullsized":"2023-10-06T04:28:10.802825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:52.320723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770652+0000","last_change":"2023-10-06T04:28:05.754602+0000","last_active":"2023-10-06T04:28:10.770652+0000","last_peered":"2023-10-06T04:28:10.770652+0000","last_clean":"2023-10-06T04:28:10.770652+0000","last_became_active":"2023-10-06T04:28:05.754262+0000","last_became_peered":"2023-10-06T04:28:05.754262+0000","last_unstale":"2023-10-06T04:28:10.770652+0000","last_undegraded":"2023-10-06T04:28:10.770652+0000","last_fullsized":"2023-10-06T04:28:10.770652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:15.728042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769463+0000","last_change":"2023-10-06T04:28:00.325832+0000","last_active":"2023-10-06T04:28:10.769463+0000","last_peered":"2023-10-06T04:28:10.769463+0000","last_clean":"2023-10-06T04:28:10.769463+0000","last_became_active":"2023-10-06T04:28:00.325466+0000","last_became_peered":"2023-10-06T04:28:00.325466+0000","last_unstale":"2023-10-06T04:28:10.769463+0000","last_undegraded":"2023-10-06T04:28:10.769463+0000","last_fullsized":"2023-10-06T04:28:10.769463+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771741+0000","last_change":"2023-10-06T04:28:06.347871+0000","last_active":"2023-10-06T04:28:10.771741+0000","last_peered":"2023-10-06T04:28:10.771741+0000","last_clean":"2023-10-06T04:28:10.771741+0000","last_became_active":"2023-10-06T04:28:06.347598+0000","last_became_peered":"2023-10-06T04:28:06.347598+0000","last_unstale":"2023-10-06T04:28:10.771741+0000","last_undegraded":"2023-10-06T04:28:10.771741+0000","last_fullsized":"2023-10-06T04:28:10.771741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:03.824145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.809116+0000","last_change":"2023-10-06T04:28:10.805828+0000","last_active":"2023-10-06T04:28:10.809116+0000","last_peered":"2023-10-06T04:28:10.809116+0000","last_clean":"2023-10-06T04:28:10.809116+0000","last_became_active":"2023-10-06T04:28:10.805391+0000","last_became_peered":"2023-10-06T04:28:10.805391+0000","last_unstale":"2023-10-06T04:28:10.809116+0000","last_undegraded":"2023-10-06T04:28:10.809116+0000","last_fullsized":"2023-10-06T04:28:10.809116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:12.226268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770768+0000","last_change":"2023-10-06T04:28:00.175241+0000","last_active":"2023-10-06T04:28:10.770768+0000","last_peered":"2023-10-06T04:28:10.770768+0000","last_clean":"2023-10-06T04:28:10.770768+0000","last_became_active":"2023-10-06T04:28:00.174814+0000","last_became_peered":"2023-10-06T04:28:00.174814+0000","last_unstale":"2023-10-06T04:28:10.770768+0000","last_undegraded":"2023-10-06T04:28:10.770768+0000","last_fullsized":"2023-10-06T04:28:10.770768+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769844+0000","last_change":"2023-10-06T04:28:05.759716+0000","last_active":"2023-10-06T04:28:10.769844+0000","last_peered":"2023-10-06T04:28:10.769844+0000","last_clean":"2023-10-06T04:28:10.769844+0000","last_became_active":"2023-10-06T04:28:05.759378+0000","last_became_peered":"2023-10-06T04:28:05.759378+0000","last_unstale":"2023-10-06T04:28:10.769844+0000","last_undegraded":"2023-10-06T04:28:10.769844+0000","last_fullsized":"2023-10-06T04:28:10.769844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:31.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769414+0000","last_change":"2023-10-06T04:28:06.345648+0000","last_active":"2023-10-06T04:28:10.769414+0000","last_peered":"2023-10-06T04:28:10.769414+0000","last_clean":"2023-10-06T04:28:10.769414+0000","last_became_active":"2023-10-06T04:28:06.345327+0000","last_became_peered":"2023-10-06T04:28:06.345327+0000","last_unstale":"2023-10-06T04:28:10.769414+0000","last_undegraded":"2023-10-06T04:28:10.769414+0000","last_fullsized":"2023-10-06T04:28:10.769414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:30.857061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.799671+0000","last_change":"2023-10-06T04:28:10.798759+0000","last_active":"2023-10-06T04:28:10.799671+0000","last_peered":"2023-10-06T04:28:10.799671+0000","last_clean":"2023-10-06T04:28:10.799671+0000","last_became_active":"2023-10-06T04:28:10.798359+0000","last_became_peered":"2023-10-06T04:28:10.798359+0000","last_unstale":"2023-10-06T04:28:10.799671+0000","last_undegraded":"2023-10-06T04:28:10.799671+0000","last_fullsized":"2023-10-06T04:28:10.799671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:21.459093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.773701+0000","last_change":"2023-10-06T04:28:00.175086+0000","last_active":"2023-10-06T04:28:10.773701+0000","last_peered":"2023-10-06T04:28:10.773701+0000","last_clean":"2023-10-06T04:28:10.773701+0000","last_became_active":"2023-10-06T04:28:00.174735+0000","last_became_peered":"2023-10-06T04:28:00.174735+0000","last_unstale":"2023-10-06T04:28:10.773701+0000","last_undegraded":"2023-10-06T04:28:10.773701+0000","last_fullsized":"2023-10-06T04:28:10.773701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.777992+0000","last_change":"2023-10-06T04:28:01.176177+0000","last_active":"2023-10-06T04:28:10.777992+0000","last_peered":"2023-10-06T04:28:10.777992+0000","last_clean":"2023-10-06T04:28:10.777992+0000","last_became_active":"2023-10-06T04:28:01.175255+0000","last_became_peered":"2023-10-06T04:28:01.175255+0000","last_unstale":"2023-10-06T04:28:10.777992+0000","last_undegraded":"2023-10-06T04:28:10.777992+0000","last_fullsized":"2023-10-06T04:28:10.777992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:00.161020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:00.161020+0000","last_clean_scrub_stamp":"2023-10-06T04:28:00.161020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:29.208067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769407+0000","last_change":"2023-10-06T04:28:05.748512+0000","last_active":"2023-10-06T04:28:10.769407+0000","last_peered":"2023-10-06T04:28:10.769407+0000","last_clean":"2023-10-06T04:28:10.769407+0000","last_became_active":"2023-10-06T04:28:05.748197+0000","last_became_peered":"2023-10-06T04:28:05.748197+0000","last_unstale":"2023-10-06T04:28:10.769407+0000","last_undegraded":"2023-10-06T04:28:10.769407+0000","last_fullsized":"2023-10-06T04:28:10.769407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:31.777366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770089+0000","last_change":"2023-10-06T04:28:06.346860+0000","last_active":"2023-10-06T04:28:10.770089+0000","last_peered":"2023-10-06T04:28:10.770089+0000","last_clean":"2023-10-06T04:28:10.770089+0000","last_became_active":"2023-10-06T04:28:06.346244+0000","last_became_peered":"2023-10-06T04:28:06.346244+0000","last_unstale":"2023-10-06T04:28:10.770089+0000","last_undegraded":"2023-10-06T04:28:10.770089+0000","last_fullsized":"2023-10-06T04:28:10.770089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:25.299896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.799239+0000","last_change":"2023-10-06T04:28:10.796043+0000","last_active":"2023-10-06T04:28:10.799239+0000","last_peered":"2023-10-06T04:28:10.799239+0000","last_clean":"2023-10-06T04:28:10.799239+0000","last_became_active":"2023-10-06T04:28:10.794267+0000","last_became_peered":"2023-10-06T04:28:10.794267+0000","last_unstale":"2023-10-06T04:28:10.799239+0000","last_undegraded":"2023-10-06T04:28:10.799239+0000","last_fullsized":"2023-10-06T04:28:10.799239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:13.098060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776644+0000","last_change":"2023-10-06T04:28:00.344573+0000","last_active":"2023-10-06T04:28:10.776644+0000","last_peered":"2023-10-06T04:28:10.776644+0000","last_clean":"2023-10-06T04:28:10.776644+0000","last_became_active":"2023-10-06T04:28:00.344324+0000","last_became_peered":"2023-10-06T04:28:00.344324+0000","last_unstale":"2023-10-06T04:28:10.776644+0000","last_undegraded":"2023-10-06T04:28:10.776644+0000","last_fullsized":"2023-10-06T04:28:10.776644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:24.184826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.775065+0000","last_change":"2023-10-06T04:28:05.757315+0000","last_active":"2023-10-06T04:28:10.775065+0000","last_peered":"2023-10-06T04:28:10.775065+0000","last_clean":"2023-10-06T04:28:10.775065+0000","last_became_active":"2023-10-06T04:28:05.756903+0000","last_became_peered":"2023-10-06T04:28:05.756903+0000","last_unstale":"2023-10-06T04:28:10.775065+0000","last_undegraded":"2023-10-06T04:28:10.775065+0000","last_fullsized":"2023-10-06T04:28:10.775065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:37.282042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.773864+0000","last_change":"2023-10-06T04:28:06.346567+0000","last_active":"2023-10-06T04:28:10.773864+0000","last_peered":"2023-10-06T04:28:10.773864+0000","last_clean":"2023-10-06T04:28:10.773864+0000","last_became_active":"2023-10-06T04:28:06.343751+0000","last_became_peered":"2023-10-06T04:28:06.343751+0000","last_unstale":"2023-10-06T04:28:10.773864+0000","last_undegraded":"2023-10-06T04:28:10.773864+0000","last_fullsized":"2023-10-06T04:28:10.773864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:53.248928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.798693+0000","last_change":"2023-10-06T04:28:10.788813+0000","last_active":"2023-10-06T04:28:10.798693+0000","last_peered":"2023-10-06T04:28:10.798693+0000","last_clean":"2023-10-06T04:28:10.798693+0000","last_became_active":"2023-10-06T04:28:10.788350+0000","last_became_peered":"2023-10-06T04:28:10.788350+0000","last_unstale":"2023-10-06T04:28:10.798693+0000","last_undegraded":"2023-10-06T04:28:10.798693+0000","last_fullsized":"2023-10-06T04:28:10.798693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:02.062950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.777569+0000","last_change":"2023-10-06T04:28:00.343571+0000","last_active":"2023-10-06T04:28:10.777569+0000","last_peered":"2023-10-06T04:28:10.777569+0000","last_clean":"2023-10-06T04:28:10.777569+0000","last_became_active":"2023-10-06T04:28:00.343268+0000","last_became_peered":"2023-10-06T04:28:00.343268+0000","last_unstale":"2023-10-06T04:28:10.777569+0000","last_undegraded":"2023-10-06T04:28:10.777569+0000","last_fullsized":"2023-10-06T04:28:10.777569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:00.931419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770595+0000","last_change":"2023-10-06T04:28:05.760969+0000","last_active":"2023-10-06T04:28:10.770595+0000","last_peered":"2023-10-06T04:28:10.770595+0000","last_clean":"2023-10-06T04:28:10.770595+0000","last_became_active":"2023-10-06T04:28:05.758813+0000","last_became_peered":"2023-10-06T04:28:05.758813+0000","last_unstale":"2023-10-06T04:28:10.770595+0000","last_undegraded":"2023-10-06T04:28:10.770595+0000","last_fullsized":"2023-10-06T04:28:10.770595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:13.125425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769104+0000","last_change":"2023-10-06T04:28:06.354285+0000","last_active":"2023-10-06T04:28:10.769104+0000","last_peered":"2023-10-06T04:28:10.769104+0000","last_clean":"2023-10-06T04:28:10.769104+0000","last_became_active":"2023-10-06T04:28:06.354002+0000","last_became_peered":"2023-10-06T04:28:06.354002+0000","last_unstale":"2023-10-06T04:28:10.769104+0000","last_undegraded":"2023-10-06T04:28:10.769104+0000","last_fullsized":"2023-10-06T04:28:10.769104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:15.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.793988+0000","last_change":"2023-10-06T04:28:10.792299+0000","last_active":"2023-10-06T04:28:10.793988+0000","last_peered":"2023-10-06T04:28:10.793988+0000","last_clean":"2023-10-06T04:28:10.793988+0000","last_became_active":"2023-10-06T04:28:10.791854+0000","last_became_peered":"2023-10-06T04:28:10.791854+0000","last_unstale":"2023-10-06T04:28:10.793988+0000","last_undegraded":"2023-10-06T04:28:10.793988+0000","last_fullsized":"2023-10-06T04:28:10.793988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:08.567157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774747+0000","last_change":"2023-10-06T04:28:00.344460+0000","last_active":"2023-10-06T04:28:10.774747+0000","last_peered":"2023-10-06T04:28:10.774747+0000","last_clean":"2023-10-06T04:28:10.774747+0000","last_became_active":"2023-10-06T04:28:00.343280+0000","last_became_peered":"2023-10-06T04:28:00.343280+0000","last_unstale":"2023-10-06T04:28:10.774747+0000","last_undegraded":"2023-10-06T04:28:10.774747+0000","last_fullsized":"2023-10-06T04:28:10.774747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768452+0000","last_change":"2023-10-06T04:28:05.757503+0000","last_active":"2023-10-06T04:28:10.768452+0000","last_peered":"2023-10-06T04:28:10.768452+0000","last_clean":"2023-10-06T04:28:10.768452+0000","last_became_active":"2023-10-06T04:28:05.757218+0000","last_became_peered":"2023-10-06T04:28:05.757218+0000","last_unstale":"2023-10-06T04:28:10.768452+0000","last_undegraded":"2023-10-06T04:28:10.768452+0000","last_fullsized":"2023-10-06T04:28:10.768452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:31.777366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774659+0000","last_change":"2023-10-06T04:28:06.334345+0000","last_active":"2023-10-06T04:28:10.774659+0000","last_peered":"2023-10-06T04:28:10.774659+0000","last_clean":"2023-10-06T04:28:10.774659+0000","last_became_active":"2023-10-06T04:28:06.334114+0000","last_became_peered":"2023-10-06T04:28:06.334114+0000","last_unstale":"2023-10-06T04:28:10.774659+0000","last_undegraded":"2023-10-06T04:28:10.774659+0000","last_fullsized":"2023-10-06T04:28:10.774659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:34.925929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.786275+0000","last_change":"2023-10-06T04:28:10.782630+0000","last_active":"2023-10-06T04:28:10.786275+0000","last_peered":"2023-10-06T04:28:10.786275+0000","last_clean":"2023-10-06T04:28:10.786275+0000","last_became_active":"2023-10-06T04:28:10.782267+0000","last_became_peered":"2023-10-06T04:28:10.782267+0000","last_unstale":"2023-10-06T04:28:10.786275+0000","last_undegraded":"2023-10-06T04:28:10.786275+0000","last_fullsized":"2023-10-06T04:28:10.786275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:11.414923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769001+0000","last_change":"2023-10-06T04:28:00.343592+0000","last_active":"2023-10-06T04:28:10.769001+0000","last_peered":"2023-10-06T04:28:10.769001+0000","last_clean":"2023-10-06T04:28:10.769001+0000","last_became_active":"2023-10-06T04:28:00.343313+0000","last_became_peered":"2023-10-06T04:28:00.343313+0000","last_unstale":"2023-10-06T04:28:10.769001+0000","last_undegraded":"2023-10-06T04:28:10.769001+0000","last_fullsized":"2023-10-06T04:28:10.769001+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:24.184826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774880+0000","last_change":"2023-10-06T04:28:05.760166+0000","last_active":"2023-10-06T04:28:10.774880+0000","last_peered":"2023-10-06T04:28:10.774880+0000","last_clean":"2023-10-06T04:28:10.774880+0000","last_became_active":"2023-10-06T04:28:05.759837+0000","last_became_peered":"2023-10-06T04:28:05.759837+0000","last_unstale":"2023-10-06T04:28:10.774880+0000","last_undegraded":"2023-10-06T04:28:10.774880+0000","last_fullsized":"2023-10-06T04:28:10.774880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:01:33.139108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772008+0000","last_change":"2023-10-06T04:28:06.340003+0000","last_active":"2023-10-06T04:28:10.772008+0000","last_peered":"2023-10-06T04:28:10.772008+0000","last_clean":"2023-10-06T04:28:10.772008+0000","last_became_active":"2023-10-06T04:28:06.339372+0000","last_became_peered":"2023-10-06T04:28:06.339372+0000","last_unstale":"2023-10-06T04:28:10.772008+0000","last_undegraded":"2023-10-06T04:28:10.772008+0000","last_fullsized":"2023-10-06T04:28:10.772008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:39.187212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.791694+0000","last_change":"2023-10-06T04:28:10.788742+0000","last_active":"2023-10-06T04:28:10.791694+0000","last_peered":"2023-10-06T04:28:10.791694+0000","last_clean":"2023-10-06T04:28:10.791694+0000","last_became_active":"2023-10-06T04:28:10.788218+0000","last_became_peered":"2023-10-06T04:28:10.788218+0000","last_unstale":"2023-10-06T04:28:10.791694+0000","last_undegraded":"2023-10-06T04:28:10.791694+0000","last_fullsized":"2023-10-06T04:28:10.791694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.241552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769530+0000","last_change":"2023-10-06T04:28:00.174563+0000","last_active":"2023-10-06T04:28:10.769530+0000","last_peered":"2023-10-06T04:28:10.769530+0000","last_clean":"2023-10-06T04:28:10.769530+0000","last_became_active":"2023-10-06T04:28:00.174265+0000","last_became_peered":"2023-10-06T04:28:00.174265+0000","last_unstale":"2023-10-06T04:28:10.769530+0000","last_undegraded":"2023-10-06T04:28:10.769530+0000","last_fullsized":"2023-10-06T04:28:10.769530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:00.931419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779588+0000","last_change":"2023-10-06T04:28:05.764045+0000","last_active":"2023-10-06T04:28:10.779588+0000","last_peered":"2023-10-06T04:28:10.779588+0000","last_clean":"2023-10-06T04:28:10.779588+0000","last_became_active":"2023-10-06T04:28:05.763751+0000","last_became_peered":"2023-10-06T04:28:05.763751+0000","last_unstale":"2023-10-06T04:28:10.779588+0000","last_undegraded":"2023-10-06T04:28:10.779588+0000","last_fullsized":"2023-10-06T04:28:10.779588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:31.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.780519+0000","last_change":"2023-10-06T04:28:06.341910+0000","last_active":"2023-10-06T04:28:10.780519+0000","last_peered":"2023-10-06T04:28:10.780519+0000","last_clean":"2023-10-06T04:28:10.780519+0000","last_became_active":"2023-10-06T04:28:06.340194+0000","last_became_peered":"2023-10-06T04:28:06.340194+0000","last_unstale":"2023-10-06T04:28:10.780519+0000","last_undegraded":"2023-10-06T04:28:10.780519+0000","last_fullsized":"2023-10-06T04:28:10.780519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:25.121736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.796035+0000","last_change":"2023-10-06T04:28:10.794957+0000","last_active":"2023-10-06T04:28:10.796035+0000","last_peered":"2023-10-06T04:28:10.796035+0000","last_clean":"2023-10-06T04:28:10.796035+0000","last_became_active":"2023-10-06T04:28:10.793329+0000","last_became_peered":"2023-10-06T04:28:10.793329+0000","last_unstale":"2023-10-06T04:28:10.796035+0000","last_undegraded":"2023-10-06T04:28:10.796035+0000","last_fullsized":"2023-10-06T04:28:10.796035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:11.414923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771921+0000","last_change":"2023-10-06T04:28:05.759061+0000","last_active":"2023-10-06T04:28:10.771921+0000","last_peered":"2023-10-06T04:28:10.771921+0000","last_clean":"2023-10-06T04:28:10.771921+0000","last_became_active":"2023-10-06T04:28:05.757716+0000","last_became_peered":"2023-10-06T04:28:05.757716+0000","last_unstale":"2023-10-06T04:28:10.771921+0000","last_undegraded":"2023-10-06T04:28:10.771921+0000","last_fullsized":"2023-10-06T04:28:10.771921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:37.282042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.766753+0000","last_change":"2023-10-06T04:28:06.339102+0000","last_active":"2023-10-06T04:28:10.766753+0000","last_peered":"2023-10-06T04:28:10.766753+0000","last_clean":"2023-10-06T04:28:10.766753+0000","last_became_active":"2023-10-06T04:28:06.338781+0000","last_became_peered":"2023-10-06T04:28:06.338781+0000","last_unstale":"2023-10-06T04:28:10.766753+0000","last_undegraded":"2023-10-06T04:28:10.766753+0000","last_fullsized":"2023-10-06T04:28:10.766753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:32.169844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.801878+0000","last_change":"2023-10-06T04:28:10.795685+0000","last_active":"2023-10-06T04:28:10.801878+0000","last_peered":"2023-10-06T04:28:10.801878+0000","last_clean":"2023-10-06T04:28:10.801878+0000","last_became_active":"2023-10-06T04:28:10.795281+0000","last_became_peered":"2023-10-06T04:28:10.795281+0000","last_unstale":"2023-10-06T04:28:10.801878+0000","last_undegraded":"2023-10-06T04:28:10.801878+0000","last_fullsized":"2023-10-06T04:28:10.801878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:11.414923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774978+0000","last_change":"2023-10-06T04:28:05.760540+0000","last_active":"2023-10-06T04:28:10.774978+0000","last_peered":"2023-10-06T04:28:10.774978+0000","last_clean":"2023-10-06T04:28:10.774978+0000","last_became_active":"2023-10-06T04:28:05.760213+0000","last_became_peered":"2023-10-06T04:28:05.760213+0000","last_unstale":"2023-10-06T04:28:10.774978+0000","last_undegraded":"2023-10-06T04:28:10.774978+0000","last_fullsized":"2023-10-06T04:28:10.774978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:13.125425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768541+0000","last_change":"2023-10-06T04:28:06.351862+0000","last_active":"2023-10-06T04:28:10.768541+0000","last_peered":"2023-10-06T04:28:10.768541+0000","last_clean":"2023-10-06T04:28:10.768541+0000","last_became_active":"2023-10-06T04:28:06.351613+0000","last_became_peered":"2023-10-06T04:28:06.351613+0000","last_unstale":"2023-10-06T04:28:10.768541+0000","last_undegraded":"2023-10-06T04:28:10.768541+0000","last_fullsized":"2023-10-06T04:28:10.768541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:36.507036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.798917+0000","last_change":"2023-10-06T04:28:10.791630+0000","last_active":"2023-10-06T04:28:10.798917+0000","last_peered":"2023-10-06T04:28:10.798917+0000","last_clean":"2023-10-06T04:28:10.798917+0000","last_became_active":"2023-10-06T04:28:10.791196+0000","last_became_peered":"2023-10-06T04:28:10.791196+0000","last_unstale":"2023-10-06T04:28:10.798917+0000","last_undegraded":"2023-10-06T04:28:10.798917+0000","last_fullsized":"2023-10-06T04:28:10.798917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.241552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779937+0000","last_change":"2023-10-06T04:28:05.761937+0000","last_active":"2023-10-06T04:28:10.779937+0000","last_peered":"2023-10-06T04:28:10.779937+0000","last_clean":"2023-10-06T04:28:10.779937+0000","last_became_active":"2023-10-06T04:28:05.761666+0000","last_became_peered":"2023-10-06T04:28:05.761666+0000","last_unstale":"2023-10-06T04:28:10.779937+0000","last_undegraded":"2023-10-06T04:28:10.779937+0000","last_fullsized":"2023-10-06T04:28:10.779937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:15.728042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770368+0000","last_change":"2023-10-06T04:28:06.350532+0000","last_active":"2023-10-06T04:28:10.770368+0000","last_peered":"2023-10-06T04:28:10.770368+0000","last_clean":"2023-10-06T04:28:10.770368+0000","last_became_active":"2023-10-06T04:28:06.349418+0000","last_became_peered":"2023-10-06T04:28:06.349418+0000","last_unstale":"2023-10-06T04:28:10.770368+0000","last_undegraded":"2023-10-06T04:28:10.770368+0000","last_fullsized":"2023-10-06T04:28:10.770368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:17.928102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802894+0000","last_change":"2023-10-06T04:28:10.798677+0000","last_active":"2023-10-06T04:28:10.802894+0000","last_peered":"2023-10-06T04:28:10.802894+0000","last_clean":"2023-10-06T04:28:10.802894+0000","last_became_active":"2023-10-06T04:28:10.798151+0000","last_became_peered":"2023-10-06T04:28:10.798151+0000","last_unstale":"2023-10-06T04:28:10.802894+0000","last_undegraded":"2023-10-06T04:28:10.802894+0000","last_fullsized":"2023-10-06T04:28:10.802894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:41.693487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.773597+0000","last_change":"2023-10-06T04:28:05.763239+0000","last_active":"2023-10-06T04:28:10.773597+0000","last_peered":"2023-10-06T04:28:10.773597+0000","last_clean":"2023-10-06T04:28:10.773597+0000","last_became_active":"2023-10-06T04:28:05.762943+0000","last_became_peered":"2023-10-06T04:28:05.762943+0000","last_unstale":"2023-10-06T04:28:10.773597+0000","last_undegraded":"2023-10-06T04:28:10.773597+0000","last_fullsized":"2023-10-06T04:28:10.773597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:31.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772811+0000","last_change":"2023-10-06T04:28:06.333362+0000","last_active":"2023-10-06T04:28:10.772811+0000","last_peered":"2023-10-06T04:28:10.772811+0000","last_clean":"2023-10-06T04:28:10.772811+0000","last_became_active":"2023-10-06T04:28:06.333122+0000","last_became_peered":"2023-10-06T04:28:06.333122+0000","last_unstale":"2023-10-06T04:28:10.772811+0000","last_undegraded":"2023-10-06T04:28:10.772811+0000","last_fullsized":"2023-10-06T04:28:10.772811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:14.542716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.795717+0000","last_change":"2023-10-06T04:28:10.791565+0000","last_active":"2023-10-06T04:28:10.795717+0000","last_peered":"2023-10-06T04:28:10.795717+0000","last_clean":"2023-10-06T04:28:10.795717+0000","last_became_active":"2023-10-06T04:28:10.791139+0000","last_became_peered":"2023-10-06T04:28:10.791139+0000","last_unstale":"2023-10-06T04:28:10.795717+0000","last_undegraded":"2023-10-06T04:28:10.795717+0000","last_fullsized":"2023-10-06T04:28:10.795717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:43.446834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770222+0000","last_change":"2023-10-06T04:28:05.755877+0000","last_active":"2023-10-06T04:28:10.770222+0000","last_peered":"2023-10-06T04:28:10.770222+0000","last_clean":"2023-10-06T04:28:10.770222+0000","last_became_active":"2023-10-06T04:28:05.755458+0000","last_became_peered":"2023-10-06T04:28:05.755458+0000","last_unstale":"2023-10-06T04:28:10.770222+0000","last_undegraded":"2023-10-06T04:28:10.770222+0000","last_fullsized":"2023-10-06T04:28:10.770222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:25.024995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770660+0000","last_change":"2023-10-06T04:28:06.344756+0000","last_active":"2023-10-06T04:28:10.770660+0000","last_peered":"2023-10-06T04:28:10.770660+0000","last_clean":"2023-10-06T04:28:10.770660+0000","last_became_active":"2023-10-06T04:28:06.344479+0000","last_became_peered":"2023-10-06T04:28:06.344479+0000","last_unstale":"2023-10-06T04:28:10.770660+0000","last_undegraded":"2023-10-06T04:28:10.770660+0000","last_fullsized":"2023-10-06T04:28:10.770660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:14.542716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769743+0000","last_change":"2023-10-06T04:28:06.332177+0000","last_active":"2023-10-06T04:28:10.769743+0000","last_peered":"2023-10-06T04:28:10.769743+0000","last_clean":"2023-10-06T04:28:10.769743+0000","last_became_active":"2023-10-06T04:28:06.331845+0000","last_became_peered":"2023-10-06T04:28:06.331845+0000","last_unstale":"2023-10-06T04:28:10.769743+0000","last_undegraded":"2023-10-06T04:28:10.769743+0000","last_fullsized":"2023-10-06T04:28:10.769743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:25.837873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772592+0000","last_change":"2023-10-06T04:28:06.341336+0000","last_active":"2023-10-06T04:28:10.772592+0000","last_peered":"2023-10-06T04:28:10.772592+0000","last_clean":"2023-10-06T04:28:10.772592+0000","last_became_active":"2023-10-06T04:28:06.341066+0000","last_became_peered":"2023-10-06T04:28:06.341066+0000","last_unstale":"2023-10-06T04:28:10.772592+0000","last_undegraded":"2023-10-06T04:28:10.772592+0000","last_fullsized":"2023-10-06T04:28:10.772592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:28.999532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770451+0000","last_change":"2023-10-06T04:28:06.346211+0000","last_active":"2023-10-06T04:28:10.770451+0000","last_peered":"2023-10-06T04:28:10.770451+0000","last_clean":"2023-10-06T04:28:10.770451+0000","last_became_active":"2023-10-06T04:28:06.345932+0000","last_became_peered":"2023-10-06T04:28:06.345932+0000","last_unstale":"2023-10-06T04:28:10.770451+0000","last_undegraded":"2023-10-06T04:28:10.770451+0000","last_fullsized":"2023-10-06T04:28:10.770451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:47.925435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771314+0000","last_change":"2023-10-06T04:28:06.337534+0000","last_active":"2023-10-06T04:28:10.771314+0000","last_peered":"2023-10-06T04:28:10.771314+0000","last_clean":"2023-10-06T04:28:10.771314+0000","last_became_active":"2023-10-06T04:28:06.337280+0000","last_became_peered":"2023-10-06T04:28:06.337280+0000","last_unstale":"2023-10-06T04:28:10.771314+0000","last_undegraded":"2023-10-06T04:28:10.771314+0000","last_fullsized":"2023-10-06T04:28:10.771314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:27.073025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774746+0000","last_change":"2023-10-06T04:28:06.336249+0000","last_active":"2023-10-06T04:28:10.774746+0000","last_peered":"2023-10-06T04:28:10.774746+0000","last_clean":"2023-10-06T04:28:10.774746+0000","last_became_active":"2023-10-06T04:28:06.335726+0000","last_became_peered":"2023-10-06T04:28:06.335726+0000","last_unstale":"2023-10-06T04:28:10.774746+0000","last_undegraded":"2023-10-06T04:28:10.774746+0000","last_fullsized":"2023-10-06T04:28:10.774746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:25.837873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":702778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302224,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069616,"statfs":{"total":96636764160,"available":96327286784,"internally_reserved":0,"allocated":860160,"data_stored":699826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":109034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301640,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070200,"statfs":{"total":96636764160,"available":96327884800,"internally_reserved":0,"allocated":262144,"data_stored":108480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":108570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":113228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":109104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:28:25.476 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T04:28:25.476 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T04:28:25.476 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T04:28:25.476 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T04:28:25.477 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T04:28:25.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.662+0000 7fee0bfff700 1 Processor -- start 2023-10-06T04:28:25.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.662+0000 7fee0bfff700 1 -- start start 2023-10-06T04:28:25.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.664+0000 7fee0bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fee0c140770 0x7fee0c06d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:25.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.664+0000 7fee0bfff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0c0af390 con 0x7fee0c06f2d0 2023-10-06T04:28:25.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.664+0000 7fee0bfff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0c0c6500 con 0x7fee0c140b40 2023-10-06T04:28:25.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.664+0000 7fee0bfff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0c0c67e0 con 0x7fee0c140770 2023-10-06T04:28:25.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.664+0000 7fee0affd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fee0c140770 0x7fee0c06d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:25.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.664+0000 7fee0b7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fee0c06f2d0 0x7fee0c15adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56978/0 (socket says 172.21.15.60:56978) 2023-10-06T04:28:25.667 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.664+0000 7fee0b7fe700 1 -- 172.21.15.60:0/2012335327 learned_addr learned my addr 172.21.15.60:0/2012335327 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:25.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.664+0000 7fee0affd700 1 -- 172.21.15.60:0/2012335327 >> v1:172.21.15.135:6789/0 conn(0x7fee0c140b40 legacy=0x7fee0c0aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:25.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.664+0000 7fee0affd700 1 -- 172.21.15.60:0/2012335327 >> v1:172.21.15.60:6789/0 conn(0x7fee0c06f2d0 legacy=0x7fee0c15adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:25.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.664+0000 7fee0affd700 1 -- 172.21.15.60:0/2012335327 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c0c6ac0 con 0x7fee0c140770 2023-10-06T04:28:25.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.664+0000 7fee09ffb700 1 -- 172.21.15.60:0/2012335327 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802226726 0 0) 0x7fee0c0af390 con 0x7fee0c06f2d0 2023-10-06T04:28:25.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.665+0000 7fee0affd700 1 --2- 172.21.15.60:0/2012335327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee0c140770 0x7fee0c06d210 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0098e0 tx=0x7fedfc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d491dafe15f8ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:25.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.665+0000 7fee09ffb700 1 -- 172.21.15.60:0/2012335327 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc009e80 con 0x7fee0c140770 2023-10-06T04:28:25.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.665+0000 7fee09ffb700 1 -- 172.21.15.60:0/2012335327 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc00b860 con 0x7fee0c140770 2023-10-06T04:28:25.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.665+0000 7fee09ffb700 1 -- 172.21.15.60:0/2012335327 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc00bbe0 con 0x7fee0c140770 2023-10-06T04:28:25.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.665+0000 7fee0bfff700 1 -- 172.21.15.60:0/2012335327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee0c140770 msgr2=0x7fee0c06d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:25.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.665+0000 7fee0bfff700 1 --2- 172.21.15.60:0/2012335327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee0c140770 0x7fee0c06d210 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0098e0 tx=0x7fedfc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:25.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.666+0000 7fee0bfff700 1 -- 172.21.15.60:0/2012335327 shutdown_connections 2023-10-06T04:28:25.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.666+0000 7fee0bfff700 1 --2- 172.21.15.60:0/2012335327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee0c140770 0x7fee0c06d210 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:25.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.666+0000 7fee0bfff700 1 -- 172.21.15.60:0/2012335327 >> 172.21.15.60:0/2012335327 conn(0x7fee0c068080 msgr2=0x7fee0c0cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:25.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.666+0000 7fee0bfff700 1 -- 172.21.15.60:0/2012335327 shutdown_connections 2023-10-06T04:28:25.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.666+0000 7fee0bfff700 1 -- 172.21.15.60:0/2012335327 wait complete. 2023-10-06T04:28:25.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.667+0000 7fee0bfff700 1 Processor -- start 2023-10-06T04:28:25.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.667+0000 7fee0bfff700 1 -- start start 2023-10-06T04:28:25.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.668+0000 7fee0bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee0c06f2d0 0x7fee0c0c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:25.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.668+0000 7fee0bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee0c140770 0x7fee0c158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:25.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.668+0000 7fee0bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee0c0ae130 0x7fee0c0c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:25.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.668+0000 7fee0bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c1563e0 con 0x7fee0c0ae130 2023-10-06T04:28:25.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.668+0000 7fee0bfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c158c50 con 0x7fee0c06f2d0 2023-10-06T04:28:25.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.668+0000 7fee0bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c0cada0 con 0x7fee0c140770 2023-10-06T04:28:25.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.668+0000 7fee0b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee0c0ae130 0x7fee0c0c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:25.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.668+0000 7fee0affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee0c06f2d0 0x7fee0c0c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:25.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.668+0000 7fee0b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee0c0ae130 0x7fee0c0c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51864/0 (socket says 172.21.15.60:51864) 2023-10-06T04:28:25.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.668+0000 7fee0b7fe700 1 -- 172.21.15.60:0/1167818879 learned_addr learned my addr 172.21.15.60:0/1167818879 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:25.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.668+0000 7fee0a7fc700 1 --2- 172.21.15.60:0/1167818879 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee0c140770 0x7fee0c158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:25.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.669+0000 7fee0affd700 1 -- 172.21.15.60:0/1167818879 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee0c140770 msgr2=0x7fee0c158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:25.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.669+0000 7fee0affd700 1 --2- 172.21.15.60:0/1167818879 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee0c140770 0x7fee0c158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:25.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.669+0000 7fee0affd700 1 -- 172.21.15.60:0/1167818879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee0c0ae130 msgr2=0x7fee0c0c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:25.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.669+0000 7fee0affd700 1 --2- 172.21.15.60:0/1167818879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee0c0ae130 0x7fee0c0c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:25.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.669+0000 7fee0affd700 1 -- 172.21.15.60:0/1167818879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc009420 con 0x7fee0c06f2d0 2023-10-06T04:28:25.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.669+0000 7fee0b7fe700 1 --2- 172.21.15.60:0/1167818879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee0c0ae130 0x7fee0c0c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:25.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.669+0000 7fee0affd700 1 --2- 172.21.15.60:0/1167818879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee0c06f2d0 0x7fee0c0c9a90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fedfc016000 tx=0x7fedfc017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:25.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.670+0000 7fedf2ffd700 1 -- 172.21.15.60:0/1167818879 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc01f070 con 0x7fee0c06f2d0 2023-10-06T04:28:25.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.670+0000 7fedf2ffd700 1 -- 172.21.15.60:0/1167818879 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc000c90 con 0x7fee0c06f2d0 2023-10-06T04:28:25.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.670+0000 7fee0bfff700 1 -- 172.21.15.60:0/1167818879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0c0cb230 con 0x7fee0c06f2d0 2023-10-06T04:28:25.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.670+0000 7fedf2ffd700 1 -- 172.21.15.60:0/1167818879 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc025420 con 0x7fee0c06f2d0 2023-10-06T04:28:25.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.670+0000 7fee0bfff700 1 -- 172.21.15.60:0/1167818879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0c0ca470 con 0x7fee0c06f2d0 2023-10-06T04:28:25.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.671+0000 7fee0bfff700 1 -- 172.21.15.60:0/1167818879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee0c05f230 con 0x7fee0c06f2d0 2023-10-06T04:28:25.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.672+0000 7fedf2ffd700 1 -- 172.21.15.60:0/1167818879 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fedfc023070 con 0x7fee0c06f2d0 2023-10-06T04:28:25.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.673+0000 7fedf2ffd700 1 --2- 172.21.15.60:0/1167818879 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fedf8066f30 0x7fedf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:25.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.673+0000 7fedf2ffd700 1 -- 172.21.15.60:0/1167818879 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fedfc085f80 con 0x7fee0c06f2d0 2023-10-06T04:28:25.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.673+0000 7fee0a7fc700 1 --2- 172.21.15.60:0/1167818879 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fedf8066f30 0x7fedf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:25.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.674+0000 7fee0a7fc700 1 --2- 172.21.15.60:0/1167818879 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fedf8066f30 0x7fedf80693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fee0c13e9d0 tx=0x7fee00007ec0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:25.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.677+0000 7fedf2ffd700 1 -- 172.21.15.60:0/1167818879 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fedfc052d00 con 0x7fee0c06f2d0 2023-10-06T04:28:25.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.934+0000 7fee0bfff700 1 -- 172.21.15.60:0/1167818879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fee0c0cb080 con 0x7fee0c06f2d0 2023-10-06T04:28:25.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.938+0000 7fedf2ffd700 1 -- 172.21.15.60:0/1167818879 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163698 (secure 0 0 0) 0x7fedfc015090 con 0x7fee0c06f2d0 2023-10-06T04:28:25.943 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:25.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.941+0000 7fee0bfff700 1 -- 172.21.15.60:0/1167818879 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fedf8066f30 msgr2=0x7fedf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:25.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.941+0000 7fee0bfff700 1 --2- 172.21.15.60:0/1167818879 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fedf8066f30 0x7fedf80693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fee0c13e9d0 tx=0x7fee00007ec0 comp rx=0 tx=0).stop 2023-10-06T04:28:25.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.941+0000 7fee0bfff700 1 -- 172.21.15.60:0/1167818879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee0c06f2d0 msgr2=0x7fee0c0c9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:25.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.941+0000 7fee0bfff700 1 --2- 172.21.15.60:0/1167818879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee0c06f2d0 0x7fee0c0c9a90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fedfc016000 tx=0x7fedfc017000 comp rx=0 tx=0).stop 2023-10-06T04:28:25.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.942+0000 7fee0bfff700 1 -- 172.21.15.60:0/1167818879 shutdown_connections 2023-10-06T04:28:25.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.942+0000 7fee0bfff700 1 --2- 172.21.15.60:0/1167818879 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fedf8066f30 0x7fedf80693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:25.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.942+0000 7fee0bfff700 1 --2- 172.21.15.60:0/1167818879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee0c0ae130 0x7fee0c0c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:25.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.942+0000 7fee0bfff700 1 --2- 172.21.15.60:0/1167818879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee0c06f2d0 0x7fee0c0c9a90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:25.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.942+0000 7fee0bfff700 1 --2- 172.21.15.60:0/1167818879 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fee0c140770 0x7fee0c158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:25.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.942+0000 7fee0bfff700 1 -- 172.21.15.60:0/1167818879 >> 172.21.15.60:0/1167818879 conn(0x7fee0c068080 msgr2=0x7fee0c0c1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:25.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.942+0000 7fee0bfff700 1 -- 172.21.15.60:0/1167818879 shutdown_connections 2023-10-06T04:28:25.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:25.942+0000 7fee0bfff700 1 -- 172.21.15.60:0/1167818879 wait complete. 2023-10-06T04:28:25.962 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":5,"active_gid":4098,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":85285},{"type":"v1","addr":"172.21.15.60:6833","nonce":85285}]},"active_addr":"172.21.15.60:6833/85285","active_change":"2023-10-06T04:27:53.293602+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":3842683085}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":2069013413}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":2565245112}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":367741981}]}]} 2023-10-06T04:28:25.967 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T04:28:25.967 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T04:28:25.967 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:28:26.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.153+0000 7f020b59e700 1 Processor -- start 2023-10-06T04:28:26.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.153+0000 7f020b59e700 1 -- start start 2023-10-06T04:28:26.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.154+0000 7f020b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f020c159760 0x7f020c0aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:26.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.154+0000 7f020b59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f020c06a120 0x7f020c0ab240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:26.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.154+0000 7f020b59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c0686c0 con 0x7f020c159390 2023-10-06T04:28:26.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.154+0000 7f020b59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f020c068c80 con 0x7f020c06a120 2023-10-06T04:28:26.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.154+0000 7f020b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c0ad0f0 con 0x7f020c159760 2023-10-06T04:28:26.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.154+0000 7f020ad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f020c06a120 0x7f020c0ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:26.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.154+0000 7f020a59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f020c159390 0x7f020c0ac8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56986/0 (socket says 172.21.15.60:56986) 2023-10-06T04:28:26.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.154+0000 7f020a59c700 1 -- 172.21.15.60:0/4027691179 learned_addr learned my addr 172.21.15.60:0/4027691179 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:26.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.155+0000 7f0203fff700 1 --2- 172.21.15.60:0/4027691179 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f020c159760 0x7f020c0aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:26.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.155+0000 7f020ad9d700 1 -- 172.21.15.60:0/4027691179 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f020c159760 msgr2=0x7f020c0aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:26.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.155+0000 7f020ad9d700 1 --2- 172.21.15.60:0/4027691179 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f020c159760 0x7f020c0aad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:26.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.155+0000 7f020ad9d700 1 -- 172.21.15.60:0/4027691179 >> v1:172.21.15.60:6789/0 conn(0x7f020c159390 legacy=0x7f020c0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:26.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.155+0000 7f020ad9d700 1 -- 172.21.15.60:0/4027691179 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c0ad3d0 con 0x7f020c06a120 2023-10-06T04:28:26.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.155+0000 7f0209d9b700 1 -- 172.21.15.60:0/4027691179 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428525259 0 0) 0x7f020c0686c0 con 0x7f020c159390 2023-10-06T04:28:26.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.155+0000 7f020ad9d700 1 --2- 172.21.15.60:0/4027691179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f020c06a120 0x7f020c0ab240 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0204009e60 tx=0x7f0204009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c273d9f57e225ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:26.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.155+0000 7f0209d9b700 1 -- 172.21.15.60:0/4027691179 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020400e070 con 0x7f020c06a120 2023-10-06T04:28:26.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.155+0000 7f0209d9b700 1 -- 172.21.15.60:0/4027691179 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020400bb60 con 0x7f020c06a120 2023-10-06T04:28:26.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.155+0000 7f0209d9b700 1 -- 172.21.15.60:0/4027691179 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204012430 con 0x7f020c06a120 2023-10-06T04:28:26.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.156+0000 7f020b59e700 1 -- 172.21.15.60:0/4027691179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f020c06a120 msgr2=0x7f020c0ab240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:26.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.156+0000 7f020b59e700 1 --2- 172.21.15.60:0/4027691179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f020c06a120 0x7f020c0ab240 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0204009e60 tx=0x7f0204009780 comp rx=0 tx=0).stop 2023-10-06T04:28:26.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.156+0000 7f020b59e700 1 -- 172.21.15.60:0/4027691179 shutdown_connections 2023-10-06T04:28:26.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.156+0000 7f020b59e700 1 --2- 172.21.15.60:0/4027691179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f020c06a120 0x7f020c0ab240 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:26.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.156+0000 7f020b59e700 1 --2- 172.21.15.60:0/4027691179 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f020c159760 0x7f020c0aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:26.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.156+0000 7f020b59e700 1 -- 172.21.15.60:0/4027691179 >> 172.21.15.60:0/4027691179 conn(0x7f020c097410 msgr2=0x7f020c067d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:26.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.156+0000 7f020b59e700 1 -- 172.21.15.60:0/4027691179 shutdown_connections 2023-10-06T04:28:26.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.156+0000 7f020b59e700 1 -- 172.21.15.60:0/4027691179 wait complete. 2023-10-06T04:28:26.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.158+0000 7f020b59e700 1 Processor -- start 2023-10-06T04:28:26.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.158+0000 7f020b59e700 1 -- start start 2023-10-06T04:28:26.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.159+0000 7f020b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f020c06a120 0x7f020c099850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:26.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.159+0000 7f020b59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f020c159390 0x7f020c15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:26.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.159+0000 7f020b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f020c159760 0x7f020c15b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:26.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.159+0000 7f020b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c159e60 con 0x7f020c06a120 2023-10-06T04:28:26.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.159+0000 7f020b59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c15a9e0 con 0x7f020c159390 2023-10-06T04:28:26.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.159+0000 7f020b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c15b8f0 con 0x7f020c159760 2023-10-06T04:28:26.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.159+0000 7f020a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f020c06a120 0x7f020c099850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:26.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.159+0000 7f020a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f020c06a120 0x7f020c099850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51884/0 (socket says 172.21.15.60:51884) 2023-10-06T04:28:26.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.159+0000 7f020a59c700 1 -- 172.21.15.60:0/3599844913 learned_addr learned my addr 172.21.15.60:0/3599844913 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:26.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.159+0000 7f020a59c700 1 -- 172.21.15.60:0/3599844913 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f020c159760 msgr2=0x7f020c15b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:26.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.159+0000 7f020a59c700 1 --2- 172.21.15.60:0/3599844913 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f020c159760 0x7f020c15b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.159+0000 7f020a59c700 1 -- 172.21.15.60:0/3599844913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f020c159390 msgr2=0x7f020c15ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.159+0000 7f0203fff700 1 --2- 172.21.15.60:0/3599844913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f020c159390 0x7f020c15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.159+0000 7f020a59c700 1 --2- 172.21.15.60:0/3599844913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f020c159390 0x7f020c15ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.159+0000 7f020a59c700 1 -- 172.21.15.60:0/3599844913 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0204009a20 con 0x7f020c06a120 2023-10-06T04:28:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.159+0000 7f0203fff700 1 --2- 172.21.15.60:0/3599844913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f020c159390 0x7f020c15ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.160+0000 7f020a59c700 1 --2- 172.21.15.60:0/3599844913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f020c06a120 0x7f020c099850 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00c7e0 tx=0x7f01fc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.160+0000 7f02027fc700 1 -- 172.21.15.60:0/3599844913 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc005b30 con 0x7f020c06a120 2023-10-06T04:28:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.160+0000 7f02027fc700 1 -- 172.21.15.60:0/3599844913 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc005c90 con 0x7f020c06a120 2023-10-06T04:28:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.160+0000 7f02027fc700 1 -- 172.21.15.60:0/3599844913 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc007300 con 0x7f020c06a120 2023-10-06T04:28:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.160+0000 7f020b59e700 1 -- 172.21.15.60:0/3599844913 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020c155ef0 con 0x7f020c06a120 2023-10-06T04:28:26.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.160+0000 7f020b59e700 1 -- 172.21.15.60:0/3599844913 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020c15a390 con 0x7f020c06a120 2023-10-06T04:28:26.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.161+0000 7f01ebfff700 1 -- 172.21.15.60:0/3599844913 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e40052b0 con 0x7f020c06a120 2023-10-06T04:28:26.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.162+0000 7f02027fc700 1 -- 172.21.15.60:0/3599844913 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f01fc01b400 con 0x7f020c06a120 2023-10-06T04:28:26.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.163+0000 7f02027fc700 1 --2- 172.21.15.60:0/3599844913 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f01ec066f30 0x7f01ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:26.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.163+0000 7f02027fc700 1 -- 172.21.15.60:0/3599844913 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f01fc084510 con 0x7f020c06a120 2023-10-06T04:28:26.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.163+0000 7f0203fff700 1 --2- 172.21.15.60:0/3599844913 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f01ec066f30 0x7f01ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:26.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.164+0000 7f0203fff700 1 --2- 172.21.15.60:0/3599844913 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f01ec066f30 0x7f01ec0693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f01f4006f00 tx=0x7f01f4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:26.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.167+0000 7f02027fc700 1 -- 172.21.15.60:0/3599844913 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01fc0513c0 con 0x7f020c06a120 2023-10-06T04:28:26.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.373+0000 7f01ebfff700 1 -- 172.21.15.60:0/3599844913 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01e4005560 con 0x7f020c06a120 2023-10-06T04:28:26.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.374+0000 7f02027fc700 1 -- 172.21.15.60:0/3599844913 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f01fc007730 con 0x7f020c06a120 2023-10-06T04:28:26.377 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:26.377 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:28:11.290557+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:28:04.355358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:28:05.208550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:28:08.791979+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:28:26.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.376+0000 7f01ebfff700 1 -- 172.21.15.60:0/3599844913 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f01ec066f30 msgr2=0x7f01ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:26.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.376+0000 7f01ebfff700 1 --2- 172.21.15.60:0/3599844913 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f01ec066f30 0x7f01ec0693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f01f4006f00 tx=0x7f01f4008040 comp rx=0 tx=0).stop 2023-10-06T04:28:26.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.376+0000 7f01ebfff700 1 -- 172.21.15.60:0/3599844913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f020c06a120 msgr2=0x7f020c099850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:26.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.376+0000 7f01ebfff700 1 --2- 172.21.15.60:0/3599844913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f020c06a120 0x7f020c099850 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00c7e0 tx=0x7f01fc007df0 comp rx=0 tx=0).stop 2023-10-06T04:28:26.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.376+0000 7f01ebfff700 1 -- 172.21.15.60:0/3599844913 shutdown_connections 2023-10-06T04:28:26.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.376+0000 7f01ebfff700 1 --2- 172.21.15.60:0/3599844913 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f01ec066f30 0x7f01ec0693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:26.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.376+0000 7f01ebfff700 1 --2- 172.21.15.60:0/3599844913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f020c06a120 0x7f020c099850 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:26.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.376+0000 7f01ebfff700 1 --2- 172.21.15.60:0/3599844913 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f020c159760 0x7f020c15b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:26.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.376+0000 7f01ebfff700 1 --2- 172.21.15.60:0/3599844913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f020c159390 0x7f020c15ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:26.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.376+0000 7f01ebfff700 1 -- 172.21.15.60:0/3599844913 >> 172.21.15.60:0/3599844913 conn(0x7f020c097410 msgr2=0x7f020c0abd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:26.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.377+0000 7f01ebfff700 1 -- 172.21.15.60:0/3599844913 shutdown_connections 2023-10-06T04:28:26.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.377+0000 7f01ebfff700 1 -- 172.21.15.60:0/3599844913 wait complete. 2023-10-06T04:28:26.397 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T04:28:26.397 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:28:26.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.582+0000 7f51c1f9d700 1 Processor -- start 2023-10-06T04:28:26.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.582+0000 7f51c1f9d700 1 -- start start 2023-10-06T04:28:26.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.584+0000 7f51c1f9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f51bc06a590 0x7f51bc1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.584+0000 7f51c1f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51bc06e660 0x7f51bc153c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.584+0000 7f51c1f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51bc0c9cc0 con 0x7f51bc06a960 2023-10-06T04:28:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.584+0000 7f51c1f9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc06f560 con 0x7f51bc06a590 2023-10-06T04:28:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.584+0000 7f51c1f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc06eac0 con 0x7f51bc06e660 2023-10-06T04:28:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.584+0000 7f51c0f9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f51bc06a590 0x7f51bc1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.584+0000 7f51c0f9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f51bc06a590 0x7f51bc1536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51900/0 (socket says 172.21.15.60:51900) 2023-10-06T04:28:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.584+0000 7f51c0f9b700 1 -- 172.21.15.60:0/4269608588 learned_addr learned my addr 172.21.15.60:0/4269608588 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.584+0000 7f51c0f9b700 1 -- 172.21.15.60:0/4269608588 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51bc06e660 msgr2=0x7f51bc153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.584+0000 7f51c179c700 1 --2- 172.21.15.60:0/4269608588 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51bc06e660 0x7f51bc153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.584+0000 7f51c0f9b700 1 --2- 172.21.15.60:0/4269608588 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51bc06e660 0x7f51bc153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.584+0000 7f51c0f9b700 1 -- 172.21.15.60:0/4269608588 >> v1:172.21.15.135:6789/0 conn(0x7f51bc06a960 legacy=0x7f51bc06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.585+0000 7f51c0f9b700 1 -- 172.21.15.60:0/4269608588 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc0c6710 con 0x7f51bc06a590 2023-10-06T04:28:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.585+0000 7f51c179c700 1 --2- 172.21.15.60:0/4269608588 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51bc06e660 0x7f51bc153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:26.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.585+0000 7f51c0f9b700 1 --2- 172.21.15.60:0/4269608588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51bc06a590 0x7f51bc1536f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f51b00099e0 tx=0x7f51b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f062036da686e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:26.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.585+0000 7f51bb7fe700 1 -- 172.21.15.60:0/4269608588 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b000b820 con 0x7f51bc06a590 2023-10-06T04:28:26.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.585+0000 7f51bb7fe700 1 -- 172.21.15.60:0/4269608588 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b000b980 con 0x7f51bc06a590 2023-10-06T04:28:26.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.585+0000 7f51bb7fe700 1 -- 172.21.15.60:0/4269608588 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b000bd20 con 0x7f51bc06a590 2023-10-06T04:28:26.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.586+0000 7f51c1f9d700 1 -- 172.21.15.60:0/4269608588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51bc06a590 msgr2=0x7f51bc1536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:26.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.586+0000 7f51c1f9d700 1 --2- 172.21.15.60:0/4269608588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51bc06a590 0x7f51bc1536f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f51b00099e0 tx=0x7f51b0009250 comp rx=0 tx=0).stop 2023-10-06T04:28:26.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.586+0000 7f51c1f9d700 1 -- 172.21.15.60:0/4269608588 shutdown_connections 2023-10-06T04:28:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.586+0000 7f51c1f9d700 1 --2- 172.21.15.60:0/4269608588 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51bc06e660 0x7f51bc153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.586+0000 7f51c1f9d700 1 --2- 172.21.15.60:0/4269608588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51bc06a590 0x7f51bc1536f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.586+0000 7f51c1f9d700 1 -- 172.21.15.60:0/4269608588 >> 172.21.15.60:0/4269608588 conn(0x7f51bc068080 msgr2=0x7f51bc0cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.586+0000 7f51c1f9d700 1 -- 172.21.15.60:0/4269608588 shutdown_connections 2023-10-06T04:28:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.586+0000 7f51c1f9d700 1 -- 172.21.15.60:0/4269608588 wait complete. 2023-10-06T04:28:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.587+0000 7f51c1f9d700 1 Processor -- start 2023-10-06T04:28:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.587+0000 7f51c1f9d700 1 -- start start 2023-10-06T04:28:26.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.588+0000 7f51c1f9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51bc06a590 0x7f51bc0c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:26.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.588+0000 7f51c1f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51bc06a960 0x7f51bc16a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:26.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.588+0000 7f51c1f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51bc06e660 0x7f51bc16a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:26.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.588+0000 7f51c1f9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc16dde0 con 0x7f51bc06a590 2023-10-06T04:28:26.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.588+0000 7f51c1f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc0c5f40 con 0x7f51bc06a960 2023-10-06T04:28:26.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.588+0000 7f51c1f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc16d440 con 0x7f51bc06e660 2023-10-06T04:28:26.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.588+0000 7f51c0f9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51bc06a590 0x7f51bc0c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:26.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.588+0000 7f51c0f9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51bc06a590 0x7f51bc0c54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51914/0 (socket says 172.21.15.60:51914) 2023-10-06T04:28:26.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.588+0000 7f51c0f9b700 1 -- 172.21.15.60:0/3779570339 learned_addr learned my addr 172.21.15.60:0/3779570339 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:26.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.589+0000 7f51c179c700 1 --2- 172.21.15.60:0/3779570339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51bc06e660 0x7f51bc16a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:26.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.589+0000 7f51bbfff700 1 --2- 172.21.15.60:0/3779570339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51bc06a960 0x7f51bc16a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:26.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.589+0000 7f51c0f9b700 1 -- 172.21.15.60:0/3779570339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51bc06e660 msgr2=0x7f51bc16a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:26.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.589+0000 7f51c0f9b700 1 --2- 172.21.15.60:0/3779570339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51bc06e660 0x7f51bc16a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:26.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.589+0000 7f51c0f9b700 1 -- 172.21.15.60:0/3779570339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51bc06a960 msgr2=0x7f51bc16a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:26.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.589+0000 7f51c0f9b700 1 --2- 172.21.15.60:0/3779570339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51bc06a960 0x7f51bc16a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:26.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.589+0000 7f51c0f9b700 1 -- 172.21.15.60:0/3779570339 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b00094f0 con 0x7f51bc06a590 2023-10-06T04:28:26.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.589+0000 7f51bbfff700 1 --2- 172.21.15.60:0/3779570339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51bc06a960 0x7f51bc16a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:26.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.589+0000 7f51c0f9b700 1 --2- 172.21.15.60:0/3779570339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51bc06a590 0x7f51bc0c54f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009290 tx=0x7f51b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:26.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.589+0000 7f51b8ff9700 1 -- 172.21.15.60:0/3779570339 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b0011e90 con 0x7f51bc06a590 2023-10-06T04:28:26.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.589+0000 7f51b8ff9700 1 -- 172.21.15.60:0/3779570339 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b001a420 con 0x7f51bc06a590 2023-10-06T04:28:26.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.589+0000 7f51b8ff9700 1 -- 172.21.15.60:0/3779570339 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b001a7e0 con 0x7f51bc06a590 2023-10-06T04:28:26.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.589+0000 7f51c1f9d700 1 -- 172.21.15.60:0/3779570339 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51bc16d720 con 0x7f51bc06a590 2023-10-06T04:28:26.602 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.590+0000 7f51c1f9d700 1 -- 172.21.15.60:0/3779570339 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51bc0c5a30 con 0x7f51bc06a590 2023-10-06T04:28:26.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.590+0000 7f51c1f9d700 1 -- 172.21.15.60:0/3779570339 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51bc05f230 con 0x7f51bc06a590 2023-10-06T04:28:26.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.591+0000 7f51b8ff9700 1 -- 172.21.15.60:0/3779570339 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51b001ab50 con 0x7f51bc06a590 2023-10-06T04:28:26.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.592+0000 7f51b8ff9700 1 --2- 172.21.15.60:0/3779570339 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f51a0066f30 0x7f51a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:26.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.592+0000 7f51b8ff9700 1 -- 172.21.15.60:0/3779570339 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f51b00864b0 con 0x7f51bc06a590 2023-10-06T04:28:26.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.592+0000 7f51bbfff700 1 --2- 172.21.15.60:0/3779570339 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f51a0066f30 0x7f51a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:26.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.593+0000 7f51bbfff700 1 --2- 172.21.15.60:0/3779570339 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f51a0066f30 0x7f51a00693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f51a8007fd0 tx=0x7f51a8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:26.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.596+0000 7f51b8ff9700 1 -- 172.21.15.60:0/3779570339 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51b0053230 con 0x7f51bc06a590 2023-10-06T04:28:26.810 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.808+0000 7f51c1f9d700 1 -- 172.21.15.60:0/3779570339 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51bc0c7f40 con 0x7f51bc06a590 2023-10-06T04:28:26.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.809+0000 7f51b8ff9700 1 -- 172.21.15.60:0/3779570339 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f51b0056850 con 0x7f51bc06a590 2023-10-06T04:28:26.812 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:26.812 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:28:11.290557+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:28:04.355358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:28:05.208550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:28:08.791979+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:28:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.811+0000 7f51c1f9d700 1 -- 172.21.15.60:0/3779570339 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f51a0066f30 msgr2=0x7f51a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.811+0000 7f51c1f9d700 1 --2- 172.21.15.60:0/3779570339 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f51a0066f30 0x7f51a00693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f51a8007fd0 tx=0x7f51a8009040 comp rx=0 tx=0).stop 2023-10-06T04:28:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.811+0000 7f51c1f9d700 1 -- 172.21.15.60:0/3779570339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51bc06a590 msgr2=0x7f51bc0c54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.811+0000 7f51c1f9d700 1 --2- 172.21.15.60:0/3779570339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51bc06a590 0x7f51bc0c54f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009290 tx=0x7f51b0017000 comp rx=0 tx=0).stop 2023-10-06T04:28:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.811+0000 7f51c1f9d700 1 -- 172.21.15.60:0/3779570339 shutdown_connections 2023-10-06T04:28:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.811+0000 7f51c1f9d700 1 --2- 172.21.15.60:0/3779570339 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f51a0066f30 0x7f51a00693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.811+0000 7f51c1f9d700 1 --2- 172.21.15.60:0/3779570339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51bc06a590 0x7f51bc0c54f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.811+0000 7f51c1f9d700 1 --2- 172.21.15.60:0/3779570339 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f51bc06e660 0x7f51bc16a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.811+0000 7f51c1f9d700 1 --2- 172.21.15.60:0/3779570339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51bc06a960 0x7f51bc16a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.811+0000 7f51c1f9d700 1 -- 172.21.15.60:0/3779570339 >> 172.21.15.60:0/3779570339 conn(0x7f51bc068080 msgr2=0x7f51bc155e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.811+0000 7f51c1f9d700 1 -- 172.21.15.60:0/3779570339 shutdown_connections 2023-10-06T04:28:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:26.811+0000 7f51c1f9d700 1 -- 172.21.15.60:0/3779570339 wait complete. 2023-10-06T04:28:26.831 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T04:28:26.832 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T04:28:26.832 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T04:28:26.833 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T04:28:26.833 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T04:28:26.833 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T04:28:26.834 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T04:28:26.834 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T04:28:27.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.166+0000 7f780339d700 1 Processor -- start 2023-10-06T04:28:27.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.166+0000 7f780339d700 1 -- start start 2023-10-06T04:28:27.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.167+0000 7f91e63ff700 1 Processor -- start 2023-10-06T04:28:27.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.167+0000 7f91e63ff700 1 -- start start 2023-10-06T04:28:27.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.168+0000 7fc7979ff700 1 Processor -- start 2023-10-06T04:28:27.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.168+0000 7fc7979ff700 1 -- start start 2023-10-06T04:28:27.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.169+0000 7f91e63ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d8033970 0x7f91d8033d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.169+0000 7f91e63ff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d8054880 con 0x7f91d804fce0 2023-10-06T04:28:27.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.169+0000 7f91e63ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d8053c70 con 0x7f91d80e61a0 2023-10-06T04:28:27.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.169+0000 7f91e63ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d8053a70 con 0x7f91d8033970 2023-10-06T04:28:27.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.170+0000 7f91e499c700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f91d80e61a0 0x7f91d80e65d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.60:56014/0 (socket says 172.21.15.60:56014) 2023-10-06T04:28:27.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.170+0000 7f91e499c700 1 -- 172.21.15.60:0/1089733639 learned_addr learned my addr 172.21.15.60:0/1089733639 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:27.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.168+0000 7f780339d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f77fc0ca4a0 0x7f77fc0872c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.168+0000 7f780339d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77fc087800 0x7f77fc0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.168+0000 7f780339d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77fc069230 con 0x7f77fc166170 2023-10-06T04:28:27.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.168+0000 7f780339d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77fc166540 con 0x7f77fc0ca4a0 2023-10-06T04:28:27.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.168+0000 7f780339d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc087ca0 con 0x7f77fc087800 2023-10-06T04:28:27.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.169+0000 7f7801b9a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f77fc0ca4a0 0x7f77fc0872c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.169+0000 7f7801b9a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f77fc0ca4a0 0x7f77fc0872c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51930/0 (socket says 172.21.15.60:51930) 2023-10-06T04:28:27.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.169+0000 7f7801b9a700 1 -- 172.21.15.60:0/2393443570 learned_addr learned my addr 172.21.15.60:0/2393443570 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.170+0000 7f7801b9a700 1 -- 172.21.15.60:0/2393443570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77fc087800 msgr2=0x7f77fc0699a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:28:27.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.170+0000 7f7801b9a700 1 --2- 172.21.15.60:0/2393443570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77fc087800 0x7f77fc0699a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.170+0000 7f7801b9a700 1 -- 172.21.15.60:0/2393443570 >> v1:172.21.15.135:6789/0 conn(0x7f77fc166170 legacy=0x7f77fc0c6500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:28:27.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.170+0000 7f7801b9a700 1 -- 172.21.15.60:0/2393443570 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc069510 con 0x7f77fc0ca4a0 2023-10-06T04:28:27.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.170+0000 7f7801b9a700 1 --2- 172.21.15.60:0/2393443570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77fc0ca4a0 0x7f77fc0872c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f77f400b1f0 tx=0x7f77f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2aa11eeac62ff3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.170+0000 7fc7979ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc7880e6630 0x7fc788006130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.171+0000 7f7801399700 1 -- 172.21.15.60:0/2393443570 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f400bd50 con 0x7f77fc0ca4a0 2023-10-06T04:28:27.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.170+0000 7f91deffd700 1 -- 172.21.15.60:0/1089733639 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391869896 0 0) 0x7f91d8053c70 con 0x7f91d80e61a0 2023-10-06T04:28:27.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.171+0000 7f91deffd700 1 -- 172.21.15.60:0/1089733639 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91d0003570 con 0x7f91d80e61a0 2023-10-06T04:28:27.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.171+0000 7f91dffff700 1 --2- 172.21.15.60:0/1089733639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d8033970 0x7f91d8033d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.171+0000 7f91deffd700 1 -- 172.21.15.60:0/1089733639 <== mon.1 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2689534834 0 0) 0x7f91d0003570 con 0x7f91d80e61a0 2023-10-06T04:28:27.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.171+0000 7f91deffd700 1 -- 172.21.15.60:0/1089733639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d8033970 msgr2=0x7f91d8033d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:27.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.171+0000 7f91deffd700 1 --2- 172.21.15.60:0/1089733639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d8033970 0x7f91d8033d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.171+0000 7f91deffd700 1 -- 172.21.15.60:0/1089733639 >> v1:172.21.15.60:6789/0 conn(0x7f91d804fce0 legacy=0x7f91d8050150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:28:27.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.171+0000 7f7801399700 1 -- 172.21.15.60:0/2393443570 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f401f070 con 0x7f77fc0ca4a0 2023-10-06T04:28:27.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.171+0000 7fc7979ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7880374b0 0x7fc788006670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.171+0000 7fc7979ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc788006bb0 con 0x7fc7880370e0 2023-10-06T04:28:27.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.171+0000 7fc7979ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc788006e80 con 0x7fc7880e6630 2023-10-06T04:28:27.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.172+0000 7f91deffd700 1 -- 172.21.15.60:0/1089733639 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d8053f50 con 0x7f91d80e61a0 2023-10-06T04:28:27.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.171+0000 7fc7979ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc788007160 con 0x7fc7880374b0 2023-10-06T04:28:27.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.171+0000 7fc795f9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7880374b0 0x7fc788006670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.171+0000 7fc794f9a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc7880e6630 0x7fc788006130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.172+0000 7fc794f9a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc7880e6630 0x7fc788006130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:58674/0 (socket says 172.21.15.60:58674) 2023-10-06T04:28:27.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.172+0000 7fc794f9a700 1 -- 172.21.15.60:0/2416136708 learned_addr learned my addr 172.21.15.60:0/2416136708 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.172+0000 7fc795f9c700 1 -- 172.21.15.60:0/2416136708 >> v2:172.21.15.135:3300/0 conn(0x7fc7880e6630 msgr2=0x7fc788006130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:27.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.172+0000 7f91deffd700 1 -- 172.21.15.60:0/1089733639 <== mon.1 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7f91e004c960 con 0x7f91d80e61a0 2023-10-06T04:28:27.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.172+0000 7f91deffd700 1 -- 172.21.15.60:0/1089733639 >> v1:172.21.15.135:6789/0 conn(0x7f91d80e61a0 legacy=0x7f91d80e65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.172+0000 7fc795f9c700 1 --2- 172.21.15.60:0/2416136708 >> v2:172.21.15.135:3300/0 conn(0x7fc7880e6630 0x7fc788006130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.172+0000 7fc795f9c700 1 -- 172.21.15.60:0/2416136708 >> v1:172.21.15.135:6789/0 conn(0x7fc7880370e0 legacy=0x7fc7880e5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:27.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.173+0000 7f780339d700 1 -- 172.21.15.60:0/2393443570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77fc0ca4a0 msgr2=0x7f77fc0872c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.173+0000 7f780339d700 1 --2- 172.21.15.60:0/2393443570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77fc0ca4a0 0x7f77fc0872c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f77f400b1f0 tx=0x7f77f4009840 comp rx=0 tx=0).stop 2023-10-06T04:28:27.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.172+0000 7f91deffd700 1 --2- 172.21.15.60:0/1089733639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d8033970 0x7f91d0003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.172+0000 7f91deffd700 1 --2- 172.21.15.60:0/1089733639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91d0004110 0x7f91d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.172+0000 7f91deffd700 1 --2- 172.21.15.60:0/1089733639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d0004d50 0x7f91d00051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.172+0000 7f91deffd700 1 -- 172.21.15.60:0/1089733639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d8053a70 con 0x7f91d0004110 2023-10-06T04:28:27.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.172+0000 7f91deffd700 1 -- 172.21.15.60:0/1089733639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d000bcc0 con 0x7f91d0004d50 2023-10-06T04:28:27.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.172+0000 7f91deffd700 1 -- 172.21.15.60:0/1089733639 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d000be80 con 0x7f91d8033970 2023-10-06T04:28:27.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.172+0000 7fc795f9c700 1 -- 172.21.15.60:0/2416136708 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc788007440 con 0x7fc7880374b0 2023-10-06T04:28:27.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.172+0000 7fc794f9a700 1 --2- 172.21.15.60:0/2416136708 >> v2:172.21.15.135:3300/0 conn(0x7fc7880e6630 0x7fc788006130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:27.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.173+0000 7f780339d700 1 -- 172.21.15.60:0/2393443570 shutdown_connections 2023-10-06T04:28:27.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.173+0000 7f780339d700 1 --2- 172.21.15.60:0/2393443570 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77fc087800 0x7f77fc0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.173+0000 7f780339d700 1 --2- 172.21.15.60:0/2393443570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77fc0ca4a0 0x7f77fc0872c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.173+0000 7f780339d700 1 -- 172.21.15.60:0/2393443570 >> 172.21.15.60:0/2393443570 conn(0x7f77fc068080 msgr2=0x7f77fc0cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.173+0000 7fc795f9c700 1 --2- 172.21.15.60:0/2416136708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7880374b0 0x7fc788006670 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc7900614b0 tx=0x7fc790066c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c40d80b394c6266 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.173+0000 7fc787fff700 1 -- 172.21.15.60:0/2416136708 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc790065da0 con 0x7fc7880374b0 2023-10-06T04:28:27.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.173+0000 7f91e499c700 1 --2- 172.21.15.60:0/1089733639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d0004d50 0x7f91d00051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.173+0000 7f91e499c700 1 -- 172.21.15.60:0/1089733639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d8033970 msgr2=0x7f91d0003ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:28:27.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.173+0000 7fc787fff700 1 -- 172.21.15.60:0/2416136708 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7900631f0 con 0x7fc7880374b0 2023-10-06T04:28:27.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.173+0000 7fc787fff700 1 -- 172.21.15.60:0/2416136708 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc790065da0 con 0x7fc7880374b0 2023-10-06T04:28:27.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.174+0000 7f780339d700 1 -- 172.21.15.60:0/2393443570 shutdown_connections 2023-10-06T04:28:27.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.173+0000 7f91e499c700 1 --2- 172.21.15.60:0/1089733639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d8033970 0x7f91d0003ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.173+0000 7f91e499c700 1 -- 172.21.15.60:0/1089733639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91d0004110 msgr2=0x7f91d0004810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:28:27.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.174+0000 7fc7979ff700 1 -- 172.21.15.60:0/2416136708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7880374b0 msgr2=0x7fc788006670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.174+0000 7fc7979ff700 1 --2- 172.21.15.60:0/2416136708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7880374b0 0x7fc788006670 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc7900614b0 tx=0x7fc790066c40 comp rx=0 tx=0).stop 2023-10-06T04:28:27.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.175+0000 7fc7979ff700 1 -- 172.21.15.60:0/2416136708 shutdown_connections 2023-10-06T04:28:27.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.175+0000 7fc7979ff700 1 --2- 172.21.15.60:0/2416136708 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7880374b0 0x7fc788006670 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.173+0000 7f91e499c700 1 --2- 172.21.15.60:0/1089733639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91d0004110 0x7f91d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.173+0000 7f91e499c700 1 -- 172.21.15.60:0/1089733639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d0003570 con 0x7f91d0004d50 2023-10-06T04:28:27.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.174+0000 7f91e499c700 1 --2- 172.21.15.60:0/1089733639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d0004d50 0x7f91d00051a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f91e005f1c0 tx=0x7f91e0067350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eda03ccbaf717b34 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.174+0000 7f91deffd700 1 -- 172.21.15.60:0/1089733639 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0064f70 con 0x7f91d0004d50 2023-10-06T04:28:27.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.174+0000 7f91deffd700 1 -- 172.21.15.60:0/1089733639 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e008b070 con 0x7f91d0004d50 2023-10-06T04:28:27.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.175+0000 7fc7979ff700 1 --2- 172.21.15.60:0/2416136708 >> v2:172.21.15.135:3300/0 conn(0x7fc7880e6630 0x7fc788006130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.175+0000 7f91e63ff700 1 -- 172.21.15.60:0/1089733639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d0004d50 msgr2=0x7f91d00051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.175+0000 7fc7979ff700 1 -- 172.21.15.60:0/2416136708 >> 172.21.15.60:0/2416136708 conn(0x7fc7880518a0 msgr2=0x7fc788051ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.175+0000 7f91e63ff700 1 --2- 172.21.15.60:0/1089733639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d0004d50 0x7f91d00051a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f91e005f1c0 tx=0x7f91e0067350 comp rx=0 tx=0).stop 2023-10-06T04:28:27.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.175+0000 7f91e499c700 1 -- 172.21.15.60:0/1089733639 reap_dead start 2023-10-06T04:28:27.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.175+0000 7f91e63ff700 1 -- 172.21.15.60:0/1089733639 shutdown_connections 2023-10-06T04:28:27.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.176+0000 7fb9e1b9d700 1 Processor -- start 2023-10-06T04:28:27.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.176+0000 7fc7979ff700 1 -- 172.21.15.60:0/2416136708 shutdown_connections 2023-10-06T04:28:27.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.176+0000 7fc7979ff700 1 -- 172.21.15.60:0/2416136708 wait complete. 2023-10-06T04:28:27.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.175+0000 7f91e63ff700 1 -- 172.21.15.60:0/1089733639 >> 172.21.15.60:0/1089733639 conn(0x7f91d8051700 msgr2=0x7f91d8051b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.176+0000 7fb9e1b9d700 1 -- start start 2023-10-06T04:28:27.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.174+0000 7f780339d700 1 -- 172.21.15.60:0/2393443570 wait complete. 2023-10-06T04:28:27.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.176+0000 7f780339d700 1 Processor -- start 2023-10-06T04:28:27.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.176+0000 7f780339d700 1 -- start start 2023-10-06T04:28:27.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.177+0000 7f91e63ff700 1 -- 172.21.15.60:0/1089733639 shutdown_connections 2023-10-06T04:28:27.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.178+0000 7f780339d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77fc087800 0x7f77fc086f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.178+0000 7fc7979ff700 1 Processor -- start 2023-10-06T04:28:27.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.178+0000 7f427a9ff700 1 Processor -- start 2023-10-06T04:28:27.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.179+0000 7fc7979ff700 1 -- start start 2023-10-06T04:28:27.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.179+0000 7f780239b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77fc087800 0x7f77fc086f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.179+0000 7f780239b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77fc087800 0x7f77fc086f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51938/0 (socket says 172.21.15.60:51938) 2023-10-06T04:28:27.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.179+0000 7f780239b700 1 -- 172.21.15.60:0/3288658034 learned_addr learned my addr 172.21.15.60:0/3288658034 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.180+0000 7f780339d700 1 --2- 172.21.15.60:0/3288658034 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77fc0ca4a0 0x7f77fc0b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.180+0000 7f780339d700 1 --2- 172.21.15.60:0/3288658034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77fc166170 0x7f77fc0ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.180+0000 7f7801b9a700 1 --2- 172.21.15.60:0/3288658034 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77fc0ca4a0 0x7f77fc0b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.181+0000 7fc7979ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7880374b0 0x7fc7880d46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.179+0000 7f427a9ff700 1 -- start start 2023-10-06T04:28:27.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.181+0000 7f427a9ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f42740bf320 0x7f42740c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.181+0000 7fc7979ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7880e6630 0x7fc78804bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.181+0000 7fc79579b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7880374b0 0x7fc7880d46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.181+0000 7fc79579b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7880374b0 0x7fc7880d46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:37398/0 (socket says 172.21.15.60:37398) 2023-10-06T04:28:27.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.181+0000 7f427a9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42740bf6f0 0x7f4274069520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.181+0000 7f4273fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f42740bf320 0x7f42740c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.181+0000 7fc79579b700 1 -- 172.21.15.60:0/141215315 learned_addr learned my addr 172.21.15.60:0/141215315 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.181+0000 7f4273fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f42740bf320 0x7f42740c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:58682/0 (socket says 172.21.15.60:58682) 2023-10-06T04:28:27.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7fc794f9a700 1 --2- 172.21.15.60:0/141215315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7880e6630 0x7fc78804bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7f4273fff700 1 -- 172.21.15.60:0/3892588983 learned_addr learned my addr 172.21.15.60:0/3892588983 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7fc7979ff700 1 --2- 172.21.15.60:0/141215315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7880c8870 0x7fc788051c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.177+0000 7f91e63ff700 1 -- 172.21.15.60:0/1089733639 wait complete. 2023-10-06T04:28:27.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7fc7979ff700 1 -- 172.21.15.60:0/141215315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7880e3e00 con 0x7fc7880c8870 2023-10-06T04:28:27.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7fc7979ff700 1 -- 172.21.15.60:0/141215315 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7880d4f00 con 0x7fc7880e6630 2023-10-06T04:28:27.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7fc7979ff700 1 -- 172.21.15.60:0/141215315 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78804c5e0 con 0x7fc7880374b0 2023-10-06T04:28:27.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.180+0000 7f780339d700 1 -- 172.21.15.60:0/3288658034 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc0afc00 con 0x7f77fc087800 2023-10-06T04:28:27.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.180+0000 7f780339d700 1 -- 172.21.15.60:0/3288658034 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc0b0f30 con 0x7f77fc166170 2023-10-06T04:28:27.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.178+0000 7fb9e1b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb9dc1551a0 0x7fb9dc06e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.178+0000 7fb9e1b9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb9dc159ce0 0x7fb9dc06ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.178+0000 7fb9e1b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9dc0c6710 0x7fb9dc0c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.178+0000 7fb9e1b9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9dc06f5b0 con 0x7fb9dc159ce0 2023-10-06T04:28:27.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.178+0000 7fb9e1b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9dc06d210 con 0x7fb9dc1551a0 2023-10-06T04:28:27.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.178+0000 7fb9e1b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc0c70b0 con 0x7fb9dc0c6710 2023-10-06T04:28:27.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.180+0000 7f780339d700 1 -- 172.21.15.60:0/3288658034 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc0b0600 con 0x7f77fc0ca4a0 2023-10-06T04:28:27.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.181+0000 7f780239b700 1 -- 172.21.15.60:0/3288658034 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77fc0ca4a0 msgr2=0x7f77fc0b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.181+0000 7f780239b700 1 --2- 172.21.15.60:0/3288658034 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f77fc0ca4a0 0x7f77fc0b13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.178+0000 7fb9dbfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb9dc159ce0 0x7fb9dc06ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.178+0000 7fb9dbfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb9dc159ce0 0x7fb9dc06ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51952/0 (socket says 172.21.15.60:51952) 2023-10-06T04:28:27.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.181+0000 7f780239b700 1 -- 172.21.15.60:0/3288658034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77fc166170 msgr2=0x7f77fc0ad0a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:28:27.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.181+0000 7f780239b700 1 --2- 172.21.15.60:0/3288658034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77fc166170 0x7f77fc0ad0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.181+0000 7f780239b700 1 -- 172.21.15.60:0/3288658034 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f4009ae0 con 0x7f77fc087800 2023-10-06T04:28:27.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7f780239b700 1 --2- 172.21.15.60:0/3288658034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77fc087800 0x7f77fc086f70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f77f800b810 tx=0x7f77f80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.179+0000 7f91e63ff700 1 Processor -- start 2023-10-06T04:28:27.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7f427a9ff700 1 --2- 172.21.15.60:0/3892588983 >> v2:172.21.15.60:3300/0 conn(0x7f4274069a60 0x7f42740c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7f427a9ff700 1 -- 172.21.15.60:0/3892588983 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4274069f00 con 0x7f4274069a60 2023-10-06T04:28:27.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7f427a9ff700 1 -- 172.21.15.60:0/3892588983 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427415e190 con 0x7f42740bf320 2023-10-06T04:28:27.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.183+0000 7fc79579b700 1 -- 172.21.15.60:0/141215315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7880e6630 msgr2=0x7fc78804bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.183+0000 7fc79579b700 1 --2- 172.21.15.60:0/141215315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7880e6630 0x7fc78804bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.183+0000 7fc79579b700 1 -- 172.21.15.60:0/141215315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7880c8870 msgr2=0x7fc788051c70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:28:27.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7f427a9ff700 1 -- 172.21.15.60:0/3892588983 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42740c7fc0 con 0x7f42740bf6f0 2023-10-06T04:28:27.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7f42737fe700 1 --2- 172.21.15.60:0/3892588983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42740bf6f0 0x7f4274069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.183+0000 7f4278f9c700 1 --2- 172.21.15.60:0/3892588983 >> v2:172.21.15.60:3300/0 conn(0x7f4274069a60 0x7f42740c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.178+0000 7fb9dbfff700 1 -- 172.21.15.60:0/196177874 learned_addr learned my addr 172.21.15.60:0/196177874 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.183+0000 7f42737fe700 1 -- 172.21.15.60:0/3892588983 >> v2:172.21.15.135:3300/0 conn(0x7f42740bf320 msgr2=0x7f42740c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.179+0000 7fb9e139c700 1 --2- 172.21.15.60:0/196177874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9dc0c6710 0x7fb9dc0c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.179+0000 7fb9dbfff700 1 -- 172.21.15.60:0/196177874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9dc0c6710 msgr2=0x7fb9dc0c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.179+0000 7fb9dbfff700 1 --2- 172.21.15.60:0/196177874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9dc0c6710 0x7fb9dc0c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.180+0000 7fb9dbfff700 1 -- 172.21.15.60:0/196177874 >> v2:172.21.15.135:3300/0 conn(0x7fb9dc1551a0 msgr2=0x7fb9dc06e200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:28:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.180+0000 7fb9dbfff700 1 --2- 172.21.15.60:0/196177874 >> v2:172.21.15.135:3300/0 conn(0x7fb9dc1551a0 0x7fb9dc06e200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.183+0000 7fc79579b700 1 --2- 172.21.15.60:0/141215315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7880c8870 0x7fc788051c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.183+0000 7fc79579b700 1 -- 172.21.15.60:0/141215315 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79004c960 con 0x7fc7880374b0 2023-10-06T04:28:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.180+0000 7fb9dbfff700 1 -- 172.21.15.60:0/196177874 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc06d440 con 0x7fb9dc159ce0 2023-10-06T04:28:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.180+0000 7fb9dbfff700 1 --2- 172.21.15.60:0/196177874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9dc159ce0 0x7fb9dc06ecb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc068ec0 tx=0x7fb9d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1fbc4f48898d6b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.181+0000 7fb9db7fe700 1 -- 172.21.15.60:0/196177874 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d000b7d0 con 0x7fb9dc159ce0 2023-10-06T04:28:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.181+0000 7fb9db7fe700 1 -- 172.21.15.60:0/196177874 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d000b930 con 0x7fb9dc159ce0 2023-10-06T04:28:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.181+0000 7fb9db7fe700 1 -- 172.21.15.60:0/196177874 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d000bcd0 con 0x7fb9dc159ce0 2023-10-06T04:28:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7fb9e1b9d700 1 -- 172.21.15.60:0/196177874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9dc159ce0 msgr2=0x7fb9dc06ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7fb9e1b9d700 1 --2- 172.21.15.60:0/196177874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9dc159ce0 0x7fb9dc06ecb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc068ec0 tx=0x7fb9d0009250 comp rx=0 tx=0).stop 2023-10-06T04:28:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.183+0000 7f42737fe700 1 --2- 172.21.15.60:0/3892588983 >> v2:172.21.15.135:3300/0 conn(0x7f42740bf320 0x7f42740c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.184+0000 7f77f27fc700 1 -- 172.21.15.60:0/3288658034 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f800f400 con 0x7f77fc087800 2023-10-06T04:28:27.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.183+0000 7f42737fe700 1 -- 172.21.15.60:0/3892588983 >> v2:172.21.15.60:3300/0 conn(0x7f4274069a60 msgr2=0x7f42740c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:27.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.184+0000 7fc79579b700 1 --2- 172.21.15.60:0/141215315 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7880374b0 0x7fc7880d46e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc78000c610 tx=0x7fc780007ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.184+0000 7fc7857fa700 1 -- 172.21.15.60:0/141215315 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc780011590 con 0x7fc7880374b0 2023-10-06T04:28:27.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.179+0000 7f91e63ff700 1 -- start start 2023-10-06T04:28:27.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.181+0000 7f91e63ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d0004d50 0x7f91d8039f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.181+0000 7f91e63ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91d804e280 0x7f91d80e6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.181+0000 7f91e63ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d80e7920 0x7f91d80dc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7f91e63ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d8039ab0 con 0x7f91d804e280 2023-10-06T04:28:27.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7f91e63ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d804e9f0 con 0x7f91d80e7920 2023-10-06T04:28:27.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.184+0000 7f42737fe700 1 --2- 172.21.15.60:0/3892588983 >> v2:172.21.15.60:3300/0 conn(0x7f4274069a60 0x7f42740c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.184+0000 7f42737fe700 1 -- 172.21.15.60:0/3892588983 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42740c73b0 con 0x7f42740bf6f0 2023-10-06T04:28:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.184+0000 7f4278f9c700 1 --2- 172.21.15.60:0/3892588983 >> v2:172.21.15.60:3300/0 conn(0x7f4274069a60 0x7f42740c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7fb9e1b9d700 1 -- 172.21.15.60:0/196177874 shutdown_connections 2023-10-06T04:28:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7fb9e1b9d700 1 --2- 172.21.15.60:0/196177874 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9dc0c6710 0x7fb9dc0c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7fb9e1b9d700 1 --2- 172.21.15.60:0/196177874 >> v2:172.21.15.135:3300/0 conn(0x7fb9dc1551a0 0x7fb9dc06e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7fb9e1b9d700 1 --2- 172.21.15.60:0/196177874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9dc159ce0 0x7fb9dc06ecb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.183+0000 7fb9e1b9d700 1 -- 172.21.15.60:0/196177874 >> 172.21.15.60:0/196177874 conn(0x7fb9dc068080 msgr2=0x7fb9dc0cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.183+0000 7fb9e1b9d700 1 -- 172.21.15.60:0/196177874 shutdown_connections 2023-10-06T04:28:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.183+0000 7fb9e1b9d700 1 -- 172.21.15.60:0/196177874 wait complete. 2023-10-06T04:28:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.185+0000 7f42737fe700 1 --2- 172.21.15.60:0/3892588983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42740bf6f0 0x7f4274069520 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f427406ce60 tx=0x7f426c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86b6fe3e9504e32 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.185+0000 7f4272ffd700 1 -- 172.21.15.60:0/3892588983 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c00e070 con 0x7f42740bf6f0 2023-10-06T04:28:27.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.184+0000 7fc7979ff700 1 -- 172.21.15.60:0/141215315 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78804c8c0 con 0x7fc7880374b0 2023-10-06T04:28:27.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.184+0000 7fc7979ff700 1 -- 172.21.15.60:0/141215315 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7880c8d10 con 0x7fc7880374b0 2023-10-06T04:28:27.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.186+0000 7fc7857fa700 1 -- 172.21.15.60:0/141215315 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7800116f0 con 0x7fc7880374b0 2023-10-06T04:28:27.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.186+0000 7fc7857fa700 1 -- 172.21.15.60:0/141215315 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc780011a90 con 0x7fc7880374b0 2023-10-06T04:28:27.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.184+0000 7f780339d700 1 -- 172.21.15.60:0/3288658034 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77fc0b08e0 con 0x7f77fc087800 2023-10-06T04:28:27.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.184+0000 7f780339d700 1 -- 172.21.15.60:0/3288658034 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77fc0874b0 con 0x7f77fc087800 2023-10-06T04:28:27.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.185+0000 7f77f27fc700 1 -- 172.21.15.60:0/3288658034 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f800f560 con 0x7f77fc087800 2023-10-06T04:28:27.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.185+0000 7f77f27fc700 1 -- 172.21.15.60:0/3288658034 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f800f920 con 0x7f77fc087800 2023-10-06T04:28:27.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.185+0000 7f4272ffd700 1 -- 172.21.15.60:0/3892588983 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c00bbf0 con 0x7f42740bf6f0 2023-10-06T04:28:27.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.185+0000 7f4272ffd700 1 -- 172.21.15.60:0/3892588983 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c012430 con 0x7f42740bf6f0 2023-10-06T04:28:27.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.186+0000 7fc7979ff700 1 -- 172.21.15.60:0/141215315 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc788005530 con 0x7fc7880374b0 2023-10-06T04:28:27.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7f91e63ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d804e710 con 0x7f91d0004d50 2023-10-06T04:28:27.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7f91e499c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d80e7920 0x7f91d80dc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7f91e499c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d80e7920 0x7f91d80dc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:58698/0 (socket says 172.21.15.60:58698) 2023-10-06T04:28:27.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.182+0000 7f91e499c700 1 -- 172.21.15.60:0/2392562582 learned_addr learned my addr 172.21.15.60:0/2392562582 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.183+0000 7f91df7fe700 1 --2- 172.21.15.60:0/2392562582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91d804e280 0x7f91d80e6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.183+0000 7f91e499c700 1 -- 172.21.15.60:0/2392562582 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d0004d50 msgr2=0x7f91d8039f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:28:27.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.183+0000 7f91dffff700 1 --2- 172.21.15.60:0/2392562582 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d0004d50 0x7f91d8039f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.183+0000 7f91e499c700 1 --2- 172.21.15.60:0/2392562582 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f91d0004d50 0x7f91d8039f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.183+0000 7f91e499c700 1 -- 172.21.15.60:0/2392562582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91d804e280 msgr2=0x7f91d80e6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.183+0000 7f91e499c700 1 --2- 172.21.15.60:0/2392562582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91d804e280 0x7f91d80e6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.184+0000 7f91e499c700 1 -- 172.21.15.60:0/2392562582 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d8039460 con 0x7f91d80e7920 2023-10-06T04:28:27.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.184+0000 7f91df7fe700 1 --2- 172.21.15.60:0/2392562582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91d804e280 0x7f91d80e6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:27.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.184+0000 7f91e499c700 1 --2- 172.21.15.60:0/2392562582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d80e7920 0x7f91d80dc4b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f91e0065a40 tx=0x7f91e0069000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.184+0000 7f91cbfff700 1 -- 172.21.15.60:0/2392562582 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0098070 con 0x7f91d80e7920 2023-10-06T04:28:27.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.187+0000 7f427a9ff700 1 -- 172.21.15.60:0/3892588983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42740bf6f0 msgr2=0x7f4274069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.187+0000 7f427a9ff700 1 --2- 172.21.15.60:0/3892588983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42740bf6f0 0x7f4274069520 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f427406ce60 tx=0x7f426c009780 comp rx=0 tx=0).stop 2023-10-06T04:28:27.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.184+0000 7f91cbfff700 1 -- 172.21.15.60:0/2392562582 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e0067da0 con 0x7f91d80e7920 2023-10-06T04:28:27.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.184+0000 7f91cbfff700 1 -- 172.21.15.60:0/2392562582 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0063660 con 0x7f91d80e7920 2023-10-06T04:28:27.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.186+0000 7f91e63ff700 1 -- 172.21.15.60:0/2392562582 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d8039740 con 0x7f91d80e7920 2023-10-06T04:28:27.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.186+0000 7f91e63ff700 1 -- 172.21.15.60:0/2392562582 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d80e76c0 con 0x7f91d80e7920 2023-10-06T04:28:27.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.187+0000 7f91c9ffb700 1 -- 172.21.15.60:0/2392562582 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f91d8005390 con 0x7f91d80e7920 2023-10-06T04:28:27.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.188+0000 7f427a9ff700 1 -- 172.21.15.60:0/3892588983 shutdown_connections 2023-10-06T04:28:27.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.188+0000 7f427a9ff700 1 --2- 172.21.15.60:0/3892588983 >> v2:172.21.15.60:3300/0 conn(0x7f4274069a60 0x7f42740c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.188+0000 7f427a9ff700 1 --2- 172.21.15.60:0/3892588983 >> v2:172.21.15.135:3300/0 conn(0x7f42740bf320 0x7f42740c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.187+0000 7fece03ff700 1 Processor -- start 2023-10-06T04:28:27.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.188+0000 7fece03ff700 1 -- start start 2023-10-06T04:28:27.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.188+0000 7f427a9ff700 1 --2- 172.21.15.60:0/3892588983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42740bf6f0 0x7f4274069520 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.188+0000 7f427a9ff700 1 -- 172.21.15.60:0/3892588983 >> 172.21.15.60:0/3892588983 conn(0x7f4274068080 msgr2=0x7f42740cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.188+0000 7f780339d700 1 -- 172.21.15.60:0/3288658034 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f77e4000fd0 con 0x7f77fc087800 2023-10-06T04:28:27.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.188+0000 7fc7857fa700 1 -- 172.21.15.60:0/141215315 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc78001c460 con 0x7fc7880374b0 2023-10-06T04:28:27.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.188+0000 7f427a9ff700 1 -- 172.21.15.60:0/3892588983 shutdown_connections 2023-10-06T04:28:27.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.188+0000 7f427a9ff700 1 -- 172.21.15.60:0/3892588983 wait complete. 2023-10-06T04:28:27.223 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.190+0000 7f77f27fc700 1 -- 172.21.15.60:0/3288658034 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77f800fcd0 con 0x7f77fc087800 2023-10-06T04:28:27.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.190+0000 7fc7857fa700 1 --2- 172.21.15.60:0/141215315 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc774067080 0x7fc774069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.190+0000 7f427a9ff700 1 Processor -- start 2023-10-06T04:28:27.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.191+0000 7fc7857fa700 1 -- 172.21.15.60:0/141215315 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc7800845e0 con 0x7fc7880374b0 2023-10-06T04:28:27.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.186+0000 7fb9e1b9d700 1 Processor -- start 2023-10-06T04:28:27.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.186+0000 7fb9e1b9d700 1 -- start start 2023-10-06T04:28:27.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.191+0000 7f427a9ff700 1 -- start start 2023-10-06T04:28:27.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.190+0000 7fece03ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fecd8069ab0 0x7fecd80ada60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.190+0000 7fece03ff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd806e6d0 con 0x7fecd80696e0 2023-10-06T04:28:27.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.190+0000 7fece03ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd806dac0 con 0x7fecd806d350 2023-10-06T04:28:27.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.190+0000 7fece03ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd80cd000 con 0x7fecd8069ab0 2023-10-06T04:28:27.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.190+0000 7fecdd99a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fecd8069ab0 0x7fecd80ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.190+0000 7fecdd99a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fecd8069ab0 0x7fecd80ada60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:58724/0 (socket says 172.21.15.60:58724) 2023-10-06T04:28:27.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.190+0000 7fecdd99a700 1 -- 172.21.15.60:0/832689293 learned_addr learned my addr 172.21.15.60:0/832689293 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.191+0000 7fecdd99a700 1 -- 172.21.15.60:0/832689293 >> v1:172.21.15.135:6789/0 conn(0x7fecd806d350 legacy=0x7fecd806eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:27.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.191+0000 7fecdd99a700 1 -- 172.21.15.60:0/832689293 >> v1:172.21.15.60:6789/0 conn(0x7fecd80696e0 legacy=0x7fecd80aeeb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:28:27.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.191+0000 7fc7857fa700 1 --2- 172.21.15.60:0/141215315 >> [v2:172.21.15.60:6808/85568,v1:172.21.15.60:6809/85568] conn(0x7fc774070d50 0x7fc774073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.191+0000 7fc7857fa700 1 -- 172.21.15.60:0/141215315 --> [v2:172.21.15.60:6808/85568,v1:172.21.15.60:6809/85568] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc774073850 con 0x7fc774070d50 2023-10-06T04:28:27.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.191+0000 7fc7857fa700 1 -- 172.21.15.60:0/141215315 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc780086ac0 con 0x7fc7880374b0 2023-10-06T04:28:27.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.189+0000 7fb9e1b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9dc0c6710 0x7fb9dc157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.228 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.189+0000 7fb9e1b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9dc1551a0 0x7fb9dc157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.191+0000 7fecdd99a700 1 -- 172.21.15.60:0/832689293 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd806dda0 con 0x7fecd8069ab0 2023-10-06T04:28:27.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.191+0000 7fc794f9a700 1 --2- 172.21.15.60:0/141215315 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc774067080 0x7fc774069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.189+0000 7fb9e1b9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9dc159ce0 0x7fb9dc156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.190+0000 7fb9e139c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9dc159ce0 0x7fb9dc156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.190+0000 7fb9e139c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9dc159ce0 0x7fb9dc156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51996/0 (socket says 172.21.15.60:51996) 2023-10-06T04:28:27.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.190+0000 7fb9dbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9dc1551a0 0x7fb9dc157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.190+0000 7fb9e139c700 1 -- 172.21.15.60:0/3250498458 learned_addr learned my addr 172.21.15.60:0/3250498458 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.190+0000 7fb9e1b9d700 1 -- 172.21.15.60:0/3250498458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc0c3f40 con 0x7fb9dc159ce0 2023-10-06T04:28:27.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.192+0000 7fecdd99a700 1 --2- 172.21.15.60:0/832689293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecd8069ab0 0x7fecd80ada60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009f20 tx=0x7fecd0009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68e2834c3aab8bcc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.190+0000 7fb9e1b9d700 1 -- 172.21.15.60:0/3250498458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc1251f0 con 0x7fb9dc1551a0 2023-10-06T04:28:27.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.190+0000 7fb9e1b9d700 1 -- 172.21.15.60:0/3250498458 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc156ff0 con 0x7fb9dc0c6710 2023-10-06T04:28:27.231 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.191+0000 7fb9dbfff700 1 -- 172.21.15.60:0/3250498458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9dc0c6710 msgr2=0x7fb9dc157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.191+0000 7fb9dbfff700 1 --2- 172.21.15.60:0/3250498458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9dc0c6710 0x7fb9dc157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.191+0000 7fb9dbfff700 1 -- 172.21.15.60:0/3250498458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9dc159ce0 msgr2=0x7fb9dc156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.191+0000 7fb9dbfff700 1 --2- 172.21.15.60:0/3250498458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9dc159ce0 0x7fb9dc156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.191+0000 7fb9dbfff700 1 -- 172.21.15.60:0/3250498458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d00094f0 con 0x7fb9dc1551a0 2023-10-06T04:28:27.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.191+0000 7fb9e139c700 1 --2- 172.21.15.60:0/3250498458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9dc159ce0 0x7fb9dc156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:27.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.191+0000 7fb9dbfff700 1 --2- 172.21.15.60:0/3250498458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9dc1551a0 0x7fb9dc157ed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc06cc20 tx=0x7fb9d0017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.232 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.190+0000 7f91cbfff700 1 -- 172.21.15.60:0/2392562582 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f91e00b8b80 con 0x7f91d80e7920 2023-10-06T04:28:27.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.192+0000 7f427a9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4274069a60 0x7f4274157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.233 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.192+0000 7fc795f9c700 1 --2- 172.21.15.60:0/141215315 >> [v2:172.21.15.60:6808/85568,v1:172.21.15.60:6809/85568] conn(0x7fc774070d50 0x7fc774073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.192+0000 7f427a9ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42740bf320 0x7f427416e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.193+0000 7fb9d8ff9700 1 -- 172.21.15.60:0/3250498458 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0011e90 con 0x7fb9dc1551a0 2023-10-06T04:28:27.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.193+0000 7fb9d8ff9700 1 -- 172.21.15.60:0/3250498458 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d001a450 con 0x7fb9dc1551a0 2023-10-06T04:28:27.234 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.192+0000 7f91cbfff700 1 --2- 172.21.15.60:0/2392562582 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f91c4067080 0x7f91c4069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.193+0000 7f91cbfff700 1 -- 172.21.15.60:0/2392562582 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f91e00fbe00 con 0x7f91d80e7920 2023-10-06T04:28:27.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.193+0000 7fb9d8ff9700 1 -- 172.21.15.60:0/3250498458 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d001a7f0 con 0x7fb9dc1551a0 2023-10-06T04:28:27.235 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.193+0000 7f4273fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4274069a60 0x7f4274157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.193+0000 7fb9e1b9d700 1 -- 172.21.15.60:0/3250498458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9dc0c4190 con 0x7fb9dc1551a0 2023-10-06T04:28:27.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.193+0000 7fb9e1b9d700 1 -- 172.21.15.60:0/3250498458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc0c4750 con 0x7fb9dc1551a0 2023-10-06T04:28:27.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.193+0000 7f91dffff700 1 --2- 172.21.15.60:0/2392562582 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f91c4067080 0x7f91c4069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.193+0000 7f91cbfff700 1 --2- 172.21.15.60:0/2392562582 >> [v2:172.21.15.60:6816/85570,v1:172.21.15.60:6817/85570] conn(0x7f91c4070d50 0x7f91c4073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.193+0000 7f91cbfff700 1 -- 172.21.15.60:0/2392562582 --> [v2:172.21.15.60:6816/85570,v1:172.21.15.60:6817/85570] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91c4073850 con 0x7f91c4070d50 2023-10-06T04:28:27.236 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.193+0000 7f91cbfff700 1 -- 172.21.15.60:0/2392562582 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91e00fc130 con 0x7f91d80e7920 2023-10-06T04:28:27.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.193+0000 7fecdd199700 1 -- 172.21.15.60:0/832689293 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd000e070 con 0x7fecd8069ab0 2023-10-06T04:28:27.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.193+0000 7fecdd199700 1 -- 172.21.15.60:0/832689293 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd000ba00 con 0x7fecd8069ab0 2023-10-06T04:28:27.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.193+0000 7fecdd199700 1 -- 172.21.15.60:0/832689293 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd00092e0 con 0x7fecd8069ab0 2023-10-06T04:28:27.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.193+0000 7f4273fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4274069a60 0x7f4274157dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:58728/0 (socket says 172.21.15.60:58728) 2023-10-06T04:28:27.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.194+0000 7f427a9ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42740bf6f0 0x7f42741543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.237 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.194+0000 7f427a9ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42740c1470 con 0x7f42740bf6f0 2023-10-06T04:28:27.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.194+0000 7f427a9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42740c1a30 con 0x7f4274069a60 2023-10-06T04:28:27.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.194+0000 7f427a9ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4274158300 con 0x7f42740bf320 2023-10-06T04:28:27.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.194+0000 7fece03ff700 1 -- 172.21.15.60:0/832689293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecd8069ab0 msgr2=0x7fecd80ada60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.194+0000 7fece03ff700 1 --2- 172.21.15.60:0/832689293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecd8069ab0 0x7fecd80ada60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009f20 tx=0x7fecd0009840 comp rx=0 tx=0).stop 2023-10-06T04:28:27.238 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.194+0000 7fb9e1b9d700 1 -- 172.21.15.60:0/3250498458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb9dc05f230 con 0x7fb9dc1551a0 2023-10-06T04:28:27.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.194+0000 7f91df7fe700 1 --2- 172.21.15.60:0/2392562582 >> [v2:172.21.15.60:6816/85570,v1:172.21.15.60:6817/85570] conn(0x7f91c4070d50 0x7f91c4073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.194+0000 7fece03ff700 1 -- 172.21.15.60:0/832689293 shutdown_connections 2023-10-06T04:28:27.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.194+0000 7fece03ff700 1 --2- 172.21.15.60:0/832689293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecd8069ab0 0x7fecd80ada60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.194+0000 7fece03ff700 1 -- 172.21.15.60:0/832689293 >> 172.21.15.60:0/832689293 conn(0x7fecd8068080 msgr2=0x7fecd80cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.194+0000 7f42737fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42740bf320 0x7f427416e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.194+0000 7f42737fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42740bf320 0x7f427416e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:37440/0 (socket says 172.21.15.60:37440) 2023-10-06T04:28:27.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.194+0000 7f42737fe700 1 -- 172.21.15.60:0/2922495841 learned_addr learned my addr 172.21.15.60:0/2922495841 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.194+0000 7fece03ff700 1 -- 172.21.15.60:0/832689293 shutdown_connections 2023-10-06T04:28:27.240 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.195+0000 7fece03ff700 1 -- 172.21.15.60:0/832689293 wait complete. 2023-10-06T04:28:27.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.195+0000 7f91df7fe700 1 --2- 172.21.15.60:0/2392562582 >> [v2:172.21.15.60:6816/85570,v1:172.21.15.60:6817/85570] conn(0x7f91c4070d50 0x7f91c4073180 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.193+0000 7fc794f9a700 1 --2- 172.21.15.60:0/141215315 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc774067080 0x7fc774069530 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc7880f5a00 tx=0x7fc78c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.195+0000 7fc795f9c700 1 --2- 172.21.15.60:0/141215315 >> [v2:172.21.15.60:6808/85568,v1:172.21.15.60:6809/85568] conn(0x7fc774070d50 0x7fc774073180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.194+0000 7f77f27fc700 1 --2- 172.21.15.60:0/3288658034 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f77e00670b0 0x7f77e0069560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.195+0000 7f77f27fc700 1 -- 172.21.15.60:0/3288658034 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f77f8084650 con 0x7f77fc087800 2023-10-06T04:28:27.241 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.195+0000 7f7801b9a700 1 --2- 172.21.15.60:0/3288658034 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f77e00670b0 0x7f77e0069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.195+0000 7f91dffff700 1 --2- 172.21.15.60:0/2392562582 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f91c4067080 0x7f91c4069530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f91d804d910 tx=0x7f91cc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.196+0000 7f91cbfff700 1 -- 172.21.15.60:0/2392562582 <== osd.2 v2:172.21.15.60:6816/85570 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f91c4073850 con 0x7f91c4070d50 2023-10-06T04:28:27.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.195+0000 7f42737fe700 1 -- 172.21.15.60:0/2922495841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4274069a60 msgr2=0x7f4274157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.195+0000 7f42737fe700 1 --2- 172.21.15.60:0/2922495841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4274069a60 0x7f4274157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.196+0000 7f42737fe700 1 -- 172.21.15.60:0/2922495841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42740bf6f0 msgr2=0x7f42741543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.196+0000 7f42737fe700 1 --2- 172.21.15.60:0/2922495841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42740bf6f0 0x7f42741543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.196+0000 7f42737fe700 1 -- 172.21.15.60:0/2922495841 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c009a20 con 0x7f42740bf320 2023-10-06T04:28:27.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.196+0000 7f77f27fc700 1 --2- 172.21.15.60:0/3288658034 >> [v2:172.21.15.60:6800/85567,v1:172.21.15.60:6801/85567] conn(0x7f77e0070d80 0x7f77e00731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.196+0000 7f77f27fc700 1 -- 172.21.15.60:0/3288658034 --> [v2:172.21.15.60:6800/85567,v1:172.21.15.60:6801/85567] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77e0073880 con 0x7f77e0070d80 2023-10-06T04:28:27.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.196+0000 7f77f27fc700 1 -- 172.21.15.60:0/3288658034 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77f8086bf0 con 0x7f77fc087800 2023-10-06T04:28:27.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.196+0000 7f7801b9a700 1 --2- 172.21.15.60:0/3288658034 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f77e00670b0 0x7f77e0069560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f77f400b1f0 tx=0x7f77f4028000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.197+0000 7fc7857fa700 1 -- 172.21.15.60:0/141215315 <== osd.0 v2:172.21.15.60:6808/85568 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc774073850 con 0x7fc774070d50 2023-10-06T04:28:27.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.197+0000 7f42737fe700 1 --2- 172.21.15.60:0/2922495841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42740bf320 0x7f427416e2a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f42740c8100 tx=0x7f426c019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.197+0000 7f7802b9c700 1 --2- 172.21.15.60:0/3288658034 >> [v2:172.21.15.60:6800/85567,v1:172.21.15.60:6801/85567] conn(0x7f77e0070d80 0x7f77e00731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.197+0000 7fece03ff700 1 Processor -- start 2023-10-06T04:28:27.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.197+0000 7fece03ff700 1 -- start start 2023-10-06T04:28:27.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.197+0000 7f425bfff700 1 -- 172.21.15.60:0/2922495841 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c012c50 con 0x7f42740bf320 2023-10-06T04:28:27.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.198+0000 7f425bfff700 1 -- 172.21.15.60:0/2922495841 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c021070 con 0x7f42740bf320 2023-10-06T04:28:27.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.198+0000 7f427a9ff700 1 -- 172.21.15.60:0/2922495841 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4274158580 con 0x7f42740bf320 2023-10-06T04:28:27.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.198+0000 7f427a9ff700 1 -- 172.21.15.60:0/2922495841 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42740c16c0 con 0x7f42740bf320 2023-10-06T04:28:27.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.197+0000 7fb9d8ff9700 1 -- 172.21.15.60:0/3250498458 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb9d001ac20 con 0x7fb9dc1551a0 2023-10-06T04:28:27.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.199+0000 7fb9d8ff9700 1 --2- 172.21.15.60:0/3250498458 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb9c8067080 0x7fb9c8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.199+0000 7fb9d8ff9700 1 -- 172.21.15.60:0/3250498458 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb9d0086d40 con 0x7fb9dc1551a0 2023-10-06T04:28:27.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.199+0000 7f7802b9c700 1 --2- 172.21.15.60:0/3288658034 >> [v2:172.21.15.60:6800/85567,v1:172.21.15.60:6801/85567] conn(0x7f77e0070d80 0x7f77e00731b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.199+0000 7fb9d8ff9700 1 --2- 172.21.15.60:0/3250498458 >> [v2:172.21.15.60:6821/85599,v1:172.21.15.60:6823/85599] conn(0x7fb9c8070be0 0x7fb9c8073010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.198+0000 7fece03ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecd80696e0 0x7fecd8158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.198+0000 7fece03ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fecd8069ab0 0x7fecd8158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.198+0000 7fece03ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecd806d350 0x7fecd815e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.198+0000 7fece03ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd816ab70 con 0x7fecd80696e0 2023-10-06T04:28:27.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.198+0000 7fece03ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd816a240 con 0x7fecd806d350 2023-10-06T04:28:27.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.198+0000 7fece03ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd816a520 con 0x7fecd8069ab0 2023-10-06T04:28:27.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.199+0000 7fecde19b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecd80696e0 0x7fecd8158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.199+0000 7fecdd99a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fecd8069ab0 0x7fecd8158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.199+0000 7fecdd99a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fecd8069ab0 0x7fecd8158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:37454/0 (socket says 172.21.15.60:37454) 2023-10-06T04:28:27.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.199+0000 7fecdd99a700 1 -- 172.21.15.60:0/3801076358 learned_addr learned my addr 172.21.15.60:0/3801076358 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.199+0000 7fecde99c700 1 --2- 172.21.15.60:0/3801076358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecd806d350 0x7fecd815e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.200+0000 7fecdd99a700 1 -- 172.21.15.60:0/3801076358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecd806d350 msgr2=0x7fecd815e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.200+0000 7fecdd99a700 1 --2- 172.21.15.60:0/3801076358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecd806d350 0x7fecd815e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.200+0000 7fecdd99a700 1 -- 172.21.15.60:0/3801076358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecd80696e0 msgr2=0x7fecd8158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.200+0000 7fecdd99a700 1 --2- 172.21.15.60:0/3801076358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecd80696e0 0x7fecd8158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.200+0000 7fecdd99a700 1 -- 172.21.15.60:0/3801076358 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd0009ae0 con 0x7fecd8069ab0 2023-10-06T04:28:27.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.200+0000 7fecde99c700 1 --2- 172.21.15.60:0/3801076358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecd806d350 0x7fecd815e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:27.249 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.200+0000 7fecde19b700 1 --2- 172.21.15.60:0/3801076358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecd80696e0 0x7fecd8158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:27.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.201+0000 7f77f27fc700 1 -- 172.21.15.60:0/3288658034 <== osd.1 v2:172.21.15.60:6800/85567 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f77e0073880 con 0x7f77e0070d80 2023-10-06T04:28:27.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.200+0000 7fa7501ff700 1 Processor -- start 2023-10-06T04:28:27.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.201+0000 7fa7501ff700 1 -- start start 2023-10-06T04:28:27.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.200+0000 7fb9e0b9b700 1 --2- 172.21.15.60:0/3250498458 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb9c8067080 0x7fb9c8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.200+0000 7fb9e139c700 1 --2- 172.21.15.60:0/3250498458 >> [v2:172.21.15.60:6821/85599,v1:172.21.15.60:6823/85599] conn(0x7fb9c8070be0 0x7fb9c8073010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.201+0000 7fb9e139c700 1 --2- 172.21.15.60:0/3250498458 >> [v2:172.21.15.60:6821/85599,v1:172.21.15.60:6823/85599] conn(0x7fb9c8070be0 0x7fb9c8073010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.201+0000 7fb9e0b9b700 1 --2- 172.21.15.60:0/3250498458 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb9c8067080 0x7fb9c8069530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0097c0 tx=0x7fb9cc006ce0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.201+0000 7fb9d8ff9700 1 -- 172.21.15.60:0/3250498458 --> [v2:172.21.15.60:6821/85599,v1:172.21.15.60:6823/85599] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb9c80736e0 con 0x7fb9c8070be0 2023-10-06T04:28:27.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.201+0000 7f427a9ff700 1 -- 172.21.15.60:0/2922495841 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4274064a90 con 0x7f42740bf320 2023-10-06T04:28:27.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.202+0000 7f425bfff700 1 -- 172.21.15.60:0/2922495841 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c026430 con 0x7f42740bf320 2023-10-06T04:28:27.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.202+0000 7f425bfff700 1 -- 172.21.15.60:0/2922495841 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f426c023030 con 0x7f42740bf320 2023-10-06T04:28:27.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.202+0000 7fecdd99a700 1 --2- 172.21.15.60:0/3801076358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fecd8069ab0 0x7fecd8158860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fecd806fd70 tx=0x7fecd0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.202+0000 7fa7501ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa7480b1de0 0x7fa7480b0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.202+0000 7fa7501ff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa7480b0c50 0x7fa7480b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.203+0000 7fa7501ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7480b35c0 con 0x7fa7480cc7e0 2023-10-06T04:28:27.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.203+0000 7fa7501ff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7480b10d0 con 0x7fa7480b0c50 2023-10-06T04:28:27.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.203+0000 7fa7501ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7480b13b0 con 0x7fa7480b1de0 2023-10-06T04:28:27.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.202+0000 7fb9d8ff9700 1 -- 172.21.15.60:0/3250498458 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9d0087070 con 0x7fb9dc1551a0 2023-10-06T04:28:27.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.203+0000 7fb9d8ff9700 1 -- 172.21.15.60:0/3250498458 <== osd.3 v2:172.21.15.60:6821/85599 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb9c80736e0 con 0x7fb9c8070be0 2023-10-06T04:28:27.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.203+0000 7fecce7fc700 1 -- 172.21.15.60:0/3801076358 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd00094e0 con 0x7fecd8069ab0 2023-10-06T04:28:27.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.203+0000 7fecce7fc700 1 -- 172.21.15.60:0/3801076358 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd0012b30 con 0x7fecd8069ab0 2023-10-06T04:28:27.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.203+0000 7fa74e79c700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fa7480cc7e0 0x7fa7480b3a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.60:56036/0 (socket says 172.21.15.60:56036) 2023-10-06T04:28:27.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.203+0000 7fecce7fc700 1 -- 172.21.15.60:0/3801076358 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd001e430 con 0x7fecd8069ab0 2023-10-06T04:28:27.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.203+0000 7fece03ff700 1 -- 172.21.15.60:0/3801076358 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd816a800 con 0x7fecd8069ab0 2023-10-06T04:28:27.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.203+0000 7fece03ff700 1 -- 172.21.15.60:0/3801076358 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd81571d0 con 0x7fecd8069ab0 2023-10-06T04:28:27.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.203+0000 7fa74e79c700 1 -- 172.21.15.60:0/204468137 learned_addr learned my addr 172.21.15.60:0/204468137 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:27.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.203+0000 7fa74d79a700 1 --2- 172.21.15.60:0/204468137 >> v2:172.21.15.60:3300/0 conn(0x7fa7480b0c50 0x7fa7480b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.204+0000 7fa74cf99700 1 -- 172.21.15.60:0/204468137 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877272881 0 0) 0x7fa7480b35c0 con 0x7fa7480cc7e0 2023-10-06T04:28:27.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.204+0000 7f425bfff700 1 --2- 172.21.15.60:0/2922495841 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4260067000 0x7f42600694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.204+0000 7f425bfff700 1 -- 172.21.15.60:0/2922495841 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f426c0868a0 con 0x7f42740bf320 2023-10-06T04:28:27.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.203+0000 7fcaaa3ff700 1 Processor -- start 2023-10-06T04:28:27.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.203+0000 7fcaaa3ff700 1 -- start start 2023-10-06T04:28:27.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.204+0000 7fa74df9b700 1 --2- 172.21.15.60:0/204468137 >> v2:172.21.15.135:3300/0 conn(0x7fa7480b1de0 0x7fa7480b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.204+0000 7fa74cf99700 1 -- 172.21.15.60:0/204468137 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa738003570 con 0x7fa7480cc7e0 2023-10-06T04:28:27.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.204+0000 7fa74d79a700 1 -- 172.21.15.60:0/204468137 >> v2:172.21.15.135:3300/0 conn(0x7fa7480b1de0 msgr2=0x7fa7480b0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:27.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.204+0000 7fa74d79a700 1 --2- 172.21.15.60:0/204468137 >> v2:172.21.15.135:3300/0 conn(0x7fa7480b1de0 0x7fa7480b0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.204+0000 7fa74d79a700 1 -- 172.21.15.60:0/204468137 >> v1:172.21.15.135:6789/0 conn(0x7fa7480cc7e0 legacy=0x7fa7480b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.204+0000 7fa74d79a700 1 -- 172.21.15.60:0/204468137 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7480b1690 con 0x7fa7480b0c50 2023-10-06T04:28:27.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.205+0000 7f425bfff700 1 --2- 172.21.15.60:0/2922495841 >> [v2:172.21.15.135:6816/85815,v1:172.21.15.135:6817/85815] conn(0x7f4260070b60 0x7f4260072f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.205+0000 7fa74d79a700 1 --2- 172.21.15.60:0/204468137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7480b0c50 0x7fa7480b21b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa7480890c0 tx=0x7fa7340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f40aa26ffe9ece server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.205+0000 7f425bfff700 1 -- 172.21.15.60:0/2922495841 --> [v2:172.21.15.135:6816/85815,v1:172.21.15.135:6817/85815] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4260073660 con 0x7f4260070b60 2023-10-06T04:28:27.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.205+0000 7f425bfff700 1 -- 172.21.15.60:0/2922495841 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f426c08b240 con 0x7f42740bf320 2023-10-06T04:28:27.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.205+0000 7fa74cf99700 1 -- 172.21.15.60:0/204468137 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734011630 con 0x7fa7480b0c50 2023-10-06T04:28:27.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.206+0000 7fa74cf99700 1 -- 172.21.15.60:0/204468137 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa734011790 con 0x7fa7480b0c50 2023-10-06T04:28:27.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.206+0000 7fa74cf99700 1 -- 172.21.15.60:0/204468137 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734011b30 con 0x7fa7480b0c50 2023-10-06T04:28:27.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.206+0000 7fecbbfff700 1 -- 172.21.15.60:0/3801076358 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fecd8157450 con 0x7fecd8069ab0 2023-10-06T04:28:27.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.206+0000 7f4278f9c700 1 --2- 172.21.15.60:0/2922495841 >> [v2:172.21.15.135:6816/85815,v1:172.21.15.135:6817/85815] conn(0x7f4260070b60 0x7f4260072f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.207+0000 7f4273fff700 1 --2- 172.21.15.60:0/2922495841 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4260067000 0x7f42600694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.205+0000 7fcaaa3ff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcaa4156760 0x7fcaa4069520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.205+0000 7fcaaa3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa4069a60 0x7fcaa40add90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.206+0000 7fcaaa3ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa4069ec0 con 0x7fcaa406b540 2023-10-06T04:28:27.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.206+0000 7fcaaa3ff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa406e320 con 0x7fcaa4156760 2023-10-06T04:28:27.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.206+0000 7fcaaa3ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa41536f0 con 0x7fcaa4069a60 2023-10-06T04:28:27.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.206+0000 7fcaa899c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa4069a60 0x7fcaa40add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.206+0000 7fcaa899c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa4069a60 0x7fcaa40add90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:37470/0 (socket says 172.21.15.60:37470) 2023-10-06T04:28:27.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.206+0000 7fcaa899c700 1 -- 172.21.15.60:0/2180110853 learned_addr learned my addr 172.21.15.60:0/2180110853 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.207+0000 7fcaa37fe700 1 --2- 172.21.15.60:0/2180110853 >> v2:172.21.15.60:3300/0 conn(0x7fcaa4156760 0x7fcaa4069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.207+0000 7fcaa899c700 1 -- 172.21.15.60:0/2180110853 >> v2:172.21.15.60:3300/0 conn(0x7fcaa4156760 msgr2=0x7fcaa4069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:27.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.207+0000 7fa7501ff700 1 -- 172.21.15.60:0/204468137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7480b0c50 msgr2=0x7fa7480b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.207+0000 7fa7501ff700 1 --2- 172.21.15.60:0/204468137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7480b0c50 0x7fa7480b21b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa7480890c0 tx=0x7fa7340091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.207+0000 7fcaa899c700 1 --2- 172.21.15.60:0/2180110853 >> v2:172.21.15.60:3300/0 conn(0x7fcaa4156760 0x7fcaa4069520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.207+0000 7fcaa899c700 1 -- 172.21.15.60:0/2180110853 >> v1:172.21.15.135:6789/0 conn(0x7fcaa406b540 legacy=0x7fcaa4152fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:28:27.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.207+0000 7fcaa899c700 1 -- 172.21.15.60:0/2180110853 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa406d710 con 0x7fcaa4069a60 2023-10-06T04:28:27.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.207+0000 7fcaa37fe700 1 --2- 172.21.15.60:0/2180110853 >> v2:172.21.15.60:3300/0 conn(0x7fcaa4156760 0x7fcaa4069520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:27.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.207+0000 7f4278f9c700 1 --2- 172.21.15.60:0/2922495841 >> [v2:172.21.15.135:6816/85815,v1:172.21.15.135:6817/85815] conn(0x7f4260070b60 0x7f4260072f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.208+0000 7fa7501ff700 1 -- 172.21.15.60:0/204468137 shutdown_connections 2023-10-06T04:28:27.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.208+0000 7fa7501ff700 1 --2- 172.21.15.60:0/204468137 >> v2:172.21.15.135:3300/0 conn(0x7fa7480b1de0 0x7fa7480b0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.208+0000 7fcaa899c700 1 --2- 172.21.15.60:0/2180110853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa4069a60 0x7fcaa40add90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fca980099b0 tx=0x7fca98009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd5f1fad2ab86437 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.208+0000 7fa7501ff700 1 --2- 172.21.15.60:0/204468137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7480b0c50 0x7fa7480b21b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.208+0000 7fa7501ff700 1 -- 172.21.15.60:0/204468137 >> 172.21.15.60:0/204468137 conn(0x7fa7480997f0 msgr2=0x7fa74806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.208+0000 7f425bfff700 1 -- 172.21.15.60:0/2922495841 <== osd.4 v2:172.21.15.135:6816/85815 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f4260073660 con 0x7f4260070b60 2023-10-06T04:28:27.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.208+0000 7f4273fff700 1 --2- 172.21.15.60:0/2922495841 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4260067000 0x7f42600694b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4264006fd0 tx=0x7f4264008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.208+0000 7fa7501ff700 1 -- 172.21.15.60:0/204468137 shutdown_connections 2023-10-06T04:28:27.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.208+0000 7fa7501ff700 1 -- 172.21.15.60:0/204468137 wait complete. 2023-10-06T04:28:27.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.209+0000 7fcaa2ffd700 1 -- 172.21.15.60:0/2180110853 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9800b820 con 0x7fcaa4069a60 2023-10-06T04:28:27.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.209+0000 7fcaa2ffd700 1 -- 172.21.15.60:0/2180110853 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9800b980 con 0x7fcaa4069a60 2023-10-06T04:28:27.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.209+0000 7fcaa2ffd700 1 -- 172.21.15.60:0/2180110853 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9800bd20 con 0x7fcaa4069a60 2023-10-06T04:28:27.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.211+0000 7fa7501ff700 1 Processor -- start 2023-10-06T04:28:27.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.211+0000 7fa7501ff700 1 -- start start 2023-10-06T04:28:27.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.211+0000 7fecce7fc700 1 -- 172.21.15.60:0/3801076358 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fecd001e860 con 0x7fecd8069ab0 2023-10-06T04:28:27.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.212+0000 7fecce7fc700 1 --2- 172.21.15.60:0/3801076358 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fecbc067080 0x7fecbc069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.212+0000 7fecce7fc700 1 -- 172.21.15.60:0/3801076358 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fecd0086fa0 con 0x7fecd8069ab0 2023-10-06T04:28:27.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.212+0000 7fecde19b700 1 --2- 172.21.15.60:0/3801076358 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fecbc067080 0x7fecbc069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.212+0000 7fecce7fc700 1 --2- 172.21.15.60:0/3801076358 >> [v2:172.21.15.135:6800/85791,v1:172.21.15.135:6802/85791] conn(0x7fecbc070be0 0x7fecbc073010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.213+0000 7fcaaa3ff700 1 -- 172.21.15.60:0/2180110853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa4069a60 msgr2=0x7fcaa40add90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.213+0000 7fcaaa3ff700 1 --2- 172.21.15.60:0/2180110853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa4069a60 0x7fcaa40add90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fca980099b0 tx=0x7fca98009250 comp rx=0 tx=0).stop 2023-10-06T04:28:27.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.213+0000 7fcaaa3ff700 1 -- 172.21.15.60:0/2180110853 shutdown_connections 2023-10-06T04:28:27.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.213+0000 7fcaaa3ff700 1 --2- 172.21.15.60:0/2180110853 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa4069a60 0x7fcaa40add90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.213+0000 7fcaaa3ff700 1 --2- 172.21.15.60:0/2180110853 >> v2:172.21.15.60:3300/0 conn(0x7fcaa4156760 0x7fcaa4069520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.213+0000 7fcaaa3ff700 1 -- 172.21.15.60:0/2180110853 >> 172.21.15.60:0/2180110853 conn(0x7fcaa4068080 msgr2=0x7fcaa40cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.212+0000 7fecce7fc700 1 -- 172.21.15.60:0/3801076358 --> [v2:172.21.15.135:6800/85791,v1:172.21.15.135:6802/85791] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fecbc0736e0 con 0x7fecbc070be0 2023-10-06T04:28:27.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.212+0000 7fecce7fc700 1 -- 172.21.15.60:0/3801076358 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecd00872d0 con 0x7fecd8069ab0 2023-10-06T04:28:27.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.213+0000 7fecde19b700 1 --2- 172.21.15.60:0/3801076358 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fecbc067080 0x7fecbc069530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fecd4007fd0 tx=0x7fecd4007e50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.214+0000 7fcaaa3ff700 1 -- 172.21.15.60:0/2180110853 shutdown_connections 2023-10-06T04:28:27.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.214+0000 7fecde99c700 1 --2- 172.21.15.60:0/3801076358 >> [v2:172.21.15.135:6800/85791,v1:172.21.15.135:6802/85791] conn(0x7fecbc070be0 0x7fecbc073010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.214+0000 7fcaaa3ff700 1 -- 172.21.15.60:0/2180110853 wait complete. 2023-10-06T04:28:27.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.214+0000 7fa7501ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7480b1de0 0x7fa748159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.215+0000 7fa7501ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7480cc7e0 0x7fa74815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.215+0000 7fa74df9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7480b1de0 0x7fa748159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.215+0000 7fecde99c700 1 --2- 172.21.15.60:0/3801076358 >> [v2:172.21.15.135:6800/85791,v1:172.21.15.135:6802/85791] conn(0x7fecbc070be0 0x7fecbc073010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.215+0000 7fa74df9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7480b1de0 0x7fa748159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:37472/0 (socket says 172.21.15.60:37472) 2023-10-06T04:28:27.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.216+0000 7fa74d79a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7480cc7e0 0x7fa74815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.216+0000 7fcaaa3ff700 1 Processor -- start 2023-10-06T04:28:27.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.216+0000 7fa74d79a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7480cc7e0 0x7fa74815c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52058/0 (socket says 172.21.15.60:52058) 2023-10-06T04:28:27.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.216+0000 7fecce7fc700 1 -- 172.21.15.60:0/3801076358 <== osd.5 v2:172.21.15.135:6800/85791 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fecbc0736e0 con 0x7fecbc070be0 2023-10-06T04:28:27.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.216+0000 7fcaaa3ff700 1 -- start start 2023-10-06T04:28:27.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.216+0000 7fa74df9b700 1 -- 172.21.15.60:0/907888380 learned_addr learned my addr 172.21.15.60:0/907888380 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.216+0000 7fa7501ff700 1 --2- 172.21.15.60:0/907888380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa74815c700 0x7fa74809c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.275 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.217+0000 7fa7501ff700 1 -- 172.21.15.60:0/907888380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa748159fe0 con 0x7fa7480cc7e0 2023-10-06T04:28:27.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.217+0000 7fcaaa3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa4069a60 0x7fcaa40aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.217+0000 7fa74e79c700 1 --2- 172.21.15.60:0/907888380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa74815c700 0x7fa74809c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.217+0000 7fa7501ff700 1 -- 172.21.15.60:0/907888380 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74815cb70 con 0x7fa74815c700 2023-10-06T04:28:27.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.217+0000 7fa7501ff700 1 -- 172.21.15.60:0/907888380 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74809de30 con 0x7fa7480b1de0 2023-10-06T04:28:27.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.217+0000 7fcaaa3ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaa406b540 0x7fcaa40adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.218+0000 7fcaaa3ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa4156760 0x7fcaa40ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.218+0000 7fcaa3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa4069a60 0x7fcaa40aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.218+0000 7fcaa3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa4069a60 0x7fcaa40aee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:58782/0 (socket says 172.21.15.60:58782) 2023-10-06T04:28:27.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.218+0000 7fcaa3fff700 1 -- 172.21.15.60:0/360506440 learned_addr learned my addr 172.21.15.60:0/360506440 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.218+0000 7fcaaa3ff700 1 -- 172.21.15.60:0/360506440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40c1f30 con 0x7fcaa406b540 2023-10-06T04:28:27.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.218+0000 7fcaa899c700 1 --2- 172.21.15.60:0/360506440 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa4156760 0x7fcaa40ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.218+0000 7fcaaa3ff700 1 -- 172.21.15.60:0/360506440 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40c23c0 con 0x7fcaa4069a60 2023-10-06T04:28:27.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.218+0000 7fcaaa3ff700 1 -- 172.21.15.60:0/360506440 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40af3d0 con 0x7fcaa4156760 2023-10-06T04:28:27.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.219+0000 7fcaa37fe700 1 --2- 172.21.15.60:0/360506440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaa406b540 0x7fcaa40adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.218+0000 7fa74d79a700 1 -- 172.21.15.60:0/907888380 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7480b1de0 msgr2=0x7fa748159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.218+0000 7fa74d79a700 1 --2- 172.21.15.60:0/907888380 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7480b1de0 0x7fa748159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.218+0000 7fa74d79a700 1 -- 172.21.15.60:0/907888380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa74815c700 msgr2=0x7fa74809c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.218+0000 7fa74d79a700 1 --2- 172.21.15.60:0/907888380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa74815c700 0x7fa74809c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.279 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.218+0000 7fa74d79a700 1 -- 172.21.15.60:0/907888380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa734009420 con 0x7fa7480cc7e0 2023-10-06T04:28:27.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.219+0000 7fcaa3fff700 1 -- 172.21.15.60:0/360506440 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa4156760 msgr2=0x7fcaa40ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.219+0000 7fcaa3fff700 1 --2- 172.21.15.60:0/360506440 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcaa4156760 0x7fcaa40ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.219+0000 7fcaa3fff700 1 -- 172.21.15.60:0/360506440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaa406b540 msgr2=0x7fcaa40adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.220+0000 7fcaa3fff700 1 --2- 172.21.15.60:0/360506440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaa406b540 0x7fcaa40adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.220+0000 7fcaa3fff700 1 -- 172.21.15.60:0/360506440 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca980094f0 con 0x7fcaa4069a60 2023-10-06T04:28:27.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.219+0000 7fa74d79a700 1 --2- 172.21.15.60:0/907888380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7480cc7e0 0x7fa74815c1c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa734015000 tx=0x7fa734016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.220+0000 7fcaa37fe700 1 --2- 172.21.15.60:0/360506440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaa406b540 0x7fcaa40adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:27.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.220+0000 7fa74df9b700 1 --2- 172.21.15.60:0/907888380 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa7480b1de0 0x7fa748159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:27.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.220+0000 7fa74e79c700 1 --2- 172.21.15.60:0/907888380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa74815c700 0x7fa74809c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:27.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.220+0000 7fcaa3fff700 1 --2- 172.21.15.60:0/360506440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa4069a60 0x7fcaa40aee90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00c5d0 tx=0x7fca9c007f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.221+0000 7fa745ffb700 1 -- 172.21.15.60:0/907888380 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734011a80 con 0x7fa7480cc7e0 2023-10-06T04:28:27.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.221+0000 7fa745ffb700 1 -- 172.21.15.60:0/907888380 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa734020070 con 0x7fa7480cc7e0 2023-10-06T04:28:27.282 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.221+0000 7fa7501ff700 1 -- 172.21.15.60:0/907888380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74809d220 con 0x7fa7480cc7e0 2023-10-06T04:28:27.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.224+0000 7fca8bfff700 1 -- 172.21.15.60:0/360506440 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c011590 con 0x7fcaa4069a60 2023-10-06T04:28:27.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.224+0000 7fcaaa3ff700 1 -- 172.21.15.60:0/360506440 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa40c1600 con 0x7fcaa4069a60 2023-10-06T04:28:27.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.224+0000 7fcaaa3ff700 1 -- 172.21.15.60:0/360506440 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa40c1bc0 con 0x7fcaa4069a60 2023-10-06T04:28:27.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.224+0000 7fca8bfff700 1 -- 172.21.15.60:0/360506440 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c0116f0 con 0x7fcaa4069a60 2023-10-06T04:28:27.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.225+0000 7fa7501ff700 1 -- 172.21.15.60:0/907888380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74809d7e0 con 0x7fa7480cc7e0 2023-10-06T04:28:27.284 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.225+0000 7fca8bfff700 1 -- 172.21.15.60:0/360506440 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c011ab0 con 0x7fcaa4069a60 2023-10-06T04:28:27.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.226+0000 7fa745ffb700 1 -- 172.21.15.60:0/907888380 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7340276d0 con 0x7fa7480cc7e0 2023-10-06T04:28:27.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.226+0000 7fa745ffb700 1 -- 172.21.15.60:0/907888380 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa734027a40 con 0x7fa7480cc7e0 2023-10-06T04:28:27.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.229+0000 7fcaaa3ff700 1 -- 172.21.15.60:0/360506440 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fca84000fd0 con 0x7fcaa4069a60 2023-10-06T04:28:27.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.227+0000 7fa745ffb700 1 --2- 172.21.15.60:0/907888380 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa72c067100 0x7fa72c0695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.228+0000 7fa74df9b700 1 --2- 172.21.15.60:0/907888380 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa72c067100 0x7fa72c0695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.228+0000 7fa745ffb700 1 -- 172.21.15.60:0/907888380 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa734022070 con 0x7fa7480cc7e0 2023-10-06T04:28:27.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.229+0000 7fa74df9b700 1 --2- 172.21.15.60:0/907888380 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa72c067100 0x7fa72c0695b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0075c0 tx=0x7fa73c00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.229+0000 7fa7501ff700 1 --2- 172.21.15.60:0/907888380 >> [v2:172.21.15.135:6824/85822,v1:172.21.15.135:6825/85822] conn(0x7fa7280015f0 0x7fa728003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.229+0000 7fa7501ff700 1 -- 172.21.15.60:0/907888380 --> [v2:172.21.15.135:6824/85822,v1:172.21.15.135:6825/85822] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa728006b90 con 0x7fa7280015f0 2023-10-06T04:28:27.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.230+0000 7fa74e79c700 1 --2- 172.21.15.60:0/907888380 >> [v2:172.21.15.135:6824/85822,v1:172.21.15.135:6825/85822] conn(0x7fa7280015f0 0x7fa728003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.230+0000 7fc7979ff700 1 -- 172.21.15.60:0/141215315 --> [v2:172.21.15.60:6808/85568,v1:172.21.15.60:6809/85568] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc788052d10 con 0x7fc774070d50 2023-10-06T04:28:27.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.231+0000 7f780339d700 1 -- 172.21.15.60:0/3288658034 --> [v2:172.21.15.60:6800/85567,v1:172.21.15.60:6801/85567] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f77e4002d30 con 0x7f77e0070d80 2023-10-06T04:28:27.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.231+0000 7fca8bfff700 1 -- 172.21.15.60:0/360506440 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca9c01c460 con 0x7fcaa4069a60 2023-10-06T04:28:27.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.231+0000 7fa74e79c700 1 --2- 172.21.15.60:0/907888380 >> [v2:172.21.15.135:6824/85822,v1:172.21.15.135:6825/85822] conn(0x7fa7280015f0 0x7fa728003aa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.232+0000 7f77f27fc700 1 -- 172.21.15.60:0/3288658034 <== osd.1 v2:172.21.15.60:6800/85567 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f77e4002d30 con 0x7f77e0070d80 2023-10-06T04:28:27.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.232+0000 7fc7857fa700 1 -- 172.21.15.60:0/141215315 <== osd.0 v2:172.21.15.60:6808/85568 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc788052d10 con 0x7fc774070d50 2023-10-06T04:28:27.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.232+0000 7f91c9ffb700 1 -- 172.21.15.60:0/2392562582 --> [v2:172.21.15.60:6816/85570,v1:172.21.15.60:6817/85570] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f91d8054230 con 0x7f91c4070d50 2023-10-06T04:28:27.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.233+0000 7fa745ffb700 1 -- 172.21.15.60:0/907888380 <== osd.7 v2:172.21.15.135:6824/85822 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa728006b90 con 0x7fa7280015f0 2023-10-06T04:28:27.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.233+0000 7fca8bfff700 1 --2- 172.21.15.60:0/360506440 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fca90066f80 0x7fca90069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.233+0000 7fc7979ff700 1 -- 172.21.15.60:0/141215315 >> [v2:172.21.15.60:6808/85568,v1:172.21.15.60:6809/85568] conn(0x7fc774070d50 msgr2=0x7fc774073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.233+0000 7fc7979ff700 1 --2- 172.21.15.60:0/141215315 >> [v2:172.21.15.60:6808/85568,v1:172.21.15.60:6809/85568] conn(0x7fc774070d50 0x7fc774073180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.233+0000 7fca8bfff700 1 -- 172.21.15.60:0/360506440 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fca9c084480 con 0x7fcaa4069a60 2023-10-06T04:28:27.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.233+0000 7fca8bfff700 1 --2- 172.21.15.60:0/360506440 >> [v2:172.21.15.135:6801/85790,v1:172.21.15.135:6803/85790] conn(0x7fca90070ae0 0x7fca90072f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.233+0000 7fca8bfff700 1 -- 172.21.15.60:0/360506440 --> [v2:172.21.15.135:6801/85790,v1:172.21.15.135:6803/85790] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca900735e0 con 0x7fca90070ae0 2023-10-06T04:28:27.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.233+0000 7fca8bfff700 1 -- 172.21.15.60:0/360506440 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca9c0869e0 con 0x7fcaa4069a60 2023-10-06T04:28:27.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.233+0000 7f91cbfff700 1 -- 172.21.15.60:0/2392562582 <== osd.2 v2:172.21.15.60:6816/85570 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f91d8054230 con 0x7f91c4070d50 2023-10-06T04:28:27.291 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.234+0000 7fcaa37fe700 1 --2- 172.21.15.60:0/360506440 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fca90066f80 0x7fca90069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.234+0000 7fc7979ff700 1 -- 172.21.15.60:0/141215315 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc774067080 msgr2=0x7fc774069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.234+0000 7fc7979ff700 1 --2- 172.21.15.60:0/141215315 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc774067080 0x7fc774069530 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc7880f5a00 tx=0x7fc78c008040 comp rx=0 tx=0).stop 2023-10-06T04:28:27.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.234+0000 7fc7979ff700 1 -- 172.21.15.60:0/141215315 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7880374b0 msgr2=0x7fc7880d46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.234+0000 7fc7979ff700 1 --2- 172.21.15.60:0/141215315 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7880374b0 0x7fc7880d46e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc78000c610 tx=0x7fc780007ed0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.234+0000 7fc795f9c700 1 -- 172.21.15.60:0/141215315 reap_dead start 2023-10-06T04:28:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.234+0000 7f91c9ffb700 1 -- 172.21.15.60:0/2392562582 >> [v2:172.21.15.60:6816/85570,v1:172.21.15.60:6817/85570] conn(0x7f91c4070d50 msgr2=0x7f91c4073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.234+0000 7f91c9ffb700 1 --2- 172.21.15.60:0/2392562582 >> [v2:172.21.15.60:6816/85570,v1:172.21.15.60:6817/85570] conn(0x7f91c4070d50 0x7f91c4073180 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.234+0000 7f91c9ffb700 1 -- 172.21.15.60:0/2392562582 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f91c4067080 msgr2=0x7f91c4069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.234+0000 7f91c9ffb700 1 --2- 172.21.15.60:0/2392562582 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f91c4067080 0x7f91c4069530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f91d804d910 tx=0x7f91cc008040 comp rx=0 tx=0).stop 2023-10-06T04:28:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.234+0000 7f91c9ffb700 1 -- 172.21.15.60:0/2392562582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d80e7920 msgr2=0x7f91d80dc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.234+0000 7f91c9ffb700 1 --2- 172.21.15.60:0/2392562582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91d80e7920 0x7f91d80dc4b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f91e0065a40 tx=0x7f91e0069000 comp rx=0 tx=0).stop 2023-10-06T04:28:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.235+0000 7fcaa899c700 1 --2- 172.21.15.60:0/360506440 >> [v2:172.21.15.135:6801/85790,v1:172.21.15.135:6803/85790] conn(0x7fca90070ae0 0x7fca90072f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.235+0000 7fc7979ff700 1 -- 172.21.15.60:0/141215315 shutdown_connections 2023-10-06T04:28:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.235+0000 7fc7979ff700 1 -- 172.21.15.60:0/141215315 >> 172.21.15.60:0/141215315 conn(0x7fc7880518a0 msgr2=0x7fc78800be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.235+0000 7fcaa37fe700 1 --2- 172.21.15.60:0/360506440 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fca90066f80 0x7fca90069430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fca9400d690 tx=0x7fca94007670 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.235+0000 7f780339d700 1 -- 172.21.15.60:0/3288658034 >> [v2:172.21.15.60:6800/85567,v1:172.21.15.60:6801/85567] conn(0x7f77e0070d80 msgr2=0x7f77e00731b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.235+0000 7f780339d700 1 --2- 172.21.15.60:0/3288658034 >> [v2:172.21.15.60:6800/85567,v1:172.21.15.60:6801/85567] conn(0x7f77e0070d80 0x7f77e00731b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.236+0000 7f91e499c700 1 -- 172.21.15.60:0/2392562582 reap_dead start 2023-10-06T04:28:27.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.236+0000 7f91c9ffb700 1 -- 172.21.15.60:0/2392562582 shutdown_connections 2023-10-06T04:28:27.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.236+0000 7fc7979ff700 1 -- 172.21.15.60:0/141215315 shutdown_connections 2023-10-06T04:28:27.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.236+0000 7f91c9ffb700 1 -- 172.21.15.60:0/2392562582 >> 172.21.15.60:0/2392562582 conn(0x7f91d8051700 msgr2=0x7f91d8049a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.236+0000 7fc7979ff700 1 -- 172.21.15.60:0/141215315 wait complete. 2023-10-06T04:28:27.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.236+0000 7f780339d700 1 -- 172.21.15.60:0/3288658034 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f77e00670b0 msgr2=0x7f77e0069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.236+0000 7f780339d700 1 --2- 172.21.15.60:0/3288658034 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f77e00670b0 0x7f77e0069560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f77f400b1f0 tx=0x7f77f4028000 comp rx=0 tx=0).stop 2023-10-06T04:28:27.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.236+0000 7f780339d700 1 -- 172.21.15.60:0/3288658034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77fc087800 msgr2=0x7f77fc086f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.236+0000 7f780339d700 1 --2- 172.21.15.60:0/3288658034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77fc087800 0x7f77fc086f70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f77f800b810 tx=0x7f77f80090f0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.236+0000 7f7802b9c700 1 -- 172.21.15.60:0/3288658034 reap_dead start 2023-10-06T04:28:27.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.236+0000 7f780339d700 1 -- 172.21.15.60:0/3288658034 shutdown_connections 2023-10-06T04:28:27.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.236+0000 7f780339d700 1 -- 172.21.15.60:0/3288658034 >> 172.21.15.60:0/3288658034 conn(0x7f77fc068080 msgr2=0x7f77fc06e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.237+0000 7f91c9ffb700 1 -- 172.21.15.60:0/2392562582 shutdown_connections 2023-10-06T04:28:27.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.237+0000 7f780339d700 1 -- 172.21.15.60:0/3288658034 shutdown_connections 2023-10-06T04:28:27.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.237+0000 7f780339d700 1 -- 172.21.15.60:0/3288658034 wait complete. 2023-10-06T04:28:27.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.237+0000 7f91c9ffb700 1 -- 172.21.15.60:0/2392562582 wait complete. 2023-10-06T04:28:27.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.237+0000 7fcaa899c700 1 --2- 172.21.15.60:0/360506440 >> [v2:172.21.15.135:6801/85790,v1:172.21.15.135:6803/85790] conn(0x7fca90070ae0 0x7fca90072f10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.238+0000 7fca8bfff700 1 -- 172.21.15.60:0/360506440 <== osd.6 v2:172.21.15.135:6801/85790 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fca900735e0 con 0x7fca90070ae0 2023-10-06T04:28:27.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.241+0000 7f427a9ff700 1 -- 172.21.15.60:0/2922495841 --> [v2:172.21.15.135:6816/85815,v1:172.21.15.135:6817/85815] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f42740b0a00 con 0x7f4260070b60 2023-10-06T04:28:27.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.242+0000 7fb9e1b9d700 1 -- 172.21.15.60:0/3250498458 --> [v2:172.21.15.60:6821/85599,v1:172.21.15.60:6823/85599] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb9dc06d720 con 0x7fb9c8070be0 2023-10-06T04:28:27.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.242+0000 7f425bfff700 1 -- 172.21.15.60:0/2922495841 <== osd.4 v2:172.21.15.135:6816/85815 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4268009600 con 0x7f4260070b60 2023-10-06T04:28:27.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.243+0000 7fb9d8ff9700 1 -- 172.21.15.60:0/3250498458 <== osd.3 v2:172.21.15.60:6821/85599 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb9dc06d720 con 0x7fb9c8070be0 2023-10-06T04:28:27.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.243+0000 7fb9c27fc700 1 -- 172.21.15.60:0/3250498458 >> [v2:172.21.15.60:6821/85599,v1:172.21.15.60:6823/85599] conn(0x7fb9c8070be0 msgr2=0x7fb9c8073010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.243+0000 7fb9c27fc700 1 --2- 172.21.15.60:0/3250498458 >> [v2:172.21.15.60:6821/85599,v1:172.21.15.60:6823/85599] conn(0x7fb9c8070be0 0x7fb9c8073010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.244+0000 7fb9c27fc700 1 -- 172.21.15.60:0/3250498458 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb9c8067080 msgr2=0x7fb9c8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.244+0000 7fb9c27fc700 1 --2- 172.21.15.60:0/3250498458 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb9c8067080 0x7fb9c8069530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0097c0 tx=0x7fb9cc006ce0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.244+0000 7f427a9ff700 1 -- 172.21.15.60:0/2922495841 >> [v2:172.21.15.135:6816/85815,v1:172.21.15.135:6817/85815] conn(0x7f4260070b60 msgr2=0x7f4260072f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.244+0000 7f427a9ff700 1 --2- 172.21.15.60:0/2922495841 >> [v2:172.21.15.135:6816/85815,v1:172.21.15.135:6817/85815] conn(0x7f4260070b60 0x7f4260072f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.244+0000 7fb9c27fc700 1 -- 172.21.15.60:0/3250498458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9dc1551a0 msgr2=0x7fb9dc157ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.244+0000 7fb9c27fc700 1 --2- 172.21.15.60:0/3250498458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9dc1551a0 0x7fb9dc157ed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc06cc20 tx=0x7fb9d0017000 comp rx=0 tx=0).stop 2023-10-06T04:28:27.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.244+0000 7fb9e139c700 1 -- 172.21.15.60:0/3250498458 reap_dead start 2023-10-06T04:28:27.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.244+0000 7fb9c27fc700 1 -- 172.21.15.60:0/3250498458 shutdown_connections 2023-10-06T04:28:27.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.245+0000 7fb9c27fc700 1 -- 172.21.15.60:0/3250498458 >> 172.21.15.60:0/3250498458 conn(0x7fb9dc068080 msgr2=0x7fb9dc0cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.245+0000 7f427a9ff700 1 -- 172.21.15.60:0/2922495841 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4260067000 msgr2=0x7f42600694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.245+0000 7f427a9ff700 1 --2- 172.21.15.60:0/2922495841 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4260067000 0x7f42600694b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4264006fd0 tx=0x7f4264008040 comp rx=0 tx=0).stop 2023-10-06T04:28:27.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.245+0000 7f427a9ff700 1 -- 172.21.15.60:0/2922495841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42740bf320 msgr2=0x7f427416e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.245+0000 7f427a9ff700 1 --2- 172.21.15.60:0/2922495841 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f42740bf320 0x7f427416e2a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f42740c8100 tx=0x7f426c019000 comp rx=0 tx=0).stop 2023-10-06T04:28:27.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.245+0000 7f4278f9c700 1 -- 172.21.15.60:0/2922495841 reap_dead start 2023-10-06T04:28:27.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.246+0000 7fb9c27fc700 1 -- 172.21.15.60:0/3250498458 shutdown_connections 2023-10-06T04:28:27.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.246+0000 7fb9c27fc700 1 -- 172.21.15.60:0/3250498458 wait complete. 2023-10-06T04:28:27.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.247+0000 7f427a9ff700 1 -- 172.21.15.60:0/2922495841 shutdown_connections 2023-10-06T04:28:27.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.247+0000 7f427a9ff700 1 -- 172.21.15.60:0/2922495841 >> 172.21.15.60:0/2922495841 conn(0x7f4274068080 msgr2=0x7f42741555c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.247+0000 7f427a9ff700 1 -- 172.21.15.60:0/2922495841 shutdown_connections 2023-10-06T04:28:27.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.247+0000 7f427a9ff700 1 -- 172.21.15.60:0/2922495841 wait complete. 2023-10-06T04:28:27.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.255+0000 7fecbbfff700 1 -- 172.21.15.60:0/3801076358 --> [v2:172.21.15.135:6800/85791,v1:172.21.15.135:6802/85791] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fecd816a660 con 0x7fecbc070be0 2023-10-06T04:28:27.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.256+0000 7fecce7fc700 1 -- 172.21.15.60:0/3801076358 <== osd.5 v2:172.21.15.135:6800/85791 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fecd816a660 con 0x7fecbc070be0 2023-10-06T04:28:27.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.257+0000 7fece03ff700 1 -- 172.21.15.60:0/3801076358 >> [v2:172.21.15.135:6800/85791,v1:172.21.15.135:6802/85791] conn(0x7fecbc070be0 msgr2=0x7fecbc073010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.257+0000 7fece03ff700 1 --2- 172.21.15.60:0/3801076358 >> [v2:172.21.15.135:6800/85791,v1:172.21.15.135:6802/85791] conn(0x7fecbc070be0 0x7fecbc073010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.258+0000 7fece03ff700 1 -- 172.21.15.60:0/3801076358 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fecbc067080 msgr2=0x7fecbc069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.258+0000 7fece03ff700 1 --2- 172.21.15.60:0/3801076358 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fecbc067080 0x7fecbc069530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fecd4007fd0 tx=0x7fecd4007e50 comp rx=0 tx=0).stop 2023-10-06T04:28:27.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.258+0000 7fece03ff700 1 -- 172.21.15.60:0/3801076358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fecd8069ab0 msgr2=0x7fecd8158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.258+0000 7fece03ff700 1 --2- 172.21.15.60:0/3801076358 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fecd8069ab0 0x7fecd8158860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fecd806fd70 tx=0x7fecd0017000 comp rx=0 tx=0).stop 2023-10-06T04:28:27.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.258+0000 7fecde99c700 1 -- 172.21.15.60:0/3801076358 reap_dead start 2023-10-06T04:28:27.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.262+0000 7fece03ff700 1 -- 172.21.15.60:0/3801076358 shutdown_connections 2023-10-06T04:28:27.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.262+0000 7fece03ff700 1 -- 172.21.15.60:0/3801076358 >> 172.21.15.60:0/3801076358 conn(0x7fecd8068080 msgr2=0x7fecd8159490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.262+0000 7fece03ff700 1 -- 172.21.15.60:0/3801076358 shutdown_connections 2023-10-06T04:28:27.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.264+0000 7fece03ff700 1 -- 172.21.15.60:0/3801076358 wait complete. 2023-10-06T04:28:27.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.264+0000 7fa7501ff700 1 -- 172.21.15.60:0/907888380 --> [v2:172.21.15.135:6824/85822,v1:172.21.15.135:6825/85822] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa728005c80 con 0x7fa7280015f0 2023-10-06T04:28:27.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.264+0000 7fa745ffb700 1 -- 172.21.15.60:0/907888380 <== osd.7 v2:172.21.15.135:6824/85822 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa728005c80 con 0x7fa7280015f0 2023-10-06T04:28:27.311 INFO:teuthology.orchestra.run.smithi060.stdout:55834574856 2023-10-06T04:28:27.312 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T04:28:27.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.266+0000 7fa7337fe700 1 -- 172.21.15.60:0/907888380 >> [v2:172.21.15.135:6824/85822,v1:172.21.15.135:6825/85822] conn(0x7fa7280015f0 msgr2=0x7fa728003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.266+0000 7fa7337fe700 1 --2- 172.21.15.60:0/907888380 >> [v2:172.21.15.135:6824/85822,v1:172.21.15.135:6825/85822] conn(0x7fa7280015f0 0x7fa728003aa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.266+0000 7fa7337fe700 1 -- 172.21.15.60:0/907888380 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa72c067100 msgr2=0x7fa72c0695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.266+0000 7fa7337fe700 1 --2- 172.21.15.60:0/907888380 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa72c067100 0x7fa72c0695b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0075c0 tx=0x7fa73c00b040 comp rx=0 tx=0).stop 2023-10-06T04:28:27.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.266+0000 7fa7337fe700 1 -- 172.21.15.60:0/907888380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7480cc7e0 msgr2=0x7fa74815c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.266+0000 7fa7337fe700 1 --2- 172.21.15.60:0/907888380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7480cc7e0 0x7fa74815c1c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa734015000 tx=0x7fa734016000 comp rx=0 tx=0).stop 2023-10-06T04:28:27.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.267+0000 7fa74e79c700 1 -- 172.21.15.60:0/907888380 reap_dead start 2023-10-06T04:28:27.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.267+0000 7fa7337fe700 1 -- 172.21.15.60:0/907888380 shutdown_connections 2023-10-06T04:28:27.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.267+0000 7fa7337fe700 1 -- 172.21.15.60:0/907888380 >> 172.21.15.60:0/907888380 conn(0x7fa7480997f0 msgr2=0x7fa7480cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.267+0000 7fa7337fe700 1 -- 172.21.15.60:0/907888380 shutdown_connections 2023-10-06T04:28:27.314 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.267+0000 7fa7337fe700 1 -- 172.21.15.60:0/907888380 wait complete. 2023-10-06T04:28:27.315 INFO:teuthology.orchestra.run.smithi060.stdout:55834574856 2023-10-06T04:28:27.315 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T04:28:27.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.270+0000 7fcaaa3ff700 1 -- 172.21.15.60:0/360506440 --> [v2:172.21.15.135:6801/85790,v1:172.21.15.135:6803/85790] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fca84002d20 con 0x7fca90070ae0 2023-10-06T04:28:27.316 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.271+0000 7fca8bfff700 1 -- 172.21.15.60:0/360506440 <== osd.6 v2:172.21.15.135:6801/85790 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fca84002d20 con 0x7fca90070ae0 2023-10-06T04:28:27.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.272+0000 7fcaaa3ff700 1 -- 172.21.15.60:0/360506440 >> [v2:172.21.15.135:6801/85790,v1:172.21.15.135:6803/85790] conn(0x7fca90070ae0 msgr2=0x7fca90072f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.272+0000 7fcaaa3ff700 1 --2- 172.21.15.60:0/360506440 >> [v2:172.21.15.135:6801/85790,v1:172.21.15.135:6803/85790] conn(0x7fca90070ae0 0x7fca90072f10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.272+0000 7fcaaa3ff700 1 -- 172.21.15.60:0/360506440 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fca90066f80 msgr2=0x7fca90069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.272+0000 7fcaaa3ff700 1 --2- 172.21.15.60:0/360506440 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fca90066f80 0x7fca90069430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fca9400d690 tx=0x7fca94007670 comp rx=0 tx=0).stop 2023-10-06T04:28:27.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.272+0000 7fcaaa3ff700 1 -- 172.21.15.60:0/360506440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa4069a60 msgr2=0x7fcaa40aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.272+0000 7fcaaa3ff700 1 --2- 172.21.15.60:0/360506440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa4069a60 0x7fcaa40aee90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00c5d0 tx=0x7fca9c007f60 comp rx=0 tx=0).stop 2023-10-06T04:28:27.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.272+0000 7fcaa899c700 1 -- 172.21.15.60:0/360506440 reap_dead start 2023-10-06T04:28:27.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.273+0000 7fcaaa3ff700 1 -- 172.21.15.60:0/360506440 shutdown_connections 2023-10-06T04:28:27.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.273+0000 7fcaaa3ff700 1 -- 172.21.15.60:0/360506440 >> 172.21.15.60:0/360506440 conn(0x7fcaa4068080 msgr2=0x7fcaa40cb580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.273+0000 7fcaaa3ff700 1 -- 172.21.15.60:0/360506440 shutdown_connections 2023-10-06T04:28:27.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.273+0000 7fcaaa3ff700 1 -- 172.21.15.60:0/360506440 wait complete. 2023-10-06T04:28:27.319 INFO:teuthology.orchestra.run.smithi060.stdout:55834574856 2023-10-06T04:28:27.320 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T04:28:27.321 INFO:teuthology.orchestra.run.smithi060.stdout:55834574855 2023-10-06T04:28:27.321 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T04:28:27.322 INFO:teuthology.orchestra.run.smithi060.stdout:55834574856 2023-10-06T04:28:27.322 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T04:28:27.323 INFO:teuthology.orchestra.run.smithi060.stdout:55834574855 2023-10-06T04:28:27.323 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T04:28:27.324 INFO:teuthology.orchestra.run.smithi060.stdout:55834574856 2023-10-06T04:28:27.324 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T04:28:27.325 INFO:teuthology.orchestra.run.smithi060.stdout:55834574855 2023-10-06T04:28:27.325 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T04:28:27.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.690+0000 7f57b679d700 1 Processor -- start 2023-10-06T04:28:27.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.690+0000 7f57b679d700 1 -- start start 2023-10-06T04:28:27.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.691+0000 7f216a7ff700 1 Processor -- start 2023-10-06T04:28:27.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.691+0000 7fdeb9b9d700 1 Processor -- start 2023-10-06T04:28:27.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.692+0000 7fdeb9b9d700 1 -- start start 2023-10-06T04:28:27.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.693+0000 7f57b679d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57b00cc5d0 0x7f57b006e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.693+0000 7f57b679d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f57b01561b0 0x7f57b00c6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.693+0000 7f57b679d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b006d210 con 0x7f57b0159a90 2023-10-06T04:28:27.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.693+0000 7f57b679d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b006f5b0 con 0x7f57b01561b0 2023-10-06T04:28:27.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.693+0000 7f57b679d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b006f3c0 con 0x7f57b00cc5d0 2023-10-06T04:28:27.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.691+0000 7f216a7ff700 1 -- start start 2023-10-06T04:28:27.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.694+0000 7fdeb9b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeac006920 0x7fdeac0e4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.694+0000 7fdeb9b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdeac0ea190 0x7fdeac0ea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.694+0000 7fdeb9b9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeac0eab30 con 0x7fdeac0e3e60 2023-10-06T04:28:27.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.694+0000 7fdeb9b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeac006e90 con 0x7fdeac0ea190 2023-10-06T04:28:27.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.694+0000 7fdeb9b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac007170 con 0x7fdeac006920 2023-10-06T04:28:27.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.695+0000 7fdeb3fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeac006920 0x7fdeac0e4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.695+0000 7fdeb3fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeac006920 0x7fdeac0e4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:37492/0 (socket says 172.21.15.60:37492) 2023-10-06T04:28:27.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.695+0000 7fdeb3fff700 1 -- 172.21.15.60:0/3608567769 learned_addr learned my addr 172.21.15.60:0/3608567769 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.695+0000 7fdeb939c700 1 --2- 172.21.15.60:0/3608567769 >> v2:172.21.15.135:3300/0 conn(0x7fdeac0ea190 0x7fdeac0ea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.694+0000 7f57b4f9a700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f57b0159a90 0x7f57b006ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.60:56054/0 (socket says 172.21.15.60:56054) 2023-10-06T04:28:27.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.694+0000 7f57b4f9a700 1 -- 172.21.15.60:0/2259546452 learned_addr learned my addr 172.21.15.60:0/2259546452 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:27.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.695+0000 7f57b579b700 1 --2- 172.21.15.60:0/2259546452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57b00cc5d0 0x7f57b006e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.695+0000 7f57a7fff700 1 -- 172.21.15.60:0/2259546452 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134613549 0 0) 0x7f57b006d210 con 0x7f57b0159a90 2023-10-06T04:28:27.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.695+0000 7f57a7fff700 1 -- 172.21.15.60:0/2259546452 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f579c003570 con 0x7f57b0159a90 2023-10-06T04:28:27.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.695+0000 7f57a7fff700 1 -- 172.21.15.60:0/2259546452 <== mon.1 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 924705742 0 0) 0x7f579c003570 con 0x7f57b0159a90 2023-10-06T04:28:27.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.695+0000 7f57a7fff700 1 -- 172.21.15.60:0/2259546452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57b00cc5d0 msgr2=0x7f57b006e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:27.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.695+0000 7f57a7fff700 1 --2- 172.21.15.60:0/2259546452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57b00cc5d0 0x7f57b006e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.695+0000 7f57a7fff700 1 -- 172.21.15.60:0/2259546452 >> v2:172.21.15.135:3300/0 conn(0x7f57b01561b0 msgr2=0x7f57b00c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:27.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.695+0000 7f57b5f9c700 1 --2- 172.21.15.60:0/2259546452 >> v2:172.21.15.135:3300/0 conn(0x7f57b01561b0 0x7f57b00c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.693+0000 7f216a7ff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f215c0eae70 0x7f215c038940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.693+0000 7f216a7ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f215c038e80 0x7f215c0e6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.694+0000 7f216a7ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f215c0061b0 con 0x7f215c0e6340 2023-10-06T04:28:27.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.694+0000 7f216a7ff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215c006490 con 0x7f215c0eae70 2023-10-06T04:28:27.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.694+0000 7f216a7ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215c0392a0 con 0x7f215c038e80 2023-10-06T04:28:27.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.694+0000 7f21637fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f215c0eae70 0x7f215c038940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.694+0000 7f21637fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f215c0eae70 0x7f215c038940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52084/0 (socket says 172.21.15.60:52084) 2023-10-06T04:28:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.694+0000 7f21637fe700 1 -- 172.21.15.60:0/334774483 learned_addr learned my addr 172.21.15.60:0/334774483 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.695+0000 7f2168d9c700 1 --2- 172.21.15.60:0/334774483 >> v2:172.21.15.135:3300/0 conn(0x7f215c038e80 0x7f215c0e6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.695+0000 7f2168d9c700 1 -- 172.21.15.60:0/334774483 >> v2:172.21.15.60:3300/0 conn(0x7f215c0eae70 msgr2=0x7f215c038940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.695+0000 7f2168d9c700 1 --2- 172.21.15.60:0/334774483 >> v2:172.21.15.60:3300/0 conn(0x7f215c0eae70 0x7f215c038940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.695+0000 7f2168d9c700 1 -- 172.21.15.60:0/334774483 >> v1:172.21.15.135:6789/0 conn(0x7f215c0e6340 legacy=0x7f215c03a8b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T04:28:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.695+0000 7f2168d9c700 1 -- 172.21.15.60:0/334774483 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215c03b2c0 con 0x7f215c038e80 2023-10-06T04:28:27.702 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.696+0000 7f57a7fff700 1 --2- 172.21.15.60:0/2259546452 >> v2:172.21.15.135:3300/0 conn(0x7f57b01561b0 0x7f57b00c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.696+0000 7f57a7fff700 1 -- 172.21.15.60:0/2259546452 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b006d720 con 0x7f57b0159a90 2023-10-06T04:28:27.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.696+0000 7f57a7fff700 1 -- 172.21.15.60:0/2259546452 <== mon.1 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7f57a80017f0 con 0x7f57b0159a90 2023-10-06T04:28:27.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.696+0000 7f57a7fff700 1 -- 172.21.15.60:0/2259546452 >> v1:172.21.15.135:6789/0 conn(0x7f57b0159a90 legacy=0x7f57b006ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.696+0000 7f57a7fff700 1 --2- 172.21.15.60:0/2259546452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57b00cc5d0 0x7f579c003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.696+0000 7f2168d9c700 1 --2- 172.21.15.60:0/334774483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c038e80 0x7f215c0e6710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f21640674b0 tx=0x7f2164067350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31c2ecb9a17c1076 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.696+0000 7fdeb3fff700 1 -- 172.21.15.60:0/3608567769 >> v2:172.21.15.135:3300/0 conn(0x7fdeac0ea190 msgr2=0x7fdeac0ea5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.696+0000 7f57a7fff700 1 --2- 172.21.15.60:0/2259546452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f579c004110 0x7f579c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.696+0000 7f57a7fff700 1 --2- 172.21.15.60:0/2259546452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f579c004e70 0x7f579c0052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.696+0000 7f57a7fff700 1 -- 172.21.15.60:0/2259546452 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b006f5b0 con 0x7f579c004110 2023-10-06T04:28:27.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.696+0000 7f57a7fff700 1 -- 172.21.15.60:0/2259546452 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c00bcc0 con 0x7f579c004e70 2023-10-06T04:28:27.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.696+0000 7f57a7fff700 1 -- 172.21.15.60:0/2259546452 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c00be80 con 0x7f57b00cc5d0 2023-10-06T04:28:27.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.697+0000 7f2162ffd700 1 -- 172.21.15.60:0/334774483 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164065890 con 0x7f215c038e80 2023-10-06T04:28:27.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.697+0000 7f2162ffd700 1 -- 172.21.15.60:0/334774483 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216404c0a0 con 0x7f215c038e80 2023-10-06T04:28:27.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.697+0000 7f2162ffd700 1 -- 172.21.15.60:0/334774483 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216404bb40 con 0x7f215c038e80 2023-10-06T04:28:27.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.697+0000 7f57b4f9a700 1 --2- 172.21.15.60:0/2259546452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f579c004110 0x7f579c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.697+0000 7fdeb3fff700 1 --2- 172.21.15.60:0/3608567769 >> v2:172.21.15.135:3300/0 conn(0x7fdeac0ea190 0x7fdeac0ea5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.697+0000 7fdeb3fff700 1 -- 172.21.15.60:0/3608567769 >> v1:172.21.15.60:6789/0 conn(0x7fdeac0e3e60 legacy=0x7fdeac04fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.697+0000 7fdeb3fff700 1 -- 172.21.15.60:0/3608567769 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac007450 con 0x7fdeac006920 2023-10-06T04:28:27.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.698+0000 7f57b4f9a700 1 -- 172.21.15.60:0/2259546452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57b00cc5d0 msgr2=0x7f579c003ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:28:27.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.698+0000 7fdeb939c700 1 --2- 172.21.15.60:0/3608567769 >> v2:172.21.15.135:3300/0 conn(0x7fdeac0ea190 0x7fdeac0ea5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:27.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.698+0000 7f57b4f9a700 1 --2- 172.21.15.60:0/2259546452 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57b00cc5d0 0x7f579c003ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.709 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.697+0000 7f664f39d700 1 Processor -- start 2023-10-06T04:28:27.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.697+0000 7f664f39d700 1 -- start start 2023-10-06T04:28:27.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.698+0000 7f57b4f9a700 1 -- 172.21.15.60:0/2259546452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f579c004e70 msgr2=0x7f579c0052e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:28:27.710 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.698+0000 7f57b4f9a700 1 --2- 172.21.15.60:0/2259546452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f579c004e70 0x7f579c0052e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.698+0000 7f216a7ff700 1 -- 172.21.15.60:0/334774483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c038e80 msgr2=0x7f215c0e6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.698+0000 7f216a7ff700 1 --2- 172.21.15.60:0/334774483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c038e80 0x7f215c0e6710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f21640674b0 tx=0x7f2164067350 comp rx=0 tx=0).stop 2023-10-06T04:28:27.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.698+0000 7f216a7ff700 1 -- 172.21.15.60:0/334774483 shutdown_connections 2023-10-06T04:28:27.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.698+0000 7f216a7ff700 1 --2- 172.21.15.60:0/334774483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c038e80 0x7f215c0e6710 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.698+0000 7f216a7ff700 1 --2- 172.21.15.60:0/334774483 >> v2:172.21.15.60:3300/0 conn(0x7f215c0eae70 0x7f215c038940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.698+0000 7f216a7ff700 1 -- 172.21.15.60:0/334774483 >> 172.21.15.60:0/334774483 conn(0x7f215c00f0b0 msgr2=0x7f215c059070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.711 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.698+0000 7f57b4f9a700 1 -- 172.21.15.60:0/2259546452 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b006d720 con 0x7f579c004110 2023-10-06T04:28:27.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.698+0000 7f216a7ff700 1 -- 172.21.15.60:0/334774483 shutdown_connections 2023-10-06T04:28:27.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.698+0000 7f57b4f9a700 1 --2- 172.21.15.60:0/2259546452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f579c004110 0x7f579c004810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f57a800a9f0 tx=0x7f57a800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca7f19b792f2af7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.712 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.699+0000 7f216a7ff700 1 -- 172.21.15.60:0/334774483 wait complete. 2023-10-06T04:28:27.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.698+0000 7f57b5f9c700 1 --2- 172.21.15.60:0/2259546452 >> v2:172.21.15.135:3300/0 conn(0x7f57b01561b0 0x7f57b00c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:27.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.699+0000 7fdeb3fff700 1 --2- 172.21.15.60:0/3608567769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeac006920 0x7fdeac0e4230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdea00099b0 tx=0x7fdea0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41f4f30e692fb64c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.699+0000 7f57a7fff700 1 -- 172.21.15.60:0/2259546452 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a800a2b0 con 0x7f579c004110 2023-10-06T04:28:27.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.699+0000 7f57a7fff700 1 -- 172.21.15.60:0/2259546452 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a80070f0 con 0x7f579c004110 2023-10-06T04:28:27.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.699+0000 7f57a7fff700 1 -- 172.21.15.60:0/2259546452 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a8007470 con 0x7f579c004110 2023-10-06T04:28:27.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.699+0000 7fdeb37fe700 1 -- 172.21.15.60:0/3608567769 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea0009ea0 con 0x7fdeac006920 2023-10-06T04:28:27.714 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.699+0000 7fdeb37fe700 1 -- 172.21.15.60:0/3608567769 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea000b860 con 0x7fdeac006920 2023-10-06T04:28:27.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.699+0000 7fdeb37fe700 1 -- 172.21.15.60:0/3608567769 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea000bbe0 con 0x7fdeac006920 2023-10-06T04:28:27.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.700+0000 7f664f39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f664815d980 0x7f664806a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.700+0000 7f664f39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f66480c9fa0 0x7f664806a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.700+0000 7f664f39d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6648069fc0 con 0x7f664815d5b0 2023-10-06T04:28:27.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.700+0000 7f664f39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66480693b0 con 0x7f66480c9fa0 2023-10-06T04:28:27.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.700+0000 7f664f39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6648069690 con 0x7f664815d980 2023-10-06T04:28:27.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.700+0000 7f57b679d700 1 -- 172.21.15.60:0/2259546452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f579c004110 msgr2=0x7f579c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.700+0000 7f57b679d700 1 --2- 172.21.15.60:0/2259546452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f579c004110 0x7f579c004810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f57a800a9f0 tx=0x7f57a800a060 comp rx=0 tx=0).stop 2023-10-06T04:28:27.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.700+0000 7f57b5f9c700 1 -- 172.21.15.60:0/2259546452 reap_dead start 2023-10-06T04:28:27.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.700+0000 7f664eb9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f66480c9fa0 0x7f664806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.700+0000 7f664db9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f664815d980 0x7f664806a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.700+0000 7fdeb9b9d700 1 -- 172.21.15.60:0/3608567769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeac006920 msgr2=0x7fdeac0e4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.700+0000 7f664e39b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f664815d5b0 0x7f664806d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57022/0 (socket says 172.21.15.60:57022) 2023-10-06T04:28:27.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.700+0000 7f664e39b700 1 -- 172.21.15.60:0/2924686713 learned_addr learned my addr 172.21.15.60:0/2924686713 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:27.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.700+0000 7fdeb9b9d700 1 --2- 172.21.15.60:0/3608567769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeac006920 0x7fdeac0e4230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdea00099b0 tx=0x7fdea0009250 comp rx=0 tx=0).stop 2023-10-06T04:28:27.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.700+0000 7f57b679d700 1 -- 172.21.15.60:0/2259546452 shutdown_connections 2023-10-06T04:28:27.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.701+0000 7fdeb9b9d700 1 -- 172.21.15.60:0/3608567769 shutdown_connections 2023-10-06T04:28:27.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.701+0000 7fdeb9b9d700 1 --2- 172.21.15.60:0/3608567769 >> v2:172.21.15.135:3300/0 conn(0x7fdeac0ea190 0x7fdeac0ea5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.701+0000 7fdeb9b9d700 1 --2- 172.21.15.60:0/3608567769 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeac006920 0x7fdeac0e4230 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.701+0000 7f664db9a700 1 -- 172.21.15.60:0/2924686713 >> v2:172.21.15.135:3300/0 conn(0x7f66480c9fa0 msgr2=0x7f664806a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:27.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.701+0000 7f664db9a700 1 --2- 172.21.15.60:0/2924686713 >> v2:172.21.15.135:3300/0 conn(0x7f66480c9fa0 0x7f664806a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.701+0000 7f664db9a700 1 -- 172.21.15.60:0/2924686713 >> v1:172.21.15.60:6789/0 conn(0x7f664815d5b0 legacy=0x7f664806d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.701+0000 7f664db9a700 1 -- 172.21.15.60:0/2924686713 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6648069970 con 0x7f664815d980 2023-10-06T04:28:27.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.700+0000 7f57b679d700 1 -- 172.21.15.60:0/2259546452 >> 172.21.15.60:0/2259546452 conn(0x7f57b0068080 msgr2=0x7f57b00cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.701+0000 7fdeb9b9d700 1 -- 172.21.15.60:0/3608567769 >> 172.21.15.60:0/3608567769 conn(0x7fdeac054c80 msgr2=0x7fdeac055080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.701+0000 7fdeb9b9d700 1 -- 172.21.15.60:0/3608567769 shutdown_connections 2023-10-06T04:28:27.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.701+0000 7f664db9a700 1 --2- 172.21.15.60:0/2924686713 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f664815d980 0x7f664806a450 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6640009e60 tx=0x7f6640009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d58192cf859809f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.701+0000 7f216a7ff700 1 Processor -- start 2023-10-06T04:28:27.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.701+0000 7fdeb9b9d700 1 -- 172.21.15.60:0/3608567769 wait complete. 2023-10-06T04:28:27.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.702+0000 7f57b679d700 1 -- 172.21.15.60:0/2259546452 shutdown_connections 2023-10-06T04:28:27.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.702+0000 7f57b679d700 1 -- 172.21.15.60:0/2259546452 wait complete. 2023-10-06T04:28:27.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.702+0000 7f216a7ff700 1 -- start start 2023-10-06T04:28:27.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.702+0000 7f664d399700 1 -- 172.21.15.60:0/2924686713 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664000e070 con 0x7f664815d980 2023-10-06T04:28:27.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.702+0000 7f664d399700 1 -- 172.21.15.60:0/2924686713 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664000bb60 con 0x7f664815d980 2023-10-06T04:28:27.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.702+0000 7f664d399700 1 -- 172.21.15.60:0/2924686713 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6640012430 con 0x7f664815d980 2023-10-06T04:28:27.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.703+0000 7f664f39d700 1 -- 172.21.15.60:0/2924686713 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f664815d980 msgr2=0x7f664806a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.703+0000 7f664f39d700 1 --2- 172.21.15.60:0/2924686713 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f664815d980 0x7f664806a450 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6640009e60 tx=0x7f6640009780 comp rx=0 tx=0).stop 2023-10-06T04:28:27.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.703+0000 7f664f39d700 1 -- 172.21.15.60:0/2924686713 shutdown_connections 2023-10-06T04:28:27.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.703+0000 7f664f39d700 1 --2- 172.21.15.60:0/2924686713 >> v2:172.21.15.135:3300/0 conn(0x7f66480c9fa0 0x7f664806a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.703+0000 7f664f39d700 1 --2- 172.21.15.60:0/2924686713 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f664815d980 0x7f664806a450 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.703+0000 7f216a7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c038e80 0x7f215c0e1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.703+0000 7f664f39d700 1 -- 172.21.15.60:0/2924686713 >> 172.21.15.60:0/2924686713 conn(0x7f6648068080 msgr2=0x7f66480cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.703+0000 7f216a7ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c0e6340 0x7f215c04d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.703+0000 7f664f39d700 1 -- 172.21.15.60:0/2924686713 shutdown_connections 2023-10-06T04:28:27.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.704+0000 7f216a7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f215c0eae70 0x7f215c0e9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.704+0000 7f216a7ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c04dfb0 con 0x7f215c0e6340 2023-10-06T04:28:27.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.704+0000 7f216a7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c00dbf0 con 0x7f215c038e80 2023-10-06T04:28:27.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.704+0000 7f216a7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215c04e7e0 con 0x7f215c0eae70 2023-10-06T04:28:27.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.704+0000 7f664f39d700 1 -- 172.21.15.60:0/2924686713 wait complete. 2023-10-06T04:28:27.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.704+0000 7f21637fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c0e6340 0x7f215c04d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.704+0000 7f21637fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c0e6340 0x7f215c04d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52112/0 (socket says 172.21.15.60:52112) 2023-10-06T04:28:27.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.704+0000 7f21637fe700 1 -- 172.21.15.60:0/3302879518 learned_addr learned my addr 172.21.15.60:0/3302879518 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.705+0000 7f57b679d700 1 Processor -- start 2023-10-06T04:28:27.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.705+0000 7f57b679d700 1 -- start start 2023-10-06T04:28:27.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.705+0000 7f21637fe700 1 -- 172.21.15.60:0/3302879518 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f215c0eae70 msgr2=0x7f215c0e9300 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:28:27.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.705+0000 7f21637fe700 1 --2- 172.21.15.60:0/3302879518 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f215c0eae70 0x7f215c0e9300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.705+0000 7f21637fe700 1 -- 172.21.15.60:0/3302879518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c038e80 msgr2=0x7f215c0e1d50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:28:27.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.705+0000 7f21637fe700 1 --2- 172.21.15.60:0/3302879518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c038e80 0x7f215c0e1d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.705+0000 7f21637fe700 1 -- 172.21.15.60:0/3302879518 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216404c960 con 0x7f215c0e6340 2023-10-06T04:28:27.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.705+0000 7fdeb9b9d700 1 Processor -- start 2023-10-06T04:28:27.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.706+0000 7fdeb9b9d700 1 -- start start 2023-10-06T04:28:27.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.706+0000 7f21637fe700 1 --2- 172.21.15.60:0/3302879518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c0e6340 0x7f215c04d5c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f215800d8c0 tx=0x7f2158008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.706+0000 7f664f39d700 1 Processor -- start 2023-10-06T04:28:27.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.706+0000 7f57b679d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f579c004110 0x7f57b00c1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.706+0000 7f57b679d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57b0142420 0x7f57b0142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.707+0000 7f57b679d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b00b1130 0x7f57b00b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.707+0000 7f57b679d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b01461b0 con 0x7f57b00b1130 2023-10-06T04:28:27.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.707+0000 7f57b679d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b01455a0 con 0x7f57b0142420 2023-10-06T04:28:27.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.707+0000 7f57b679d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b0145880 con 0x7f579c004110 2023-10-06T04:28:27.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.707+0000 7f57b579b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f579c004110 0x7f57b00c1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.707+0000 7f57b579b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f579c004110 0x7f57b00c1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:37536/0 (socket says 172.21.15.60:37536) 2023-10-06T04:28:27.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.707+0000 7f57b579b700 1 -- 172.21.15.60:0/787897878 learned_addr learned my addr 172.21.15.60:0/787897878 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.707+0000 7fdeb9b9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeac006920 0x7fdeac0d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.707+0000 7fdeb9b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeac0e3e60 0x7fdeac0f6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.707+0000 7fdeb9b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeac0ea190 0x7fdeac0fad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.708+0000 7fdeb9b9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0fa870 con 0x7fdeac006920 2023-10-06T04:28:27.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.708+0000 7fdeb9b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0f77c0 con 0x7fdeac0e3e60 2023-10-06T04:28:27.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.708+0000 7fdeb9b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0f7aa0 con 0x7fdeac0ea190 2023-10-06T04:28:27.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.708+0000 7fdeb939c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeac0ea190 0x7fdeac0fad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.708+0000 7fdeb939c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeac0ea190 0x7fdeac0fad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:37546/0 (socket says 172.21.15.60:37546) 2023-10-06T04:28:27.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.708+0000 7fdeb939c700 1 -- 172.21.15.60:0/3057538696 learned_addr learned my addr 172.21.15.60:0/3057538696 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.708+0000 7fdeb8b9b700 1 --2- 172.21.15.60:0/3057538696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeac006920 0x7fdeac0d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.708+0000 7f57b579b700 1 -- 172.21.15.60:0/787897878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57b0142420 msgr2=0x7f57b0142890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:28:27.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.708+0000 7f57b579b700 1 --2- 172.21.15.60:0/787897878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57b0142420 0x7f57b0142890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.708+0000 7f57b579b700 1 -- 172.21.15.60:0/787897878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b00b1130 msgr2=0x7f57b00b1560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:28:27.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.708+0000 7f57b579b700 1 --2- 172.21.15.60:0/787897878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b00b1130 0x7f57b00b1560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.708+0000 7f57b579b700 1 -- 172.21.15.60:0/787897878 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b0145b60 con 0x7f579c004110 2023-10-06T04:28:27.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.708+0000 7f57b579b700 1 --2- 172.21.15.60:0/787897878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f579c004110 0x7f57b00c1b30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00d890 tx=0x7f57ac008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.707+0000 7f214ffff700 1 -- 172.21.15.60:0/3302879518 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21580095b0 con 0x7f215c0e6340 2023-10-06T04:28:27.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.708+0000 7f216a7ff700 1 -- 172.21.15.60:0/3302879518 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215c0e5980 con 0x7f215c0e6340 2023-10-06T04:28:27.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.708+0000 7f216a7ff700 1 -- 172.21.15.60:0/3302879518 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215c04e470 con 0x7f215c0e6340 2023-10-06T04:28:27.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.708+0000 7f214ffff700 1 -- 172.21.15.60:0/3302879518 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2158009710 con 0x7f215c0e6340 2023-10-06T04:28:27.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.708+0000 7f214ffff700 1 -- 172.21.15.60:0/3302879518 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158009ab0 con 0x7f215c0e6340 2023-10-06T04:28:27.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.708+0000 7f57a57fa700 1 -- 172.21.15.60:0/787897878 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac0125f0 con 0x7f579c004110 2023-10-06T04:28:27.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.709+0000 7fdeb8b9b700 1 -- 172.21.15.60:0/3057538696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeac0ea190 msgr2=0x7fdeac0fad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.709+0000 7fdeb8b9b700 1 --2- 172.21.15.60:0/3057538696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeac0ea190 0x7fdeac0fad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.709+0000 7fdeb8b9b700 1 -- 172.21.15.60:0/3057538696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeac0e3e60 msgr2=0x7fdeac0f6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.709+0000 7fdeb8b9b700 1 --2- 172.21.15.60:0/3057538696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeac0e3e60 0x7fdeac0f6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.709+0000 7fdeb8b9b700 1 -- 172.21.15.60:0/3057538696 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea8009420 con 0x7fdeac006920 2023-10-06T04:28:27.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.709+0000 7fdeb8b9b700 1 --2- 172.21.15.60:0/3057538696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeac006920 0x7fdeac0d0e60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdeb404c820 tx=0x7fdeb4067350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.710+0000 7fdeb0ff9700 1 -- 172.21.15.60:0/3057538696 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4068940 con 0x7fdeac006920 2023-10-06T04:28:27.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.710+0000 7fdeb0ff9700 1 -- 172.21.15.60:0/3057538696 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb4068aa0 con 0x7fdeac006920 2023-10-06T04:28:27.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.710+0000 7fdeb0ff9700 1 -- 172.21.15.60:0/3057538696 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4068c30 con 0x7fdeac006920 2023-10-06T04:28:27.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.710+0000 7fdeb9b9d700 1 -- 172.21.15.60:0/3057538696 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea00094f0 con 0x7fdeac006920 2023-10-06T04:28:27.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.708+0000 7f664f39d700 1 -- start start 2023-10-06T04:28:27.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.710+0000 7f664f39d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66480c9fa0 0x7f664815c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.710+0000 7f664f39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f664815d5b0 0x7f664815ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.710+0000 7f664f39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f664815d980 0x7f66481563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.710+0000 7f664f39d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664816dd00 con 0x7f66480c9fa0 2023-10-06T04:28:27.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.710+0000 7f664f39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664815ef60 con 0x7f664815d5b0 2023-10-06T04:28:27.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.710+0000 7f664f39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f664815c7f0 con 0x7f664815d980 2023-10-06T04:28:27.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.710+0000 7fd45f1ff700 1 Processor -- start 2023-10-06T04:28:27.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.709+0000 7f3922bff700 1 Processor -- start 2023-10-06T04:28:27.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.711+0000 7fd45f1ff700 1 -- start start 2023-10-06T04:28:27.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.709+0000 7f3922bff700 1 -- start start 2023-10-06T04:28:27.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.711+0000 7f3922bff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f391c0bf320 0x7f391c0c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.711+0000 7f3922bff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f391c0bf6f0 0x7f391c069520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.711+0000 7f3922bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f391c069a60 0x7f391c0c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.711+0000 7f216a7ff700 1 -- 172.21.15.60:0/3302879518 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21440052b0 con 0x7f215c0e6340 2023-10-06T04:28:27.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.711+0000 7f664eb9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f664815d980 0x7f66481563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.711+0000 7f664eb9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f664815d980 0x7f66481563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:37550/0 (socket says 172.21.15.60:37550) 2023-10-06T04:28:27.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.711+0000 7f3922bff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c15e190 con 0x7f391c0bf320 2023-10-06T04:28:27.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.711+0000 7f3922bff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c069ee0 con 0x7f391c0bf6f0 2023-10-06T04:28:27.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.711+0000 7f3922bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0c7fc0 con 0x7f391c069a60 2023-10-06T04:28:27.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.712+0000 7f392119c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f391c069a60 0x7f391c0c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.712+0000 7f392099b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f391c0bf320 0x7f391c0c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.738 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.712+0000 7f392119c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f391c069a60 0x7f391c0c6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:37562/0 (socket says 172.21.15.60:37562) 2023-10-06T04:28:27.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.712+0000 7f392119c700 1 -- 172.21.15.60:0/2386190576 learned_addr learned my addr 172.21.15.60:0/2386190576 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.711+0000 7f664eb9c700 1 -- 172.21.15.60:0/1159307134 learned_addr learned my addr 172.21.15.60:0/1159307134 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.712+0000 7f664eb9c700 1 -- 172.21.15.60:0/1159307134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f664815d5b0 msgr2=0x7f664815ea20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T04:28:27.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.712+0000 7f664eb9c700 1 --2- 172.21.15.60:0/1159307134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f664815d5b0 0x7f664815ea20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.710+0000 7f57a57fa700 1 -- 172.21.15.60:0/787897878 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac012750 con 0x7f579c004110 2023-10-06T04:28:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.710+0000 7f57b679d700 1 -- 172.21.15.60:0/787897878 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b0145e40 con 0x7f579c004110 2023-10-06T04:28:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.710+0000 7f57a57fa700 1 -- 172.21.15.60:0/787897878 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac012ad0 con 0x7f579c004110 2023-10-06T04:28:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.710+0000 7f57b679d700 1 -- 172.21.15.60:0/787897878 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b0143030 con 0x7f579c004110 2023-10-06T04:28:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.712+0000 7f664eb9c700 1 -- 172.21.15.60:0/1159307134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66480c9fa0 msgr2=0x7f664815c110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:28:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.712+0000 7fd45f1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd458159560 0x7fd4580aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.712+0000 7fd45f1ff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd4580b0760 0x7fd4580b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.713+0000 7fd45f1ff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4580b0c60 con 0x7fd4580b49a0 2023-10-06T04:28:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.713+0000 7fd45f1ff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4580b0f40 con 0x7fd4580b0760 2023-10-06T04:28:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.713+0000 7fd45f1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4580b1220 con 0x7fd458159560 2023-10-06T04:28:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.712+0000 7f392119c700 1 -- 172.21.15.60:0/2386190576 >> v2:172.21.15.135:3300/0 conn(0x7f391c0bf6f0 msgr2=0x7f391c069520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T04:28:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.712+0000 7f392119c700 1 --2- 172.21.15.60:0/2386190576 >> v2:172.21.15.135:3300/0 conn(0x7f391c0bf6f0 0x7f391c069520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.712+0000 7f392119c700 1 -- 172.21.15.60:0/2386190576 >> v2:172.21.15.60:3300/0 conn(0x7f391c0bf320 msgr2=0x7f391c0c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.712+0000 7f392119c700 1 --2- 172.21.15.60:0/2386190576 >> v2:172.21.15.60:3300/0 conn(0x7f391c0bf320 0x7f391c0c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.712+0000 7f392119c700 1 -- 172.21.15.60:0/2386190576 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c0c73b0 con 0x7f391c069a60 2023-10-06T04:28:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.712+0000 7f664eb9c700 1 --2- 172.21.15.60:0/1159307134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66480c9fa0 0x7f664815c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.713+0000 7f392099b700 1 --2- 172.21.15.60:0/2386190576 >> v2:172.21.15.60:3300/0 conn(0x7f391c0bf320 0x7f391c0c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.712+0000 7f664eb9c700 1 -- 172.21.15.60:0/1159307134 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6640009a20 con 0x7f664815d980 2023-10-06T04:28:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.712+0000 7f664eb9c700 1 --2- 172.21.15.60:0/1159307134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f664815d980 0x7f66481563b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f663800ea50 tx=0x7f66380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.713+0000 7f663e7fc700 1 -- 172.21.15.60:0/1159307134 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663800c8c0 con 0x7f664815d980 2023-10-06T04:28:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.713+0000 7f663e7fc700 1 -- 172.21.15.60:0/1159307134 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663800ca60 con 0x7f664815d980 2023-10-06T04:28:27.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.713+0000 7f663e7fc700 1 -- 172.21.15.60:0/1159307134 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663800ce20 con 0x7f664815d980 2023-10-06T04:28:27.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.713+0000 7f664f39d700 1 -- 172.21.15.60:0/1159307134 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f664816df50 con 0x7f664815d980 2023-10-06T04:28:27.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.713+0000 7f664f39d700 1 -- 172.21.15.60:0/1159307134 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f664816e510 con 0x7f664815d980 2023-10-06T04:28:27.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.713+0000 7fd45cf9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd458159560 0x7fd4580aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.713+0000 7fd45cf9b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd458159560 0x7fd4580aa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:37576/0 (socket says 172.21.15.60:37576) 2023-10-06T04:28:27.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.713+0000 7fd45cf9b700 1 -- 172.21.15.60:0/3670407930 learned_addr learned my addr 172.21.15.60:0/3670407930 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.713+0000 7fd45d79c700 1 --2- 172.21.15.60:0/3670407930 >> v2:172.21.15.60:3300/0 conn(0x7fd4580b0760 0x7fd4580b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.713+0000 7f392119c700 1 --2- 172.21.15.60:0/2386190576 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f391c069a60 0x7f391c0c6680 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f391c0cc910 tx=0x7f3914009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23a88ca30eb0b7fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.713+0000 7fd45cf9b700 1 -- 172.21.15.60:0/3670407930 >> v2:172.21.15.60:3300/0 conn(0x7fd4580b0760 msgr2=0x7fd4580b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:27.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.713+0000 7fd45cf9b700 1 --2- 172.21.15.60:0/3670407930 >> v2:172.21.15.60:3300/0 conn(0x7fd4580b0760 0x7fd4580b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.713+0000 7fd45cf9b700 1 -- 172.21.15.60:0/3670407930 >> v1:172.21.15.60:6789/0 conn(0x7fd4580b49a0 legacy=0x7fd4580aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:27.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.713+0000 7fd45cf9b700 1 -- 172.21.15.60:0/3670407930 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4580b1500 con 0x7fd458159560 2023-10-06T04:28:27.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.713+0000 7f57b679d700 1 -- 172.21.15.60:0/787897878 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b005f230 con 0x7f579c004110 2023-10-06T04:28:27.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.714+0000 7f38c3bff700 1 Processor -- start 2023-10-06T04:28:27.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.715+0000 7fdeb0ff9700 1 -- 172.21.15.60:0/3057538696 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdeb408d020 con 0x7fdeac006920 2023-10-06T04:28:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.715+0000 7f214ffff700 1 -- 172.21.15.60:0/3302879518 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f215801e460 con 0x7f215c0e6340 2023-10-06T04:28:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.715+0000 7f38c3bff700 1 -- start start 2023-10-06T04:28:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.715+0000 7f57a57fa700 1 -- 172.21.15.60:0/787897878 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57ac01e460 con 0x7f579c004110 2023-10-06T04:28:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.716+0000 7f214ffff700 1 --2- 172.21.15.60:0/3302879518 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2148067000 0x7f21480694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.716+0000 7f214ffff700 1 -- 172.21.15.60:0/3302879518 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2158084f50 con 0x7f215c0e6340 2023-10-06T04:28:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.715+0000 7f664f39d700 1 -- 172.21.15.60:0/1159307134 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66300052b0 con 0x7f664815d980 2023-10-06T04:28:27.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.717+0000 7f57a57fa700 1 --2- 172.21.15.60:0/787897878 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5794067000 0x7f57940694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.717+0000 7f663e7fc700 1 -- 172.21.15.60:0/1159307134 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6638013680 con 0x7f664815d980 2023-10-06T04:28:27.749 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.717+0000 7f38c3bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38bc0aef10 0x7f38bc155840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.717+0000 7f38c3bff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f38bc15a270 0x7f38bc0685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.717+0000 7f38c3bff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38bc0b2630 con 0x7f38bc0b2150 2023-10-06T04:28:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.717+0000 7f38c3bff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38bc0b2910 con 0x7f38bc15a270 2023-10-06T04:28:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.717+0000 7f38c3bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc070ee0 con 0x7f38bc0aef10 2023-10-06T04:28:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.715+0000 7fdeb9b9d700 1 -- 172.21.15.60:0/3057538696 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeac0fa500 con 0x7fdeac006920 2023-10-06T04:28:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.717+0000 7fdeb9b9d700 1 -- 172.21.15.60:0/3057538696 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeac005380 con 0x7fdeac006920 2023-10-06T04:28:27.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.717+0000 7fdeb0ff9700 1 --2- 172.21.15.60:0/3057538696 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fde98067000 0x7fde980694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.717+0000 7f38c199b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38bc0aef10 0x7f38bc155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.718+0000 7f38c199b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38bc0aef10 0x7f38bc155840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:37588/0 (socket says 172.21.15.60:37588) 2023-10-06T04:28:27.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.718+0000 7f38c199b700 1 -- 172.21.15.60:0/1254422678 learned_addr learned my addr 172.21.15.60:0/1254422678 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.718+0000 7f663e7fc700 1 --2- 172.21.15.60:0/1159307134 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f662c067080 0x7f662c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.718+0000 7f57a57fa700 1 -- 172.21.15.60:0/787897878 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f57ac084f80 con 0x7f579c004110 2023-10-06T04:28:27.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.718+0000 7fd45cf9b700 1 --2- 172.21.15.60:0/3670407930 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd458159560 0x7fd4580aa530 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd448009f70 tx=0x7fd448009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66633a0ddf6561ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.718+0000 7f38c199b700 1 -- 172.21.15.60:0/1254422678 >> v2:172.21.15.60:3300/0 conn(0x7f38bc15a270 msgr2=0x7f38bc0685c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:27.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.718+0000 7f38c199b700 1 --2- 172.21.15.60:0/1254422678 >> v2:172.21.15.60:3300/0 conn(0x7f38bc15a270 0x7f38bc0685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.718+0000 7fdeb3fff700 1 --2- 172.21.15.60:0/3057538696 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fde98067000 0x7fde980694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.718+0000 7f38c199b700 1 -- 172.21.15.60:0/1254422678 >> v1:172.21.15.135:6789/0 conn(0x7f38bc0b2150 legacy=0x7f38bc0707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.718+0000 7f38c199b700 1 -- 172.21.15.60:0/1254422678 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc159790 con 0x7f38bc0aef10 2023-10-06T04:28:27.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.718+0000 7f663e7fc700 1 -- 172.21.15.60:0/1159307134 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6638084d80 con 0x7f664815d980 2023-10-06T04:28:27.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.718+0000 7f664e39b700 1 --2- 172.21.15.60:0/1159307134 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f662c067080 0x7f662c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.718+0000 7f45ae39d700 1 Processor -- start 2023-10-06T04:28:27.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.718+0000 7f38c199b700 1 --2- 172.21.15.60:0/1254422678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38bc0aef10 0x7f38bc155840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f38ac0099b0 tx=0x7f38ac009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=949db21927baaa36 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.718+0000 7f2163fff700 1 --2- 172.21.15.60:0/3302879518 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2148067000 0x7f21480694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.719+0000 7f45ae39d700 1 -- start start 2023-10-06T04:28:27.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.719+0000 7f391bfff700 1 -- 172.21.15.60:0/2386190576 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391400b820 con 0x7f391c069a60 2023-10-06T04:28:27.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.719+0000 7f391bfff700 1 -- 172.21.15.60:0/2386190576 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391400b980 con 0x7f391c069a60 2023-10-06T04:28:27.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.719+0000 7f391bfff700 1 -- 172.21.15.60:0/2386190576 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391400bd20 con 0x7f391c069a60 2023-10-06T04:28:27.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.719+0000 7f664e39b700 1 --2- 172.21.15.60:0/1159307134 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f662c067080 0x7f662c069530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f66440058d0 tx=0x7f6644007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.719+0000 7fdeb3fff700 1 --2- 172.21.15.60:0/3057538696 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fde98067000 0x7fde980694b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdea00099b0 tx=0x7fdea0017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.720+0000 7f57b4f9a700 1 --2- 172.21.15.60:0/787897878 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5794067000 0x7f57940694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.720+0000 7f2163fff700 1 --2- 172.21.15.60:0/3302879518 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2148067000 0x7f21480694b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2150009740 tx=0x7f2150006c60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.720+0000 7f3922bff700 1 -- 172.21.15.60:0/2386190576 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f391c069a60 msgr2=0x7f391c0c6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.720+0000 7f3922bff700 1 --2- 172.21.15.60:0/2386190576 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f391c069a60 0x7f391c0c6680 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f391c0cc910 tx=0x7f3914009250 comp rx=0 tx=0).stop 2023-10-06T04:28:27.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.720+0000 7f45ae39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a00547c0 0x7f45a00e6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.721+0000 7f57b4f9a700 1 --2- 172.21.15.60:0/787897878 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5794067000 0x7f57940694b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f57b014ad10 tx=0x7f57a8016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.721+0000 7f45ad39b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f45a00e60a0 0x7f45a0057f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57038/0 (socket says 172.21.15.60:57038) 2023-10-06T04:28:27.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.721+0000 7f3922bff700 1 -- 172.21.15.60:0/2386190576 shutdown_connections 2023-10-06T04:28:27.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.721+0000 7f3922bff700 1 --2- 172.21.15.60:0/2386190576 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f391c069a60 0x7f391c0c6680 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.721+0000 7f3922bff700 1 --2- 172.21.15.60:0/2386190576 >> v2:172.21.15.60:3300/0 conn(0x7f391c0bf320 0x7f391c0c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.721+0000 7f3922bff700 1 --2- 172.21.15.60:0/2386190576 >> v2:172.21.15.135:3300/0 conn(0x7f391c0bf6f0 0x7f391c069520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.721+0000 7f3922bff700 1 -- 172.21.15.60:0/2386190576 >> 172.21.15.60:0/2386190576 conn(0x7f391c068080 msgr2=0x7f391c0cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.721+0000 7f45ad39b700 1 -- 172.21.15.60:0/2737795015 learned_addr learned my addr 172.21.15.60:0/2737795015 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:27.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.721+0000 7f45ae39d700 1 --2- 172.21.15.60:0/2737795015 >> v2:172.21.15.60:3300/0 conn(0x7f45a00dc430 0x7f45a00dc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.721+0000 7f3922bff700 1 -- 172.21.15.60:0/2386190576 shutdown_connections 2023-10-06T04:28:27.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.721+0000 7f3922bff700 1 -- 172.21.15.60:0/2386190576 wait complete. 2023-10-06T04:28:27.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.721+0000 7f45acb9a700 1 --2- 172.21.15.60:0/2737795015 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a00547c0 0x7f45a00e6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.721+0000 7f45adb9c700 1 --2- 172.21.15.60:0/2737795015 >> v2:172.21.15.60:3300/0 conn(0x7f45a00dc430 0x7f45a00dc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.722+0000 7f45ae39d700 1 -- 172.21.15.60:0/2737795015 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a00e3ab0 con 0x7f45a00e60a0 2023-10-06T04:28:27.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.722+0000 7f45ae39d700 1 -- 172.21.15.60:0/2737795015 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a00dcdf0 con 0x7f45a00dc430 2023-10-06T04:28:27.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.722+0000 7f45ae39d700 1 -- 172.21.15.60:0/2737795015 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a0006030 con 0x7f45a00547c0 2023-10-06T04:28:27.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.722+0000 7f663e7fc700 1 -- 172.21.15.60:0/1159307134 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6638051b80 con 0x7f664815d980 2023-10-06T04:28:27.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.722+0000 7f45adb9c700 1 -- 172.21.15.60:0/2737795015 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a00547c0 msgr2=0x7f45a00e6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:27.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.722+0000 7f45adb9c700 1 --2- 172.21.15.60:0/2737795015 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a00547c0 0x7f45a00e6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.722+0000 7f45adb9c700 1 -- 172.21.15.60:0/2737795015 >> v1:172.21.15.60:6789/0 conn(0x7f45a00e60a0 legacy=0x7f45a0057f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.722+0000 7f45adb9c700 1 -- 172.21.15.60:0/2737795015 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a0058800 con 0x7f45a00dc430 2023-10-06T04:28:27.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.722+0000 7f45acb9a700 1 --2- 172.21.15.60:0/2737795015 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a00547c0 0x7f45a00e6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:27.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.723+0000 7f214ffff700 1 -- 172.21.15.60:0/3302879518 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21580557e0 con 0x7f215c0e6340 2023-10-06T04:28:27.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.723+0000 7f45adb9c700 1 --2- 172.21.15.60:0/2737795015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45a00dc430 0x7f45a00dc8b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f45a80614b0 tx=0x7f45a8066c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71453c992c3c1da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.723+0000 7f3922bff700 1 Processor -- start 2023-10-06T04:28:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.723+0000 7f3922bff700 1 -- start start 2023-10-06T04:28:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.724+0000 7f3922bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f391c069a60 0x7f391c14c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.724+0000 7f3922bff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f391c0bf320 0x7f391c0c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.724+0000 7f3922bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f391c0bf6f0 0x7f391c0c2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.724+0000 7f3922bff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0bfb00 con 0x7f391c0bf320 2023-10-06T04:28:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.724+0000 7f3922bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0c08d0 con 0x7f391c0bf6f0 2023-10-06T04:28:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.724+0000 7f3922bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0c2880 con 0x7f391c069a60 2023-10-06T04:28:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.725+0000 7f392099b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f391c069a60 0x7f391c14c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.725+0000 7f3913fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f391c0bf320 0x7f391c0c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.725+0000 7f392119c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f391c0bf6f0 0x7f391c0c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.725+0000 7f3913fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f391c0bf320 0x7f391c0c1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52154/0 (socket says 172.21.15.60:52154) 2023-10-06T04:28:27.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.725+0000 7f3913fff700 1 -- 172.21.15.60:0/995573405 learned_addr learned my addr 172.21.15.60:0/995573405 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.725+0000 7fdeb0ff9700 1 -- 172.21.15.60:0/3057538696 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdeb40cb580 con 0x7fdeac006920 2023-10-06T04:28:27.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.725+0000 7f392119c700 1 -- 172.21.15.60:0/995573405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f391c069a60 msgr2=0x7f391c14c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.725+0000 7f392119c700 1 --2- 172.21.15.60:0/995573405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f391c069a60 0x7f391c14c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.725+0000 7f392119c700 1 -- 172.21.15.60:0/995573405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f391c0bf320 msgr2=0x7f391c0c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.725+0000 7f392119c700 1 --2- 172.21.15.60:0/995573405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f391c0bf320 0x7f391c0c1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.725+0000 7f392119c700 1 -- 172.21.15.60:0/995573405 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39140094f0 con 0x7f391c0bf6f0 2023-10-06T04:28:27.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.726+0000 7f392119c700 1 --2- 172.21.15.60:0/995573405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f391c0bf6f0 0x7f391c0c2340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f391c06ce60 tx=0x7f3914017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.726+0000 7f39197fa700 1 -- 172.21.15.60:0/995573405 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391400b820 con 0x7f391c0bf6f0 2023-10-06T04:28:27.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.726+0000 7f39197fa700 1 -- 172.21.15.60:0/995573405 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391401f070 con 0x7f391c0bf6f0 2023-10-06T04:28:27.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.726+0000 7f3922bff700 1 -- 172.21.15.60:0/995573405 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391c0bfd50 con 0x7f391c0bf6f0 2023-10-06T04:28:27.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.726+0000 7f39197fa700 1 -- 172.21.15.60:0/995573405 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391401a870 con 0x7f391c0bf6f0 2023-10-06T04:28:27.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.726+0000 7f3922bff700 1 -- 172.21.15.60:0/995573405 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391c0c05f0 con 0x7f391c0bf6f0 2023-10-06T04:28:27.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.727+0000 7f57a57fa700 1 -- 172.21.15.60:0/787897878 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57ac051d80 con 0x7f579c004110 2023-10-06T04:28:27.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.727+0000 7fd4577fe700 1 -- 172.21.15.60:0/3670407930 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44800e070 con 0x7fd458159560 2023-10-06T04:28:27.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.727+0000 7fd4577fe700 1 -- 172.21.15.60:0/3670407930 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44800ba90 con 0x7fd458159560 2023-10-06T04:28:27.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.727+0000 7fd4577fe700 1 -- 172.21.15.60:0/3670407930 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4480092e0 con 0x7fd458159560 2023-10-06T04:28:27.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.727+0000 7f38c0999700 1 -- 172.21.15.60:0/1254422678 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac00b860 con 0x7f38bc0aef10 2023-10-06T04:28:27.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.727+0000 7f38c0999700 1 -- 172.21.15.60:0/1254422678 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ac00b9c0 con 0x7f38bc0aef10 2023-10-06T04:28:27.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.727+0000 7f38c0999700 1 -- 172.21.15.60:0/1254422678 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac00bd60 con 0x7f38bc0aef10 2023-10-06T04:28:27.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.728+0000 7f3922bff700 1 -- 172.21.15.60:0/995573405 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391c0c7bb0 con 0x7f391c0bf6f0 2023-10-06T04:28:27.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.728+0000 7f38c3bff700 1 -- 172.21.15.60:0/1254422678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38bc0aef10 msgr2=0x7f38bc155840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.728+0000 7f38c3bff700 1 --2- 172.21.15.60:0/1254422678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38bc0aef10 0x7f38bc155840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f38ac0099b0 tx=0x7f38ac009250 comp rx=0 tx=0).stop 2023-10-06T04:28:27.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.728+0000 7fd45f1ff700 1 -- 172.21.15.60:0/3670407930 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd458159560 msgr2=0x7fd4580aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.728+0000 7fd45f1ff700 1 --2- 172.21.15.60:0/3670407930 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd458159560 0x7fd4580aa530 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd448009f70 tx=0x7fd448009840 comp rx=0 tx=0).stop 2023-10-06T04:28:27.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.728+0000 7f38c3bff700 1 -- 172.21.15.60:0/1254422678 shutdown_connections 2023-10-06T04:28:27.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.728+0000 7f38c3bff700 1 --2- 172.21.15.60:0/1254422678 >> v2:172.21.15.60:3300/0 conn(0x7f38bc15a270 0x7f38bc0685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.728+0000 7f38c3bff700 1 --2- 172.21.15.60:0/1254422678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38bc0aef10 0x7f38bc155840 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.728+0000 7f38c3bff700 1 -- 172.21.15.60:0/1254422678 >> 172.21.15.60:0/1254422678 conn(0x7f38bc06dcd0 msgr2=0x7f38bc06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.729+0000 7f459ffff700 1 -- 172.21.15.60:0/2737795015 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a80631f0 con 0x7f45a00dc430 2023-10-06T04:28:27.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.729+0000 7fd45f1ff700 1 -- 172.21.15.60:0/3670407930 shutdown_connections 2023-10-06T04:28:27.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.729+0000 7fd45f1ff700 1 --2- 172.21.15.60:0/3670407930 >> v2:172.21.15.60:3300/0 conn(0x7fd4580b0760 0x7fd4580b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.729+0000 7fd45f1ff700 1 --2- 172.21.15.60:0/3670407930 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd458159560 0x7fd4580aa530 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.729+0000 7fd45f1ff700 1 -- 172.21.15.60:0/3670407930 >> 172.21.15.60:0/3670407930 conn(0x7fd4580997f0 msgr2=0x7fd45806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.730+0000 7f459ffff700 1 -- 172.21.15.60:0/2737795015 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a8065890 con 0x7f45a00dc430 2023-10-06T04:28:27.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.730+0000 7f459ffff700 1 -- 172.21.15.60:0/2737795015 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a804c0a0 con 0x7f45a00dc430 2023-10-06T04:28:27.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.730+0000 7f39197fa700 1 -- 172.21.15.60:0/995573405 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f391401ac60 con 0x7f391c0bf6f0 2023-10-06T04:28:27.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.730+0000 7f38c3bff700 1 -- 172.21.15.60:0/1254422678 shutdown_connections 2023-10-06T04:28:27.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.730+0000 7f38c3bff700 1 -- 172.21.15.60:0/1254422678 wait complete. 2023-10-06T04:28:27.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.730+0000 7fdeb0ff9700 1 -- 172.21.15.60:0/3057538696 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdeb40ff060 con 0x7fdeac006920 2023-10-06T04:28:27.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.731+0000 7f45ae39d700 1 -- 172.21.15.60:0/2737795015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45a00dc430 msgr2=0x7f45a00dc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.731+0000 7f45ae39d700 1 --2- 172.21.15.60:0/2737795015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45a00dc430 0x7f45a00dc8b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f45a80614b0 tx=0x7f45a8066c40 comp rx=0 tx=0).stop 2023-10-06T04:28:27.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.731+0000 7f45ae39d700 1 -- 172.21.15.60:0/2737795015 shutdown_connections 2023-10-06T04:28:27.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.731+0000 7f45ae39d700 1 --2- 172.21.15.60:0/2737795015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45a00dc430 0x7f45a00dc8b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.731+0000 7f45ae39d700 1 --2- 172.21.15.60:0/2737795015 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a00547c0 0x7f45a00e6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.731+0000 7f45ae39d700 1 -- 172.21.15.60:0/2737795015 >> 172.21.15.60:0/2737795015 conn(0x7f45a000e7c0 msgr2=0x7f45a000ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:27.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.731+0000 7f39197fa700 1 --2- 172.21.15.60:0/995573405 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f38fc066f30 0x7f38fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.731+0000 7f39197fa700 1 -- 172.21.15.60:0/995573405 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3914021070 con 0x7f391c0bf6f0 2023-10-06T04:28:27.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.732+0000 7f392099b700 1 --2- 172.21.15.60:0/995573405 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f38fc066f30 0x7f38fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.732+0000 7f38c3bff700 1 Processor -- start 2023-10-06T04:28:27.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.733+0000 7f38c3bff700 1 -- start start 2023-10-06T04:28:27.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.733+0000 7f45ae39d700 1 -- 172.21.15.60:0/2737795015 shutdown_connections 2023-10-06T04:28:27.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.733+0000 7f45ae39d700 1 -- 172.21.15.60:0/2737795015 wait complete. 2023-10-06T04:28:27.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.731+0000 7fd45f1ff700 1 -- 172.21.15.60:0/3670407930 shutdown_connections 2023-10-06T04:28:27.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.731+0000 7fd45f1ff700 1 -- 172.21.15.60:0/3670407930 wait complete. 2023-10-06T04:28:27.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.733+0000 7fd45f1ff700 1 Processor -- start 2023-10-06T04:28:27.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.733+0000 7fd45f1ff700 1 -- start start 2023-10-06T04:28:27.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.735+0000 7fd45f1ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4580b0760 0x7fd4580c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.735+0000 7f38c3bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38bc0aef10 0x7f38bc129a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.735+0000 7fd45f1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4580b49a0 0x7fd4580c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.735+0000 7fd45f1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd458159560 0x7fd45809d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.735+0000 7fd45f1ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4580c7960 con 0x7fd4580b0760 2023-10-06T04:28:27.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.735+0000 7fd45f1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4580c5ef0 con 0x7fd4580b49a0 2023-10-06T04:28:27.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.735+0000 7fd45f1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4580ae540 con 0x7fd458159560 2023-10-06T04:28:27.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.735+0000 7fd45cf9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4580b0760 0x7fd4580c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.735+0000 7fd45cf9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4580b0760 0x7fd4580c7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52166/0 (socket says 172.21.15.60:52166) 2023-10-06T04:28:27.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.735+0000 7fd45cf9b700 1 -- 172.21.15.60:0/431161320 learned_addr learned my addr 172.21.15.60:0/431161320 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.735+0000 7f38c3bff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38bc0b2150 0x7f38bc150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.735+0000 7f38c3bff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38bc15a270 0x7f38bc14c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.736+0000 7f38c3bff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc14f6d0 con 0x7f38bc0b2150 2023-10-06T04:28:27.779 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.735+0000 7fd45d79c700 1 --2- 172.21.15.60:0/431161320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd458159560 0x7fd45809d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.736+0000 7f38c3bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc14d6a0 con 0x7f38bc0aef10 2023-10-06T04:28:27.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.736+0000 7f38c3bff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc144e30 con 0x7f38bc15a270 2023-10-06T04:28:27.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.736+0000 7f45ae39d700 1 Processor -- start 2023-10-06T04:28:27.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.736+0000 7fd457fff700 1 --2- 172.21.15.60:0/431161320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4580b49a0 0x7fd4580c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.736+0000 7fd45cf9b700 1 -- 172.21.15.60:0/431161320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd458159560 msgr2=0x7fd45809d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.736+0000 7fd45cf9b700 1 --2- 172.21.15.60:0/431161320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd458159560 0x7fd45809d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.736+0000 7fd45cf9b700 1 -- 172.21.15.60:0/431161320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4580b49a0 msgr2=0x7fd4580c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.736+0000 7fd45cf9b700 1 --2- 172.21.15.60:0/431161320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4580b49a0 0x7fd4580c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.736+0000 7fd45cf9b700 1 -- 172.21.15.60:0/431161320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd448009ae0 con 0x7fd4580b0760 2023-10-06T04:28:27.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.736+0000 7f38c219c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38bc15a270 0x7f38bc14c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.736+0000 7f45ae39d700 1 -- start start 2023-10-06T04:28:27.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.736+0000 7f38c219c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38bc15a270 0x7f38bc14c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:37628/0 (socket says 172.21.15.60:37628) 2023-10-06T04:28:27.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.736+0000 7f38c219c700 1 -- 172.21.15.60:0/1099791786 learned_addr learned my addr 172.21.15.60:0/1099791786 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.736+0000 7fd45cf9b700 1 --2- 172.21.15.60:0/431161320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4580b0760 0x7fd4580c7420 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd4580b1360 tx=0x7fd448017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.737+0000 7f392099b700 1 --2- 172.21.15.60:0/995573405 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f38fc066f30 0x7f38fc0693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f390c0076f0 tx=0x7f390c0098f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.737+0000 7f38c219c700 1 -- 172.21.15.60:0/1099791786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38bc0aef10 msgr2=0x7f38bc129a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.737+0000 7f38c219c700 1 --2- 172.21.15.60:0/1099791786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38bc0aef10 0x7f38bc129a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.738+0000 7f38c219c700 1 -- 172.21.15.60:0/1099791786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38bc0b2150 msgr2=0x7f38bc150ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T04:28:27.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.738+0000 7f39197fa700 1 -- 172.21.15.60:0/995573405 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3914053660 con 0x7f391c0bf6f0 2023-10-06T04:28:27.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.738+0000 7f38c219c700 1 --2- 172.21.15.60:0/1099791786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38bc0b2150 0x7f38bc150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.738+0000 7f38c219c700 1 -- 172.21.15.60:0/1099791786 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac0094f0 con 0x7f38bc15a270 2023-10-06T04:28:27.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.738+0000 7f45ae39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45a00547c0 0x7f45a004df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.739+0000 7fd454ff9700 1 -- 172.21.15.60:0/431161320 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4480094e0 con 0x7fd4580b0760 2023-10-06T04:28:27.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.739+0000 7f45ae39d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45a00dc430 0x7f45a00da650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.739+0000 7f38c219c700 1 --2- 172.21.15.60:0/1099791786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38bc15a270 0x7f38bc14c3b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f38b400bb60 tx=0x7f38b4009810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.739+0000 7f45ad39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45a00547c0 0x7f45a004df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.739+0000 7f45ad39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45a00547c0 0x7f45a004df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:58886/0 (socket says 172.21.15.60:58886) 2023-10-06T04:28:27.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.739+0000 7f45acb9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45a00dc430 0x7f45a00da650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.739+0000 7f45acb9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45a00dc430 0x7f45a00da650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52184/0 (socket says 172.21.15.60:52184) 2023-10-06T04:28:27.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.740+0000 7f45ad39b700 1 -- 172.21.15.60:0/217695321 learned_addr learned my addr 172.21.15.60:0/217695321 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:27.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.740+0000 7f45ae39d700 1 --2- 172.21.15.60:0/217695321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a00e60a0 0x7f45a00ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.740+0000 7f38b1ffb700 1 -- 172.21.15.60:0/1099791786 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b400c940 con 0x7f38bc15a270 2023-10-06T04:28:27.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.740+0000 7f45ae39d700 1 -- 172.21.15.60:0/217695321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a004e850 con 0x7f45a00dc430 2023-10-06T04:28:27.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.740+0000 7f45ae39d700 1 -- 172.21.15.60:0/217695321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a004eb30 con 0x7f45a00547c0 2023-10-06T04:28:27.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.740+0000 7f45ae39d700 1 -- 172.21.15.60:0/217695321 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a004ee10 con 0x7f45a00e60a0 2023-10-06T04:28:27.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.740+0000 7f38b1ffb700 1 -- 172.21.15.60:0/1099791786 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b400caa0 con 0x7f38bc15a270 2023-10-06T04:28:27.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.740+0000 7f45adb9c700 1 --2- 172.21.15.60:0/217695321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a00e60a0 0x7f45a00ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.740+0000 7f38b1ffb700 1 -- 172.21.15.60:0/1099791786 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b400c940 con 0x7f38bc15a270 2023-10-06T04:28:27.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.741+0000 7f45ad39b700 1 -- 172.21.15.60:0/217695321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a00e60a0 msgr2=0x7f45a00ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.741+0000 7f45ad39b700 1 --2- 172.21.15.60:0/217695321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a00e60a0 0x7f45a00ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.741+0000 7f45ad39b700 1 -- 172.21.15.60:0/217695321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45a00dc430 msgr2=0x7f45a00da650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:27.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.741+0000 7f38c3bff700 1 -- 172.21.15.60:0/1099791786 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38bc14ca90 con 0x7f38bc15a270 2023-10-06T04:28:27.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.741+0000 7f38c3bff700 1 -- 172.21.15.60:0/1099791786 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38bc14d050 con 0x7f38bc15a270 2023-10-06T04:28:27.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.741+0000 7f45ad39b700 1 --2- 172.21.15.60:0/217695321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45a00dc430 0x7f45a00da650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:27.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.741+0000 7f45ad39b700 1 -- 172.21.15.60:0/217695321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a4009420 con 0x7f45a00547c0 2023-10-06T04:28:27.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.741+0000 7f45acb9a700 1 --2- 172.21.15.60:0/217695321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45a00dc430 0x7f45a00da650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:27.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.743+0000 7fd454ff9700 1 -- 172.21.15.60:0/431161320 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd448012ac0 con 0x7fd4580b0760 2023-10-06T04:28:27.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.743+0000 7fd454ff9700 1 -- 172.21.15.60:0/431161320 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448012e80 con 0x7fd4580b0760 2023-10-06T04:28:27.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.743+0000 7f38c3bff700 1 -- 172.21.15.60:0/1099791786 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38bc064a90 con 0x7f38bc15a270 2023-10-06T04:28:27.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.743+0000 7f45ad39b700 1 --2- 172.21.15.60:0/217695321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45a00547c0 0x7f45a004df50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f459800c560 tx=0x7f4598007f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.743+0000 7fd45f1ff700 1 -- 172.21.15.60:0/431161320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4580c5c10 con 0x7fd4580b0760 2023-10-06T04:28:27.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.744+0000 7fd45f1ff700 1 -- 172.21.15.60:0/431161320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4580ae1d0 con 0x7fd4580b0760 2023-10-06T04:28:27.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.745+0000 7f38b1ffb700 1 -- 172.21.15.60:0/1099791786 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f38b400cc10 con 0x7f38bc15a270 2023-10-06T04:28:27.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.746+0000 7f38b1ffb700 1 --2- 172.21.15.60:0/1099791786 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f38a0066ff0 0x7f38a00694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.746+0000 7f38b1ffb700 1 -- 172.21.15.60:0/1099791786 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f38b40844c0 con 0x7f38bc15a270 2023-10-06T04:28:27.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.747+0000 7f38c199b700 1 --2- 172.21.15.60:0/1099791786 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f38a0066ff0 0x7f38a00694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.748+0000 7fd454ff9700 1 -- 172.21.15.60:0/431161320 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd44801d630 con 0x7fd4580b0760 2023-10-06T04:28:27.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.749+0000 7f38c199b700 1 --2- 172.21.15.60:0/1099791786 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f38a0066ff0 0x7f38a00694a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f38ac0099b0 tx=0x7f38ac017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.748+0000 7f459d7fa700 1 -- 172.21.15.60:0/217695321 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598005b30 con 0x7f45a00547c0 2023-10-06T04:28:27.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.748+0000 7f459d7fa700 1 -- 172.21.15.60:0/217695321 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4598005c90 con 0x7f45a00547c0 2023-10-06T04:28:27.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.748+0000 7f459d7fa700 1 -- 172.21.15.60:0/217695321 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598004a40 con 0x7f45a00547c0 2023-10-06T04:28:27.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.749+0000 7f45ae39d700 1 -- 172.21.15.60:0/217695321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a804c960 con 0x7f45a00547c0 2023-10-06T04:28:27.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.750+0000 7f45ae39d700 1 -- 172.21.15.60:0/217695321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a004f3d0 con 0x7f45a00547c0 2023-10-06T04:28:27.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.749+0000 7fd44e7fc700 1 -- 172.21.15.60:0/431161320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd458064a90 con 0x7fd4580b0760 2023-10-06T04:28:27.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.750+0000 7fd454ff9700 1 --2- 172.21.15.60:0/431161320 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd438067080 0x7fd438069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.750+0000 7fd454ff9700 1 -- 172.21.15.60:0/431161320 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd448086090 con 0x7fd4580b0760 2023-10-06T04:28:27.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.750+0000 7f38b1ffb700 1 -- 172.21.15.60:0/1099791786 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f38b4051240 con 0x7f38bc15a270 2023-10-06T04:28:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.751+0000 7fd457fff700 1 --2- 172.21.15.60:0/431161320 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd438067080 0x7fd438069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.752+0000 7fd457fff700 1 --2- 172.21.15.60:0/431161320 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd438067080 0x7fd438069530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd440006fd0 tx=0x7fd440008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.752+0000 7f45ae39d700 1 -- 172.21.15.60:0/217695321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a00054e0 con 0x7f45a00547c0 2023-10-06T04:28:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.761+0000 7fd454ff9700 1 -- 172.21.15.60:0/431161320 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd448052e90 con 0x7fd4580b0760 2023-10-06T04:28:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.761+0000 7f459d7fa700 1 -- 172.21.15.60:0/217695321 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f45980070d0 con 0x7f45a00547c0 2023-10-06T04:28:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.763+0000 7f459d7fa700 1 --2- 172.21.15.60:0/217695321 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f458c067080 0x7f458c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.763+0000 7f459d7fa700 1 -- 172.21.15.60:0/217695321 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4598084470 con 0x7f45a00547c0 2023-10-06T04:28:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.763+0000 7f459d7fa700 1 -- 172.21.15.60:0/217695321 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4598084900 con 0x7f45a00547c0 2023-10-06T04:28:27.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.764+0000 7f45acb9a700 1 --2- 172.21.15.60:0/217695321 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f458c067080 0x7f458c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:27.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:27.766+0000 7f45acb9a700 1 --2- 172.21.15.60:0/217695321 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f458c067080 0x7f458c069530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f45a00d80d0 tx=0x7f45a4018040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:28.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.176+0000 7f216a7ff700 1 -- 172.21.15.60:0/3302879518 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2144005560 con 0x7f215c0e6340 2023-10-06T04:28:28.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.177+0000 7f664f39d700 1 -- 172.21.15.60:0/1159307134 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6630005560 con 0x7f664815d980 2023-10-06T04:28:28.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.177+0000 7f663e7fc700 1 -- 172.21.15.60:0/1159307134 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f66380551a0 con 0x7f664815d980 2023-10-06T04:28:28.180 INFO:teuthology.orchestra.run.smithi060.stdout:55834574855 2023-10-06T04:28:28.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.179+0000 7f214ffff700 1 -- 172.21.15.60:0/3302879518 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2158055370 con 0x7f215c0e6340 2023-10-06T04:28:28.182 INFO:teuthology.orchestra.run.smithi060.stdout:55834574856 2023-10-06T04:28:28.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.182+0000 7f662bfff700 1 -- 172.21.15.60:0/1159307134 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f662c067080 msgr2=0x7f662c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.182+0000 7f662bfff700 1 --2- 172.21.15.60:0/1159307134 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f662c067080 0x7f662c069530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f66440058d0 tx=0x7f6644007ac0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.182+0000 7f662bfff700 1 -- 172.21.15.60:0/1159307134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f664815d980 msgr2=0x7f66481563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.182+0000 7f662bfff700 1 --2- 172.21.15.60:0/1159307134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f664815d980 0x7f66481563b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f663800ea50 tx=0x7f66380091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.183+0000 7f216a7ff700 1 -- 172.21.15.60:0/3302879518 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2148067000 msgr2=0x7f21480694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.183+0000 7f216a7ff700 1 --2- 172.21.15.60:0/3302879518 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2148067000 0x7f21480694b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2150009740 tx=0x7f2150006c60 comp rx=0 tx=0).stop 2023-10-06T04:28:28.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.183+0000 7f216a7ff700 1 -- 172.21.15.60:0/3302879518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c0e6340 msgr2=0x7f215c04d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.183+0000 7f216a7ff700 1 --2- 172.21.15.60:0/3302879518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c0e6340 0x7f215c04d5c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f215800d8c0 tx=0x7f2158008040 comp rx=0 tx=0).stop 2023-10-06T04:28:28.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.183+0000 7f662bfff700 1 -- 172.21.15.60:0/1159307134 shutdown_connections 2023-10-06T04:28:28.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.183+0000 7f662bfff700 1 --2- 172.21.15.60:0/1159307134 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f662c067080 0x7f662c069530 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.183+0000 7f662bfff700 1 --2- 172.21.15.60:0/1159307134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66480c9fa0 0x7f664815c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.183+0000 7f662bfff700 1 --2- 172.21.15.60:0/1159307134 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f664815d980 0x7f66481563b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.183+0000 7f662bfff700 1 --2- 172.21.15.60:0/1159307134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f664815d5b0 0x7f664815ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.183+0000 7f662bfff700 1 -- 172.21.15.60:0/1159307134 >> 172.21.15.60:0/1159307134 conn(0x7f6648068080 msgr2=0x7f66480cac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:28.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.184+0000 7f216a7ff700 1 -- 172.21.15.60:0/3302879518 shutdown_connections 2023-10-06T04:28:28.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.184+0000 7f216a7ff700 1 --2- 172.21.15.60:0/3302879518 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2148067000 0x7f21480694b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.184+0000 7f216a7ff700 1 --2- 172.21.15.60:0/3302879518 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f215c0eae70 0x7f215c0e9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.184+0000 7f216a7ff700 1 --2- 172.21.15.60:0/3302879518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c038e80 0x7f215c0e1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.184+0000 7f216a7ff700 1 --2- 172.21.15.60:0/3302879518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c0e6340 0x7f215c04d5c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.184+0000 7f216a7ff700 1 -- 172.21.15.60:0/3302879518 >> 172.21.15.60:0/3302879518 conn(0x7f215c00f0b0 msgr2=0x7f215c054eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:28.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.184+0000 7f662bfff700 1 -- 172.21.15.60:0/1159307134 shutdown_connections 2023-10-06T04:28:28.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.184+0000 7f216a7ff700 1 -- 172.21.15.60:0/3302879518 shutdown_connections 2023-10-06T04:28:28.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.184+0000 7f216a7ff700 1 -- 172.21.15.60:0/3302879518 wait complete. 2023-10-06T04:28:28.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.184+0000 7f662bfff700 1 -- 172.21.15.60:0/1159307134 wait complete. 2023-10-06T04:28:28.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.185+0000 7f57b679d700 1 -- 172.21.15.60:0/787897878 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f57b006da00 con 0x7f579c004110 2023-10-06T04:28:28.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.186+0000 7f57a57fa700 1 -- 172.21.15.60:0/787897878 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f57ac0553a0 con 0x7f579c004110 2023-10-06T04:28:28.193 INFO:teuthology.orchestra.run.smithi060.stdout:55834574856 2023-10-06T04:28:28.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.187+0000 7fdeb9b9d700 1 -- 172.21.15.60:0/3057538696 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdeac0eab30 con 0x7fdeac006920 2023-10-06T04:28:28.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.189+0000 7fdeb0ff9700 1 -- 172.21.15.60:0/3057538696 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdeac0eab30 con 0x7fdeac006920 2023-10-06T04:28:28.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.189+0000 7f3922bff700 1 -- 172.21.15.60:0/995573405 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f391c064a90 con 0x7f391c0bf6f0 2023-10-06T04:28:28.194 INFO:teuthology.orchestra.run.smithi060.stdout:55834574856 2023-10-06T04:28:28.195 INFO:teuthology.orchestra.run.smithi060.stdout:55834574855 2023-10-06T04:28:28.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.190+0000 7f39197fa700 1 -- 172.21.15.60:0/995573405 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3914056c80 con 0x7f391c0bf6f0 2023-10-06T04:28:28.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.191+0000 7f57b679d700 1 -- 172.21.15.60:0/787897878 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5794067000 msgr2=0x7f57940694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.191+0000 7f57b679d700 1 --2- 172.21.15.60:0/787897878 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5794067000 0x7f57940694b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f57b014ad10 tx=0x7f57a8016000 comp rx=0 tx=0).stop 2023-10-06T04:28:28.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.191+0000 7f57b679d700 1 -- 172.21.15.60:0/787897878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f579c004110 msgr2=0x7f57b00c1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.191+0000 7f57b679d700 1 --2- 172.21.15.60:0/787897878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f579c004110 0x7f57b00c1b30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00d890 tx=0x7f57ac008040 comp rx=0 tx=0).stop 2023-10-06T04:28:28.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.192+0000 7f57b679d700 1 -- 172.21.15.60:0/787897878 shutdown_connections 2023-10-06T04:28:28.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.192+0000 7f57b679d700 1 --2- 172.21.15.60:0/787897878 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5794067000 0x7f57940694b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.192+0000 7f57b679d700 1 --2- 172.21.15.60:0/787897878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b00b1130 0x7f57b00b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.192+0000 7f57b679d700 1 --2- 172.21.15.60:0/787897878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f579c004110 0x7f57b00c1b30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.192+0000 7f57b679d700 1 --2- 172.21.15.60:0/787897878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57b0142420 0x7f57b0142890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.192+0000 7f57b679d700 1 -- 172.21.15.60:0/787897878 >> 172.21.15.60:0/787897878 conn(0x7f57b0068080 msgr2=0x7f57b0069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.193+0000 7fdeb9b9d700 1 -- 172.21.15.60:0/3057538696 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fde98067000 msgr2=0x7fde980694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.193+0000 7fdeb9b9d700 1 --2- 172.21.15.60:0/3057538696 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fde98067000 0x7fde980694b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdea00099b0 tx=0x7fdea0017000 comp rx=0 tx=0).stop 2023-10-06T04:28:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.193+0000 7fdeb9b9d700 1 -- 172.21.15.60:0/3057538696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeac006920 msgr2=0x7fdeac0d0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.193+0000 7fdeb9b9d700 1 --2- 172.21.15.60:0/3057538696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeac006920 0x7fdeac0d0e60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdeb404c820 tx=0x7fdeb4067350 comp rx=0 tx=0).stop 2023-10-06T04:28:28.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.193+0000 7fdeb9b9d700 1 -- 172.21.15.60:0/3057538696 shutdown_connections 2023-10-06T04:28:28.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.193+0000 7fdeb9b9d700 1 --2- 172.21.15.60:0/3057538696 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fde98067000 0x7fde980694b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.193+0000 7fdeb9b9d700 1 --2- 172.21.15.60:0/3057538696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeac006920 0x7fdeac0d0e60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.193+0000 7fdeb9b9d700 1 --2- 172.21.15.60:0/3057538696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdeac0ea190 0x7fdeac0fad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.193+0000 7fdeb9b9d700 1 --2- 172.21.15.60:0/3057538696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeac0e3e60 0x7fdeac0f6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.193+0000 7fdeb9b9d700 1 -- 172.21.15.60:0/3057538696 >> 172.21.15.60:0/3057538696 conn(0x7fdeac054c80 msgr2=0x7fdeac0dfaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:28.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.194+0000 7fdeb9b9d700 1 -- 172.21.15.60:0/3057538696 shutdown_connections 2023-10-06T04:28:28.202 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.194+0000 7fdeb9b9d700 1 -- 172.21.15.60:0/3057538696 wait complete. 2023-10-06T04:28:28.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.194+0000 7f3922bff700 1 -- 172.21.15.60:0/995573405 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f38fc066f30 msgr2=0x7f38fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.194+0000 7f3922bff700 1 --2- 172.21.15.60:0/995573405 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f38fc066f30 0x7f38fc0693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f390c0076f0 tx=0x7f390c0098f0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.204 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.194+0000 7f3922bff700 1 -- 172.21.15.60:0/995573405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f391c0bf6f0 msgr2=0x7f391c0c2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.194+0000 7f3922bff700 1 --2- 172.21.15.60:0/995573405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f391c0bf6f0 0x7f391c0c2340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f391c06ce60 tx=0x7f3914017000 comp rx=0 tx=0).stop 2023-10-06T04:28:28.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.195+0000 7f3922bff700 1 -- 172.21.15.60:0/995573405 shutdown_connections 2023-10-06T04:28:28.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.195+0000 7f3922bff700 1 --2- 172.21.15.60:0/995573405 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f38fc066f30 0x7f38fc0693e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.195+0000 7f3922bff700 1 --2- 172.21.15.60:0/995573405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f391c0bf6f0 0x7f391c0c2340 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.195+0000 7f3922bff700 1 --2- 172.21.15.60:0/995573405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f391c069a60 0x7f391c14c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.195+0000 7f3922bff700 1 --2- 172.21.15.60:0/995573405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f391c0bf320 0x7f391c0c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.195+0000 7f3922bff700 1 -- 172.21.15.60:0/995573405 >> 172.21.15.60:0/995573405 conn(0x7f391c068080 msgr2=0x7f391c0ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:28.206 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.195+0000 7f57b679d700 1 -- 172.21.15.60:0/787897878 shutdown_connections 2023-10-06T04:28:28.207 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.195+0000 7f3922bff700 1 -- 172.21.15.60:0/995573405 shutdown_connections 2023-10-06T04:28:28.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.195+0000 7f3922bff700 1 -- 172.21.15.60:0/995573405 wait complete. 2023-10-06T04:28:28.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.195+0000 7f57b679d700 1 -- 172.21.15.60:0/787897878 wait complete. 2023-10-06T04:28:28.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.204+0000 7f38c3bff700 1 -- 172.21.15.60:0/1099791786 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f38bc14d810 con 0x7f38bc15a270 2023-10-06T04:28:28.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.205+0000 7f38b1ffb700 1 -- 172.21.15.60:0/1099791786 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f38b4051240 con 0x7f38bc15a270 2023-10-06T04:28:28.210 INFO:teuthology.orchestra.run.smithi060.stdout:55834574856 2023-10-06T04:28:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.210+0000 7f38c3bff700 1 -- 172.21.15.60:0/1099791786 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f38a0066ff0 msgr2=0x7f38a00694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.210+0000 7f38c3bff700 1 --2- 172.21.15.60:0/1099791786 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f38a0066ff0 0x7f38a00694a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f38ac0099b0 tx=0x7f38ac017000 comp rx=0 tx=0).stop 2023-10-06T04:28:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.210+0000 7f38c3bff700 1 -- 172.21.15.60:0/1099791786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38bc15a270 msgr2=0x7f38bc14c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.210+0000 7f38c3bff700 1 --2- 172.21.15.60:0/1099791786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38bc15a270 0x7f38bc14c3b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f38b400bb60 tx=0x7f38b4009810 comp rx=0 tx=0).stop 2023-10-06T04:28:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.211+0000 7f38c3bff700 1 -- 172.21.15.60:0/1099791786 shutdown_connections 2023-10-06T04:28:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.211+0000 7f38c3bff700 1 --2- 172.21.15.60:0/1099791786 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f38a0066ff0 0x7f38a00694a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.211+0000 7f38c3bff700 1 --2- 172.21.15.60:0/1099791786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38bc15a270 0x7f38bc14c3b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.211+0000 7f38c3bff700 1 --2- 172.21.15.60:0/1099791786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38bc0aef10 0x7f38bc129a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.211+0000 7f38c3bff700 1 --2- 172.21.15.60:0/1099791786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38bc0b2150 0x7f38bc150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.211+0000 7f38c3bff700 1 -- 172.21.15.60:0/1099791786 >> 172.21.15.60:0/1099791786 conn(0x7f38bc06dcd0 msgr2=0x7f38bc069df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:28.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.211+0000 7f38c3bff700 1 -- 172.21.15.60:0/1099791786 shutdown_connections 2023-10-06T04:28:28.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.211+0000 7f38c3bff700 1 -- 172.21.15.60:0/1099791786 wait complete. 2023-10-06T04:28:28.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.213+0000 7fd44e7fc700 1 -- 172.21.15.60:0/431161320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd4580b17e0 con 0x7fd4580b0760 2023-10-06T04:28:28.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.214+0000 7fd454ff9700 1 -- 172.21.15.60:0/431161320 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd4480564b0 con 0x7fd4580b0760 2023-10-06T04:28:28.220 INFO:teuthology.orchestra.run.smithi060.stdout:55834574856 2023-10-06T04:28:28.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.219+0000 7f45ae39d700 1 -- 172.21.15.60:0/217695321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f45a0058b10 con 0x7f45a00547c0 2023-10-06T04:28:28.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2023-10-06T04:28:28.223 DEBUG:teuthology.parallel:result is None 2023-10-06T04:28:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.219+0000 7fd44e7fc700 1 -- 172.21.15.60:0/431161320 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd438067080 msgr2=0x7fd438069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.219+0000 7fd44e7fc700 1 --2- 172.21.15.60:0/431161320 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd438067080 0x7fd438069530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd440006fd0 tx=0x7fd440008040 comp rx=0 tx=0).stop 2023-10-06T04:28:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.220+0000 7fd44e7fc700 1 -- 172.21.15.60:0/431161320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4580b0760 msgr2=0x7fd4580c7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.220+0000 7fd44e7fc700 1 --2- 172.21.15.60:0/431161320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4580b0760 0x7fd4580c7420 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd4580b1360 tx=0x7fd448017000 comp rx=0 tx=0).stop 2023-10-06T04:28:28.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.220+0000 7f459d7fa700 1 -- 172.21.15.60:0/217695321 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f45980512f0 con 0x7f45a00547c0 2023-10-06T04:28:28.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.220+0000 7fd44e7fc700 1 -- 172.21.15.60:0/431161320 shutdown_connections 2023-10-06T04:28:28.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.220+0000 7fd44e7fc700 1 --2- 172.21.15.60:0/431161320 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd438067080 0x7fd438069530 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.220+0000 7fd44e7fc700 1 --2- 172.21.15.60:0/431161320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4580b0760 0x7fd4580c7420 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.220+0000 7fd44e7fc700 1 --2- 172.21.15.60:0/431161320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd458159560 0x7fd45809d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.220+0000 7fd44e7fc700 1 --2- 172.21.15.60:0/431161320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4580b49a0 0x7fd4580c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.220+0000 7fd44e7fc700 1 -- 172.21.15.60:0/431161320 >> 172.21.15.60:0/431161320 conn(0x7fd4580997f0 msgr2=0x7fd4580b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:28.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.220+0000 7fd44e7fc700 1 -- 172.21.15.60:0/431161320 shutdown_connections 2023-10-06T04:28:28.227 INFO:teuthology.orchestra.run.smithi060.stdout:55834574855 2023-10-06T04:28:28.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.220+0000 7fd44e7fc700 1 -- 172.21.15.60:0/431161320 wait complete. 2023-10-06T04:28:28.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-10-06T04:28:28.229 DEBUG:teuthology.parallel:result is None 2023-10-06T04:28:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.224+0000 7f45ae39d700 1 -- 172.21.15.60:0/217695321 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f458c067080 msgr2=0x7f458c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.224+0000 7f45ae39d700 1 --2- 172.21.15.60:0/217695321 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f458c067080 0x7f458c069530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f45a00d80d0 tx=0x7f45a4018040 comp rx=0 tx=0).stop 2023-10-06T04:28:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.224+0000 7f45ae39d700 1 -- 172.21.15.60:0/217695321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45a00547c0 msgr2=0x7f45a004df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.224+0000 7f45ae39d700 1 --2- 172.21.15.60:0/217695321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45a00547c0 0x7f45a004df50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f459800c560 tx=0x7f4598007f70 comp rx=0 tx=0).stop 2023-10-06T04:28:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.224+0000 7f45ae39d700 1 -- 172.21.15.60:0/217695321 shutdown_connections 2023-10-06T04:28:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.224+0000 7f45ae39d700 1 --2- 172.21.15.60:0/217695321 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f458c067080 0x7f458c069530 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.224+0000 7f45ae39d700 1 --2- 172.21.15.60:0/217695321 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f45a00e60a0 0x7f45a00ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.224+0000 7f45ae39d700 1 --2- 172.21.15.60:0/217695321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45a00547c0 0x7f45a004df50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.224+0000 7f45ae39d700 1 --2- 172.21.15.60:0/217695321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45a00dc430 0x7f45a00da650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.224+0000 7f45ae39d700 1 -- 172.21.15.60:0/217695321 >> 172.21.15.60:0/217695321 conn(0x7f45a000e7c0 msgr2=0x7f45a00e6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.224+0000 7f45ae39d700 1 -- 172.21.15.60:0/217695321 shutdown_connections 2023-10-06T04:28:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.224+0000 7f45ae39d700 1 -- 172.21.15.60:0/217695321 wait complete. 2023-10-06T04:28:28.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-10-06T04:28:28.232 DEBUG:teuthology.parallel:result is None 2023-10-06T04:28:28.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2023-10-06T04:28:28.235 DEBUG:teuthology.parallel:result is None 2023-10-06T04:28:28.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-10-06T04:28:28.236 DEBUG:teuthology.parallel:result is None 2023-10-06T04:28:28.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2023-10-06T04:28:28.241 DEBUG:teuthology.parallel:result is None 2023-10-06T04:28:28.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2023-10-06T04:28:28.254 DEBUG:teuthology.parallel:result is None 2023-10-06T04:28:28.255 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-10-06T04:28:28.255 DEBUG:teuthology.parallel:result is None 2023-10-06T04:28:28.256 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T04:28:28.256 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:28:28.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.481+0000 7fb14d5ff700 1 Processor -- start 2023-10-06T04:28:28.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.481+0000 7fb14d5ff700 1 -- start start 2023-10-06T04:28:28.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.482+0000 7fb14d5ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb148159580 0x7fb14806e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:28.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.482+0000 7fb14d5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb148067cc0 0x7fb1480b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:28.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.482+0000 7fb14d5ff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1480cde30 con 0x7fb14806e9a0 2023-10-06T04:28:28.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.482+0000 7fb14d5ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb14806ef20 con 0x7fb148159580 2023-10-06T04:28:28.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.482+0000 7fb14d5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14806f200 con 0x7fb148067cc0 2023-10-06T04:28:28.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.482+0000 7fb1467fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb14806e9a0 0x7fb1480675b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57044/0 (socket says 172.21.15.60:57044) 2023-10-06T04:28:28.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.482+0000 7fb1467fc700 1 -- 172.21.15.60:0/2626936842 learned_addr learned my addr 172.21.15.60:0/2626936842 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:28.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.483+0000 7fb1477fe700 1 --2- 172.21.15.60:0/2626936842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb148067cc0 0x7fb1480b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:28.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.483+0000 7fb146ffd700 1 --2- 172.21.15.60:0/2626936842 >> v2:172.21.15.135:3300/0 conn(0x7fb148159580 0x7fb14806e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:28.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.483+0000 7fb145ffb700 1 -- 172.21.15.60:0/2626936842 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809333752 0 0) 0x7fb1480cde30 con 0x7fb14806e9a0 2023-10-06T04:28:28.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.483+0000 7fb145ffb700 1 -- 172.21.15.60:0/2626936842 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb130003570 con 0x7fb14806e9a0 2023-10-06T04:28:28.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.483+0000 7fb145ffb700 1 -- 172.21.15.60:0/2626936842 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1536305522 0 0) 0x7fb130003570 con 0x7fb14806e9a0 2023-10-06T04:28:28.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.483+0000 7fb145ffb700 1 -- 172.21.15.60:0/2626936842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb148067cc0 msgr2=0x7fb1480b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:28.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.483+0000 7fb145ffb700 1 --2- 172.21.15.60:0/2626936842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb148067cc0 0x7fb1480b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.483+0000 7fb145ffb700 1 -- 172.21.15.60:0/2626936842 >> v2:172.21.15.135:3300/0 conn(0x7fb148159580 msgr2=0x7fb14806e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:28.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.483+0000 7fb145ffb700 1 --2- 172.21.15.60:0/2626936842 >> v2:172.21.15.135:3300/0 conn(0x7fb148159580 0x7fb14806e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.483+0000 7fb145ffb700 1 -- 172.21.15.60:0/2626936842 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1480b0150 con 0x7fb14806e9a0 2023-10-06T04:28:28.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.483+0000 7fb145ffb700 1 -- 172.21.15.60:0/2626936842 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7fb13c001470 con 0x7fb14806e9a0 2023-10-06T04:28:28.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.483+0000 7fb145ffb700 1 -- 172.21.15.60:0/2626936842 >> v1:172.21.15.60:6789/0 conn(0x7fb14806e9a0 legacy=0x7fb1480675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.483+0000 7fb145ffb700 1 --2- 172.21.15.60:0/2626936842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb130003ae0 0x7fb130003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:28.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.483+0000 7fb145ffb700 1 --2- 172.21.15.60:0/2626936842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb130004810 0x7fb130004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:28.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.483+0000 7fb145ffb700 1 --2- 172.21.15.60:0/2626936842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb148067cc0 0x7fb1300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:28.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.483+0000 7fb145ffb700 1 -- 172.21.15.60:0/2626936842 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14806ef20 con 0x7fb130003ae0 2023-10-06T04:28:28.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.483+0000 7fb145ffb700 1 -- 172.21.15.60:0/2626936842 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14806f200 con 0x7fb130004810 2023-10-06T04:28:28.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.483+0000 7fb145ffb700 1 -- 172.21.15.60:0/2626936842 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13000bb10 con 0x7fb148067cc0 2023-10-06T04:28:28.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.483+0000 7fb146ffd700 1 --2- 172.21.15.60:0/2626936842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb130003ae0 0x7fb130003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:28.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.484+0000 7fb1467fc700 1 --2- 172.21.15.60:0/2626936842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb130004810 0x7fb130004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:28.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.484+0000 7fb1477fe700 1 --2- 172.21.15.60:0/2626936842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb148067cc0 0x7fb1300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:28.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.484+0000 7fb146ffd700 1 -- 172.21.15.60:0/2626936842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb148067cc0 msgr2=0x7fb1300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:28.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.484+0000 7fb146ffd700 1 --2- 172.21.15.60:0/2626936842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb148067cc0 0x7fb1300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.484+0000 7fb146ffd700 1 -- 172.21.15.60:0/2626936842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb130004810 msgr2=0x7fb130004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:28.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.484+0000 7fb146ffd700 1 --2- 172.21.15.60:0/2626936842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb130004810 0x7fb130004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.484+0000 7fb146ffd700 1 -- 172.21.15.60:0/2626936842 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb130003570 con 0x7fb130003ae0 2023-10-06T04:28:28.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.484+0000 7fb1467fc700 1 --2- 172.21.15.60:0/2626936842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb130004810 0x7fb130004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:28.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.484+0000 7fb146ffd700 1 --2- 172.21.15.60:0/2626936842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb130003ae0 0x7fb130003ef0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb138009c00 tx=0x7fb1380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c690d35d821c896 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:28.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.484+0000 7fb145ffb700 1 -- 172.21.15.60:0/2626936842 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13800e710 con 0x7fb130003ae0 2023-10-06T04:28:28.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.484+0000 7fb145ffb700 1 -- 172.21.15.60:0/2626936842 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13800e870 con 0x7fb130003ae0 2023-10-06T04:28:28.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.484+0000 7fb145ffb700 1 -- 172.21.15.60:0/2626936842 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13800ec30 con 0x7fb130003ae0 2023-10-06T04:28:28.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.485+0000 7fb14d5ff700 1 -- 172.21.15.60:0/2626936842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb130003ae0 msgr2=0x7fb130003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.485+0000 7fb14d5ff700 1 --2- 172.21.15.60:0/2626936842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb130003ae0 0x7fb130003ef0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb138009c00 tx=0x7fb1380091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.485+0000 7fb1477fe700 1 -- 172.21.15.60:0/2626936842 reap_dead start 2023-10-06T04:28:28.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.485+0000 7fb14d5ff700 1 -- 172.21.15.60:0/2626936842 shutdown_connections 2023-10-06T04:28:28.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.485+0000 7fb14d5ff700 1 -- 172.21.15.60:0/2626936842 >> 172.21.15.60:0/2626936842 conn(0x7fb148069140 msgr2=0x7fb1480cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:28.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.485+0000 7fb14d5ff700 1 -- 172.21.15.60:0/2626936842 shutdown_connections 2023-10-06T04:28:28.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.485+0000 7fb14d5ff700 1 -- 172.21.15.60:0/2626936842 wait complete. 2023-10-06T04:28:28.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.486+0000 7fb14d5ff700 1 Processor -- start 2023-10-06T04:28:28.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.487+0000 7fb14d5ff700 1 -- start start 2023-10-06T04:28:28.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.488+0000 7fb14d5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb130003ae0 0x7fb1480c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:28.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.488+0000 7fb14d5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1481577c0 0x7fb1480ab7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:28.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.488+0000 7fb14d5ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb148157c30 0x7fb1480abd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:28.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.488+0000 7fb14d5ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14816a860 con 0x7fb148157c30 2023-10-06T04:28:28.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.488+0000 7fb14d5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1480c8130 con 0x7fb1481577c0 2023-10-06T04:28:28.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.488+0000 7fb14d5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1481699c0 con 0x7fb130003ae0 2023-10-06T04:28:28.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.488+0000 7fb1477fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb148157c30 0x7fb1480abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:28.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.488+0000 7fb1477fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb148157c30 0x7fb1480abd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52202/0 (socket says 172.21.15.60:52202) 2023-10-06T04:28:28.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.488+0000 7fb1477fe700 1 -- 172.21.15.60:0/2902927944 learned_addr learned my addr 172.21.15.60:0/2902927944 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:28.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.488+0000 7fb146ffd700 1 --2- 172.21.15.60:0/2902927944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb130003ae0 0x7fb1480c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:28.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.488+0000 7fb1467fc700 1 --2- 172.21.15.60:0/2902927944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1481577c0 0x7fb1480ab7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:28.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.488+0000 7fb1477fe700 1 -- 172.21.15.60:0/2902927944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb130003ae0 msgr2=0x7fb1480c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.488+0000 7fb1477fe700 1 --2- 172.21.15.60:0/2902927944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb130003ae0 0x7fb1480c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.488+0000 7fb1477fe700 1 -- 172.21.15.60:0/2902927944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1481577c0 msgr2=0x7fb1480ab7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.488+0000 7fb1477fe700 1 --2- 172.21.15.60:0/2902927944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1481577c0 0x7fb1480ab7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.488+0000 7fb1477fe700 1 -- 172.21.15.60:0/2902927944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb148169c50 con 0x7fb148157c30 2023-10-06T04:28:28.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.488+0000 7fb1477fe700 1 --2- 172.21.15.60:0/2902927944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb148157c30 0x7fb1480abd20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb1480cacc0 tx=0x7fb14000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:28.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.489+0000 7fb12effd700 1 -- 172.21.15.60:0/2902927944 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14000e070 con 0x7fb148157c30 2023-10-06T04:28:28.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.489+0000 7fb12effd700 1 -- 172.21.15.60:0/2902927944 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb140011d00 con 0x7fb148157c30 2023-10-06T04:28:28.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.489+0000 7fb14d5ff700 1 -- 172.21.15.60:0/2902927944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb148169f30 con 0x7fb148157c30 2023-10-06T04:28:28.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.489+0000 7fb12effd700 1 -- 172.21.15.60:0/2902927944 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1400166e0 con 0x7fb148157c30 2023-10-06T04:28:28.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.489+0000 7fb14d5ff700 1 -- 172.21.15.60:0/2902927944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14816a4f0 con 0x7fb148157c30 2023-10-06T04:28:28.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.490+0000 7fb14d5ff700 1 -- 172.21.15.60:0/2902927944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14816a9a0 con 0x7fb148157c30 2023-10-06T04:28:28.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.491+0000 7fb12effd700 1 -- 172.21.15.60:0/2902927944 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb140016ad0 con 0x7fb148157c30 2023-10-06T04:28:28.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.492+0000 7fb12effd700 1 --2- 172.21.15.60:0/2902927944 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb134066f30 0x7fb1340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:28.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.492+0000 7fb12effd700 1 -- 172.21.15.60:0/2902927944 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb140085770 con 0x7fb148157c30 2023-10-06T04:28:28.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.492+0000 7fb146ffd700 1 --2- 172.21.15.60:0/2902927944 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb134066f30 0x7fb1340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:28.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.493+0000 7fb146ffd700 1 --2- 172.21.15.60:0/2902927944 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb134066f30 0x7fb1340693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb1380091e0 tx=0x7fb13801a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:28.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.496+0000 7fb12effd700 1 -- 172.21.15.60:0/2902927944 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb14816a9a0 con 0x7fb148157c30 2023-10-06T04:28:28.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.695+0000 7fb14d5ff700 1 -- 172.21.15.60:0/2902927944 --> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb14816a9a0 con 0x7fb134066f30 2023-10-06T04:28:28.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.706+0000 7fb12effd700 1 -- 172.21.15.60:0/2902927944 <== mgr.4098 v2:172.21.15.60:6832/85285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367621 (secure 0 0 0) 0x7fb14816a9a0 con 0x7fb134066f30 2023-10-06T04:28:28.714 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:28.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.711+0000 7fb14d5ff700 1 -- 172.21.15.60:0/2902927944 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb134066f30 msgr2=0x7fb1340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.711+0000 7fb14d5ff700 1 --2- 172.21.15.60:0/2902927944 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb134066f30 0x7fb1340693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb1380091e0 tx=0x7fb13801a000 comp rx=0 tx=0).stop 2023-10-06T04:28:28.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.711+0000 7fb14d5ff700 1 -- 172.21.15.60:0/2902927944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb148157c30 msgr2=0x7fb1480abd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.711+0000 7fb14d5ff700 1 --2- 172.21.15.60:0/2902927944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb148157c30 0x7fb1480abd20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb1480cacc0 tx=0x7fb14000b040 comp rx=0 tx=0).stop 2023-10-06T04:28:28.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.711+0000 7fb14d5ff700 1 -- 172.21.15.60:0/2902927944 shutdown_connections 2023-10-06T04:28:28.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.711+0000 7fb14d5ff700 1 --2- 172.21.15.60:0/2902927944 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb134066f30 0x7fb1340693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.711+0000 7fb14d5ff700 1 --2- 172.21.15.60:0/2902927944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb148157c30 0x7fb1480abd20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.711+0000 7fb14d5ff700 1 --2- 172.21.15.60:0/2902927944 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb130003ae0 0x7fb1480c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.711+0000 7fb14d5ff700 1 --2- 172.21.15.60:0/2902927944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1481577c0 0x7fb1480ab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.711+0000 7fb14d5ff700 1 -- 172.21.15.60:0/2902927944 >> 172.21.15.60:0/2902927944 conn(0x7fb148069140 msgr2=0x7fb1480c9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:28.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.711+0000 7fb14d5ff700 1 -- 172.21.15.60:0/2902927944 shutdown_connections 2023-10-06T04:28:28.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.711+0000 7fb14d5ff700 1 -- 172.21.15.60:0/2902927944 wait complete. 2023-10-06T04:28:28.718 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-06T04:28:28.733 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-10-06T04:28:27.314710+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397972,"kb_used_data":3284,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752576748,"statfs":{"total":773094113280,"available":770638589952,"internally_reserved":0,"allocated":3362816,"data_stored":2060478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002651"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.767703+0000","last_change":"2023-10-06T04:28:06.333183+0000","last_active":"2023-10-06T04:28:10.767703+0000","last_peered":"2023-10-06T04:28:10.767703+0000","last_clean":"2023-10-06T04:28:10.767703+0000","last_became_active":"2023-10-06T04:28:06.332860+0000","last_became_peered":"2023-10-06T04:28:06.332860+0000","last_unstale":"2023-10-06T04:28:10.767703+0000","last_undegraded":"2023-10-06T04:28:10.767703+0000","last_fullsized":"2023-10-06T04:28:10.767703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:32.786074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.778681+0000","last_change":"2023-10-06T04:28:06.344458+0000","last_active":"2023-10-06T04:28:10.778681+0000","last_peered":"2023-10-06T04:28:10.778681+0000","last_clean":"2023-10-06T04:28:10.778681+0000","last_became_active":"2023-10-06T04:28:06.344197+0000","last_became_peered":"2023-10-06T04:28:06.344197+0000","last_unstale":"2023-10-06T04:28:10.778681+0000","last_undegraded":"2023-10-06T04:28:10.778681+0000","last_fullsized":"2023-10-06T04:28:10.778681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:34.925929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769634+0000","last_change":"2023-10-06T04:28:06.349096+0000","last_active":"2023-10-06T04:28:10.769634+0000","last_peered":"2023-10-06T04:28:10.769634+0000","last_clean":"2023-10-06T04:28:10.769634+0000","last_became_active":"2023-10-06T04:28:06.348569+0000","last_became_peered":"2023-10-06T04:28:06.348569+0000","last_unstale":"2023-10-06T04:28:10.769634+0000","last_undegraded":"2023-10-06T04:28:10.769634+0000","last_fullsized":"2023-10-06T04:28:10.769634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:32.246348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768718+0000","last_change":"2023-10-06T04:28:06.343369+0000","last_active":"2023-10-06T04:28:10.768718+0000","last_peered":"2023-10-06T04:28:10.768718+0000","last_clean":"2023-10-06T04:28:10.768718+0000","last_became_active":"2023-10-06T04:28:06.342720+0000","last_became_peered":"2023-10-06T04:28:06.342720+0000","last_unstale":"2023-10-06T04:28:10.768718+0000","last_undegraded":"2023-10-06T04:28:10.768718+0000","last_fullsized":"2023-10-06T04:28:10.768718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:25.121736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772088+0000","last_change":"2023-10-06T04:28:06.340210+0000","last_active":"2023-10-06T04:28:10.772088+0000","last_peered":"2023-10-06T04:28:10.772088+0000","last_clean":"2023-10-06T04:28:10.772088+0000","last_became_active":"2023-10-06T04:28:06.339725+0000","last_became_peered":"2023-10-06T04:28:06.339725+0000","last_unstale":"2023-10-06T04:28:10.772088+0000","last_undegraded":"2023-10-06T04:28:10.772088+0000","last_fullsized":"2023-10-06T04:28:10.772088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:59.952485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770264+0000","last_change":"2023-10-06T04:28:06.348877+0000","last_active":"2023-10-06T04:28:10.770264+0000","last_peered":"2023-10-06T04:28:10.770264+0000","last_clean":"2023-10-06T04:28:10.770264+0000","last_became_active":"2023-10-06T04:28:06.348593+0000","last_became_peered":"2023-10-06T04:28:06.348593+0000","last_unstale":"2023-10-06T04:28:10.770264+0000","last_undegraded":"2023-10-06T04:28:10.770264+0000","last_fullsized":"2023-10-06T04:28:10.770264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:58.373238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774127+0000","last_change":"2023-10-06T04:28:06.341608+0000","last_active":"2023-10-06T04:28:10.774127+0000","last_peered":"2023-10-06T04:28:10.774127+0000","last_clean":"2023-10-06T04:28:10.774127+0000","last_became_active":"2023-10-06T04:28:06.341341+0000","last_became_peered":"2023-10-06T04:28:06.341341+0000","last_unstale":"2023-10-06T04:28:10.774127+0000","last_undegraded":"2023-10-06T04:28:10.774127+0000","last_fullsized":"2023-10-06T04:28:10.774127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:25.299896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.775047+0000","last_change":"2023-10-06T04:28:06.352230+0000","last_active":"2023-10-06T04:28:10.775047+0000","last_peered":"2023-10-06T04:28:10.775047+0000","last_clean":"2023-10-06T04:28:10.775047+0000","last_became_active":"2023-10-06T04:28:06.351946+0000","last_became_peered":"2023-10-06T04:28:06.351946+0000","last_unstale":"2023-10-06T04:28:10.775047+0000","last_undegraded":"2023-10-06T04:28:10.775047+0000","last_fullsized":"2023-10-06T04:28:10.775047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:39.187212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769280+0000","last_change":"2023-10-06T04:28:06.349388+0000","last_active":"2023-10-06T04:28:10.769280+0000","last_peered":"2023-10-06T04:28:10.769280+0000","last_clean":"2023-10-06T04:28:10.769280+0000","last_became_active":"2023-10-06T04:28:06.349059+0000","last_became_peered":"2023-10-06T04:28:06.349059+0000","last_unstale":"2023-10-06T04:28:10.769280+0000","last_undegraded":"2023-10-06T04:28:10.769280+0000","last_fullsized":"2023-10-06T04:28:10.769280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:17.928102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.778830+0000","last_change":"2023-10-06T04:28:06.346835+0000","last_active":"2023-10-06T04:28:10.778830+0000","last_peered":"2023-10-06T04:28:10.778830+0000","last_clean":"2023-10-06T04:28:10.778830+0000","last_became_active":"2023-10-06T04:28:06.346555+0000","last_became_peered":"2023-10-06T04:28:06.346555+0000","last_unstale":"2023-10-06T04:28:10.778830+0000","last_undegraded":"2023-10-06T04:28:10.778830+0000","last_fullsized":"2023-10-06T04:28:10.778830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:27.073025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769556+0000","last_change":"2023-10-06T04:28:06.349715+0000","last_active":"2023-10-06T04:28:10.769556+0000","last_peered":"2023-10-06T04:28:10.769556+0000","last_clean":"2023-10-06T04:28:10.769556+0000","last_became_active":"2023-10-06T04:28:06.347463+0000","last_became_peered":"2023-10-06T04:28:06.347463+0000","last_unstale":"2023-10-06T04:28:10.769556+0000","last_undegraded":"2023-10-06T04:28:10.769556+0000","last_fullsized":"2023-10-06T04:28:10.769556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:20.864954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.766598+0000","last_change":"2023-10-06T04:28:06.352759+0000","last_active":"2023-10-06T04:28:10.766598+0000","last_peered":"2023-10-06T04:28:10.766598+0000","last_clean":"2023-10-06T04:28:10.766598+0000","last_became_active":"2023-10-06T04:28:06.352427+0000","last_became_peered":"2023-10-06T04:28:06.352427+0000","last_unstale":"2023-10-06T04:28:10.766598+0000","last_undegraded":"2023-10-06T04:28:10.766598+0000","last_fullsized":"2023-10-06T04:28:10.766598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:14.134133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768223+0000","last_change":"2023-10-06T04:28:06.331950+0000","last_active":"2023-10-06T04:28:10.768223+0000","last_peered":"2023-10-06T04:28:10.768223+0000","last_clean":"2023-10-06T04:28:10.768223+0000","last_became_active":"2023-10-06T04:28:06.331660+0000","last_became_peered":"2023-10-06T04:28:06.331660+0000","last_unstale":"2023-10-06T04:28:10.768223+0000","last_undegraded":"2023-10-06T04:28:10.768223+0000","last_fullsized":"2023-10-06T04:28:10.768223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:01:34.147816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.775071+0000","last_change":"2023-10-06T04:28:06.344093+0000","last_active":"2023-10-06T04:28:10.775071+0000","last_peered":"2023-10-06T04:28:10.775071+0000","last_clean":"2023-10-06T04:28:10.775071+0000","last_became_active":"2023-10-06T04:28:06.343647+0000","last_became_peered":"2023-10-06T04:28:06.343647+0000","last_unstale":"2023-10-06T04:28:10.775071+0000","last_undegraded":"2023-10-06T04:28:10.775071+0000","last_fullsized":"2023-10-06T04:28:10.775071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:25.299896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.773879+0000","last_change":"2023-10-06T04:28:06.341653+0000","last_active":"2023-10-06T04:28:10.773879+0000","last_peered":"2023-10-06T04:28:10.773879+0000","last_clean":"2023-10-06T04:28:10.773879+0000","last_became_active":"2023-10-06T04:28:06.341377+0000","last_became_peered":"2023-10-06T04:28:06.341377+0000","last_unstale":"2023-10-06T04:28:10.773879+0000","last_undegraded":"2023-10-06T04:28:10.773879+0000","last_fullsized":"2023-10-06T04:28:10.773879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:15.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770685+0000","last_change":"2023-10-06T04:28:06.348854+0000","last_active":"2023-10-06T04:28:10.770685+0000","last_peered":"2023-10-06T04:28:10.770685+0000","last_clean":"2023-10-06T04:28:10.770685+0000","last_became_active":"2023-10-06T04:28:06.348503+0000","last_became_peered":"2023-10-06T04:28:06.348503+0000","last_unstale":"2023-10-06T04:28:10.770685+0000","last_undegraded":"2023-10-06T04:28:10.770685+0000","last_fullsized":"2023-10-06T04:28:10.770685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:28.999532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769974+0000","last_change":"2023-10-06T04:28:06.344544+0000","last_active":"2023-10-06T04:28:10.769974+0000","last_peered":"2023-10-06T04:28:10.769974+0000","last_clean":"2023-10-06T04:28:10.769974+0000","last_became_active":"2023-10-06T04:28:06.342776+0000","last_became_peered":"2023-10-06T04:28:06.342776+0000","last_unstale":"2023-10-06T04:28:10.769974+0000","last_undegraded":"2023-10-06T04:28:10.769974+0000","last_fullsized":"2023-10-06T04:28:10.769974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:14.542716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769109+0000","last_change":"2023-10-06T04:28:06.352912+0000","last_active":"2023-10-06T04:28:10.769109+0000","last_peered":"2023-10-06T04:28:10.769109+0000","last_clean":"2023-10-06T04:28:10.769109+0000","last_became_active":"2023-10-06T04:28:06.352449+0000","last_became_peered":"2023-10-06T04:28:06.352449+0000","last_unstale":"2023-10-06T04:28:10.769109+0000","last_undegraded":"2023-10-06T04:28:10.769109+0000","last_fullsized":"2023-10-06T04:28:10.769109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:07.389056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768234+0000","last_change":"2023-10-06T04:28:06.339688+0000","last_active":"2023-10-06T04:28:10.768234+0000","last_peered":"2023-10-06T04:28:10.768234+0000","last_clean":"2023-10-06T04:28:10.768234+0000","last_became_active":"2023-10-06T04:28:06.339427+0000","last_became_peered":"2023-10-06T04:28:06.339427+0000","last_unstale":"2023-10-06T04:28:10.768234+0000","last_undegraded":"2023-10-06T04:28:10.768234+0000","last_fullsized":"2023-10-06T04:28:10.768234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:25.189214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771104+0000","last_change":"2023-10-06T04:28:06.351544+0000","last_active":"2023-10-06T04:28:10.771104+0000","last_peered":"2023-10-06T04:28:10.771104+0000","last_clean":"2023-10-06T04:28:10.771104+0000","last_became_active":"2023-10-06T04:28:06.351250+0000","last_became_peered":"2023-10-06T04:28:06.351250+0000","last_unstale":"2023-10-06T04:28:10.771104+0000","last_undegraded":"2023-10-06T04:28:10.771104+0000","last_fullsized":"2023-10-06T04:28:10.771104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:20.083329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776616+0000","last_change":"2023-10-06T04:28:06.339922+0000","last_active":"2023-10-06T04:28:10.776616+0000","last_peered":"2023-10-06T04:28:10.776616+0000","last_clean":"2023-10-06T04:28:10.776616+0000","last_became_active":"2023-10-06T04:28:06.339645+0000","last_became_peered":"2023-10-06T04:28:06.339645+0000","last_unstale":"2023-10-06T04:28:10.776616+0000","last_undegraded":"2023-10-06T04:28:10.776616+0000","last_fullsized":"2023-10-06T04:28:10.776616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:34.925929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769587+0000","last_change":"2023-10-06T04:28:06.340838+0000","last_active":"2023-10-06T04:28:10.769587+0000","last_peered":"2023-10-06T04:28:10.769587+0000","last_clean":"2023-10-06T04:28:10.769587+0000","last_became_active":"2023-10-06T04:28:06.340585+0000","last_became_peered":"2023-10-06T04:28:06.340585+0000","last_unstale":"2023-10-06T04:28:10.769587+0000","last_undegraded":"2023-10-06T04:28:10.769587+0000","last_fullsized":"2023-10-06T04:28:10.769587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:15.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772671+0000","last_change":"2023-10-06T04:28:06.341897+0000","last_active":"2023-10-06T04:28:10.772671+0000","last_peered":"2023-10-06T04:28:10.772671+0000","last_clean":"2023-10-06T04:28:10.772671+0000","last_became_active":"2023-10-06T04:28:06.341660+0000","last_became_peered":"2023-10-06T04:28:06.341660+0000","last_unstale":"2023-10-06T04:28:10.772671+0000","last_undegraded":"2023-10-06T04:28:10.772671+0000","last_fullsized":"2023-10-06T04:28:10.772671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:20.864954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.777630+0000","last_change":"2023-10-06T04:28:06.351307+0000","last_active":"2023-10-06T04:28:10.777630+0000","last_peered":"2023-10-06T04:28:10.777630+0000","last_clean":"2023-10-06T04:28:10.777630+0000","last_became_active":"2023-10-06T04:28:06.351018+0000","last_became_peered":"2023-10-06T04:28:06.351018+0000","last_unstale":"2023-10-06T04:28:10.777630+0000","last_undegraded":"2023-10-06T04:28:10.777630+0000","last_fullsized":"2023-10-06T04:28:10.777630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:39.187212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.773769+0000","last_change":"2023-10-06T04:28:06.335571+0000","last_active":"2023-10-06T04:28:10.773769+0000","last_peered":"2023-10-06T04:28:10.773769+0000","last_clean":"2023-10-06T04:28:10.773769+0000","last_became_active":"2023-10-06T04:28:06.335306+0000","last_became_peered":"2023-10-06T04:28:06.335306+0000","last_unstale":"2023-10-06T04:28:10.773769+0000","last_undegraded":"2023-10-06T04:28:10.773769+0000","last_fullsized":"2023-10-06T04:28:10.773769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:13.160015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.781232+0000","last_change":"2023-10-06T04:28:06.334344+0000","last_active":"2023-10-06T04:28:10.781232+0000","last_peered":"2023-10-06T04:28:10.781232+0000","last_clean":"2023-10-06T04:28:10.781232+0000","last_became_active":"2023-10-06T04:28:06.334085+0000","last_became_peered":"2023-10-06T04:28:06.334085+0000","last_unstale":"2023-10-06T04:28:10.781232+0000","last_undegraded":"2023-10-06T04:28:10.781232+0000","last_fullsized":"2023-10-06T04:28:10.781232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:30.857061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779760+0000","last_change":"2023-10-06T04:28:06.347690+0000","last_active":"2023-10-06T04:28:10.779760+0000","last_peered":"2023-10-06T04:28:10.779760+0000","last_clean":"2023-10-06T04:28:10.779760+0000","last_became_active":"2023-10-06T04:28:06.347352+0000","last_became_peered":"2023-10-06T04:28:06.347352+0000","last_unstale":"2023-10-06T04:28:10.779760+0000","last_undegraded":"2023-10-06T04:28:10.779760+0000","last_fullsized":"2023-10-06T04:28:10.779760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:15.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802995+0000","last_change":"2023-10-06T04:28:10.801453+0000","last_active":"2023-10-06T04:28:10.802995+0000","last_peered":"2023-10-06T04:28:10.802995+0000","last_clean":"2023-10-06T04:28:10.802995+0000","last_became_active":"2023-10-06T04:28:10.801079+0000","last_became_peered":"2023-10-06T04:28:10.801079+0000","last_unstale":"2023-10-06T04:28:10.802995+0000","last_undegraded":"2023-10-06T04:28:10.802995+0000","last_fullsized":"2023-10-06T04:28:10.802995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:36.131936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770166+0000","last_change":"2023-10-06T04:28:05.761188+0000","last_active":"2023-10-06T04:28:10.770166+0000","last_peered":"2023-10-06T04:28:10.770166+0000","last_clean":"2023-10-06T04:28:10.770166+0000","last_became_active":"2023-10-06T04:28:05.760899+0000","last_became_peered":"2023-10-06T04:28:05.760899+0000","last_unstale":"2023-10-06T04:28:10.770166+0000","last_undegraded":"2023-10-06T04:28:10.770166+0000","last_fullsized":"2023-10-06T04:28:10.770166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:01:33.139108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770473+0000","last_change":"2023-10-06T04:28:06.341518+0000","last_active":"2023-10-06T04:28:10.770473+0000","last_peered":"2023-10-06T04:28:10.770473+0000","last_clean":"2023-10-06T04:28:10.770473+0000","last_became_active":"2023-10-06T04:28:06.341202+0000","last_became_peered":"2023-10-06T04:28:06.341202+0000","last_unstale":"2023-10-06T04:28:10.770473+0000","last_undegraded":"2023-10-06T04:28:10.770473+0000","last_fullsized":"2023-10-06T04:28:10.770473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:59.952485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.801053+0000","last_change":"2023-10-06T04:28:10.795457+0000","last_active":"2023-10-06T04:28:10.801053+0000","last_peered":"2023-10-06T04:28:10.801053+0000","last_clean":"2023-10-06T04:28:10.801053+0000","last_became_active":"2023-10-06T04:28:10.795098+0000","last_became_peered":"2023-10-06T04:28:10.795098+0000","last_unstale":"2023-10-06T04:28:10.801053+0000","last_undegraded":"2023-10-06T04:28:10.801053+0000","last_fullsized":"2023-10-06T04:28:10.801053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:13.098060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776901+0000","last_change":"2023-10-06T04:28:05.756129+0000","last_active":"2023-10-06T04:28:10.776901+0000","last_peered":"2023-10-06T04:28:10.776901+0000","last_clean":"2023-10-06T04:28:10.776901+0000","last_became_active":"2023-10-06T04:28:05.755795+0000","last_became_peered":"2023-10-06T04:28:05.755795+0000","last_unstale":"2023-10-06T04:28:10.776901+0000","last_undegraded":"2023-10-06T04:28:10.776901+0000","last_fullsized":"2023-10-06T04:28:10.776901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:31.777366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769931+0000","last_change":"2023-10-06T04:28:06.345205+0000","last_active":"2023-10-06T04:28:10.769931+0000","last_peered":"2023-10-06T04:28:10.769931+0000","last_clean":"2023-10-06T04:28:10.769931+0000","last_became_active":"2023-10-06T04:28:06.342334+0000","last_became_peered":"2023-10-06T04:28:06.342334+0000","last_unstale":"2023-10-06T04:28:10.769931+0000","last_undegraded":"2023-10-06T04:28:10.769931+0000","last_fullsized":"2023-10-06T04:28:10.769931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:27.073025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.793941+0000","last_change":"2023-10-06T04:28:10.792492+0000","last_active":"2023-10-06T04:28:10.793941+0000","last_peered":"2023-10-06T04:28:10.793941+0000","last_clean":"2023-10-06T04:28:10.793941+0000","last_became_active":"2023-10-06T04:28:10.791665+0000","last_became_peered":"2023-10-06T04:28:10.791665+0000","last_unstale":"2023-10-06T04:28:10.793941+0000","last_undegraded":"2023-10-06T04:28:10.793941+0000","last_fullsized":"2023-10-06T04:28:10.793941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:52.113969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771973+0000","last_change":"2023-10-06T04:28:05.766695+0000","last_active":"2023-10-06T04:28:10.771973+0000","last_peered":"2023-10-06T04:28:10.771973+0000","last_clean":"2023-10-06T04:28:10.771973+0000","last_became_active":"2023-10-06T04:28:05.766394+0000","last_became_peered":"2023-10-06T04:28:05.766394+0000","last_unstale":"2023-10-06T04:28:10.771973+0000","last_undegraded":"2023-10-06T04:28:10.771973+0000","last_fullsized":"2023-10-06T04:28:10.771973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:01.869120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769616+0000","last_change":"2023-10-06T04:28:06.340699+0000","last_active":"2023-10-06T04:28:10.769616+0000","last_peered":"2023-10-06T04:28:10.769616+0000","last_clean":"2023-10-06T04:28:10.769616+0000","last_became_active":"2023-10-06T04:28:06.339789+0000","last_became_peered":"2023-10-06T04:28:06.339789+0000","last_unstale":"2023-10-06T04:28:10.769616+0000","last_undegraded":"2023-10-06T04:28:10.769616+0000","last_fullsized":"2023-10-06T04:28:10.769616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:30.857061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.807709+0000","last_change":"2023-10-06T04:28:10.804204+0000","last_active":"2023-10-06T04:28:10.807709+0000","last_peered":"2023-10-06T04:28:10.807709+0000","last_clean":"2023-10-06T04:28:10.807709+0000","last_became_active":"2023-10-06T04:28:10.803790+0000","last_became_peered":"2023-10-06T04:28:10.803790+0000","last_unstale":"2023-10-06T04:28:10.807709+0000","last_undegraded":"2023-10-06T04:28:10.807709+0000","last_fullsized":"2023-10-06T04:28:10.807709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:24.109196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770090+0000","last_change":"2023-10-06T04:28:05.755711+0000","last_active":"2023-10-06T04:28:10.770090+0000","last_peered":"2023-10-06T04:28:10.770090+0000","last_clean":"2023-10-06T04:28:10.770090+0000","last_became_active":"2023-10-06T04:28:05.755078+0000","last_became_peered":"2023-10-06T04:28:05.755078+0000","last_unstale":"2023-10-06T04:28:10.770090+0000","last_undegraded":"2023-10-06T04:28:10.770090+0000","last_fullsized":"2023-10-06T04:28:10.770090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:13.125425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771897+0000","last_change":"2023-10-06T04:28:06.341424+0000","last_active":"2023-10-06T04:28:10.771897+0000","last_peered":"2023-10-06T04:28:10.771897+0000","last_clean":"2023-10-06T04:28:10.771897+0000","last_became_active":"2023-10-06T04:28:06.341143+0000","last_became_peered":"2023-10-06T04:28:06.341143+0000","last_unstale":"2023-10-06T04:28:10.771897+0000","last_undegraded":"2023-10-06T04:28:10.771897+0000","last_fullsized":"2023-10-06T04:28:10.771897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:58.373238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802044+0000","last_change":"2023-10-06T04:28:10.795677+0000","last_active":"2023-10-06T04:28:10.802044+0000","last_peered":"2023-10-06T04:28:10.802044+0000","last_clean":"2023-10-06T04:28:10.802044+0000","last_became_active":"2023-10-06T04:28:10.795322+0000","last_became_peered":"2023-10-06T04:28:10.795322+0000","last_unstale":"2023-10-06T04:28:10.802044+0000","last_undegraded":"2023-10-06T04:28:10.802044+0000","last_fullsized":"2023-10-06T04:28:10.802044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:43.446834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.778777+0000","last_change":"2023-10-06T04:28:05.755211+0000","last_active":"2023-10-06T04:28:10.778777+0000","last_peered":"2023-10-06T04:28:10.778777+0000","last_clean":"2023-10-06T04:28:10.778777+0000","last_became_active":"2023-10-06T04:28:05.754921+0000","last_became_peered":"2023-10-06T04:28:05.754921+0000","last_unstale":"2023-10-06T04:28:10.778777+0000","last_undegraded":"2023-10-06T04:28:10.778777+0000","last_fullsized":"2023-10-06T04:28:10.778777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:24.180507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772506+0000","last_change":"2023-10-06T04:28:06.337449+0000","last_active":"2023-10-06T04:28:10.772506+0000","last_peered":"2023-10-06T04:28:10.772506+0000","last_clean":"2023-10-06T04:28:10.772506+0000","last_became_active":"2023-10-06T04:28:06.337164+0000","last_became_peered":"2023-10-06T04:28:06.337164+0000","last_unstale":"2023-10-06T04:28:10.772506+0000","last_undegraded":"2023-10-06T04:28:10.772506+0000","last_fullsized":"2023-10-06T04:28:10.772506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:39.187212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.809084+0000","last_change":"2023-10-06T04:28:10.805106+0000","last_active":"2023-10-06T04:28:10.809084+0000","last_peered":"2023-10-06T04:28:10.809084+0000","last_clean":"2023-10-06T04:28:10.809084+0000","last_became_active":"2023-10-06T04:28:10.804660+0000","last_became_peered":"2023-10-06T04:28:10.804660+0000","last_unstale":"2023-10-06T04:28:10.809084+0000","last_undegraded":"2023-10-06T04:28:10.809084+0000","last_fullsized":"2023-10-06T04:28:10.809084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:33:06.767121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779391+0000","last_change":"2023-10-06T04:28:05.763511+0000","last_active":"2023-10-06T04:28:10.779391+0000","last_peered":"2023-10-06T04:28:10.779391+0000","last_clean":"2023-10-06T04:28:10.779391+0000","last_became_active":"2023-10-06T04:28:05.763165+0000","last_became_peered":"2023-10-06T04:28:05.763165+0000","last_unstale":"2023-10-06T04:28:10.779391+0000","last_undegraded":"2023-10-06T04:28:10.779391+0000","last_fullsized":"2023-10-06T04:28:10.779391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:58.212679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.780725+0000","last_change":"2023-10-06T04:28:06.335419+0000","last_active":"2023-10-06T04:28:10.780725+0000","last_peered":"2023-10-06T04:28:10.780725+0000","last_clean":"2023-10-06T04:28:10.780725+0000","last_became_active":"2023-10-06T04:28:06.335165+0000","last_became_peered":"2023-10-06T04:28:06.335165+0000","last_unstale":"2023-10-06T04:28:10.780725+0000","last_undegraded":"2023-10-06T04:28:10.780725+0000","last_fullsized":"2023-10-06T04:28:10.780725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:15.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.795671+0000","last_change":"2023-10-06T04:28:10.791897+0000","last_active":"2023-10-06T04:28:10.795671+0000","last_peered":"2023-10-06T04:28:10.795671+0000","last_clean":"2023-10-06T04:28:10.795671+0000","last_became_active":"2023-10-06T04:28:10.791427+0000","last_became_peered":"2023-10-06T04:28:10.791427+0000","last_unstale":"2023-10-06T04:28:10.795671+0000","last_undegraded":"2023-10-06T04:28:10.795671+0000","last_fullsized":"2023-10-06T04:28:10.795671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:23.024555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T04:28:20.129303+0000","last_change":"2023-10-06T04:28:05.756961+0000","last_active":"2023-10-06T04:28:20.129303+0000","last_peered":"2023-10-06T04:28:20.129303+0000","last_clean":"2023-10-06T04:28:20.129303+0000","last_became_active":"2023-10-06T04:28:05.756443+0000","last_became_peered":"2023-10-06T04:28:05.756443+0000","last_unstale":"2023-10-06T04:28:20.129303+0000","last_undegraded":"2023-10-06T04:28:20.129303+0000","last_fullsized":"2023-10-06T04:28:20.129303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:15.728042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768364+0000","last_change":"2023-10-06T04:28:06.350205+0000","last_active":"2023-10-06T04:28:10.768364+0000","last_peered":"2023-10-06T04:28:10.768364+0000","last_clean":"2023-10-06T04:28:10.768364+0000","last_became_active":"2023-10-06T04:28:06.347777+0000","last_became_peered":"2023-10-06T04:28:06.347777+0000","last_unstale":"2023-10-06T04:28:10.768364+0000","last_undegraded":"2023-10-06T04:28:10.768364+0000","last_fullsized":"2023-10-06T04:28:10.768364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:24:58.690599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.800408+0000","last_change":"2023-10-06T04:28:10.799162+0000","last_active":"2023-10-06T04:28:10.800408+0000","last_peered":"2023-10-06T04:28:10.800408+0000","last_clean":"2023-10-06T04:28:10.800408+0000","last_became_active":"2023-10-06T04:28:10.798723+0000","last_became_peered":"2023-10-06T04:28:10.798723+0000","last_unstale":"2023-10-06T04:28:10.800408+0000","last_undegraded":"2023-10-06T04:28:10.800408+0000","last_fullsized":"2023-10-06T04:28:10.800408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:57.373019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776524+0000","last_change":"2023-10-06T04:28:05.762181+0000","last_active":"2023-10-06T04:28:10.776524+0000","last_peered":"2023-10-06T04:28:10.776524+0000","last_clean":"2023-10-06T04:28:10.776524+0000","last_became_active":"2023-10-06T04:28:05.761833+0000","last_became_peered":"2023-10-06T04:28:05.761833+0000","last_unstale":"2023-10-06T04:28:10.776524+0000","last_undegraded":"2023-10-06T04:28:10.776524+0000","last_fullsized":"2023-10-06T04:28:10.776524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:31.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770860+0000","last_change":"2023-10-06T04:28:06.340906+0000","last_active":"2023-10-06T04:28:10.770860+0000","last_peered":"2023-10-06T04:28:10.770860+0000","last_clean":"2023-10-06T04:28:10.770860+0000","last_became_active":"2023-10-06T04:28:06.340662+0000","last_became_peered":"2023-10-06T04:28:06.340662+0000","last_unstale":"2023-10-06T04:28:10.770860+0000","last_undegraded":"2023-10-06T04:28:10.770860+0000","last_fullsized":"2023-10-06T04:28:10.770860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:17.928102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.809048+0000","last_change":"2023-10-06T04:28:10.804183+0000","last_active":"2023-10-06T04:28:10.809048+0000","last_peered":"2023-10-06T04:28:10.809048+0000","last_clean":"2023-10-06T04:28:10.809048+0000","last_became_active":"2023-10-06T04:28:10.803784+0000","last_became_peered":"2023-10-06T04:28:10.803784+0000","last_unstale":"2023-10-06T04:28:10.809048+0000","last_undegraded":"2023-10-06T04:28:10.809048+0000","last_fullsized":"2023-10-06T04:28:10.809048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:31.800551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769741+0000","last_change":"2023-10-06T04:28:05.750972+0000","last_active":"2023-10-06T04:28:10.769741+0000","last_peered":"2023-10-06T04:28:10.769741+0000","last_clean":"2023-10-06T04:28:10.769741+0000","last_became_active":"2023-10-06T04:28:05.750669+0000","last_became_peered":"2023-10-06T04:28:05.750669+0000","last_unstale":"2023-10-06T04:28:10.769741+0000","last_undegraded":"2023-10-06T04:28:10.769741+0000","last_fullsized":"2023-10-06T04:28:10.769741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:24.180507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779676+0000","last_change":"2023-10-06T04:28:06.347817+0000","last_active":"2023-10-06T04:28:10.779676+0000","last_peered":"2023-10-06T04:28:10.779676+0000","last_clean":"2023-10-06T04:28:10.779676+0000","last_became_active":"2023-10-06T04:28:06.347502+0000","last_became_peered":"2023-10-06T04:28:06.347502+0000","last_unstale":"2023-10-06T04:28:10.779676+0000","last_undegraded":"2023-10-06T04:28:10.779676+0000","last_fullsized":"2023-10-06T04:28:10.779676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:13.160015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.809120+0000","last_change":"2023-10-06T04:28:10.805867+0000","last_active":"2023-10-06T04:28:10.809120+0000","last_peered":"2023-10-06T04:28:10.809120+0000","last_clean":"2023-10-06T04:28:10.809120+0000","last_became_active":"2023-10-06T04:28:10.805292+0000","last_became_peered":"2023-10-06T04:28:10.805292+0000","last_unstale":"2023-10-06T04:28:10.809120+0000","last_undegraded":"2023-10-06T04:28:10.809120+0000","last_fullsized":"2023-10-06T04:28:10.809120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:21.459093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774023+0000","last_change":"2023-10-06T04:28:05.758582+0000","last_active":"2023-10-06T04:28:10.774023+0000","last_peered":"2023-10-06T04:28:10.774023+0000","last_clean":"2023-10-06T04:28:10.774023+0000","last_became_active":"2023-10-06T04:28:05.758300+0000","last_became_peered":"2023-10-06T04:28:05.758300+0000","last_unstale":"2023-10-06T04:28:10.774023+0000","last_undegraded":"2023-10-06T04:28:10.774023+0000","last_fullsized":"2023-10-06T04:28:10.774023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:46.282985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770173+0000","last_change":"2023-10-06T04:28:06.347051+0000","last_active":"2023-10-06T04:28:10.770173+0000","last_peered":"2023-10-06T04:28:10.770173+0000","last_clean":"2023-10-06T04:28:10.770173+0000","last_became_active":"2023-10-06T04:28:06.346605+0000","last_became_peered":"2023-10-06T04:28:06.346605+0000","last_unstale":"2023-10-06T04:28:10.770173+0000","last_undegraded":"2023-10-06T04:28:10.770173+0000","last_fullsized":"2023-10-06T04:28:10.770173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:28.999532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.799625+0000","last_change":"2023-10-06T04:28:10.797651+0000","last_active":"2023-10-06T04:28:10.799625+0000","last_peered":"2023-10-06T04:28:10.799625+0000","last_clean":"2023-10-06T04:28:10.799625+0000","last_became_active":"2023-10-06T04:28:10.797232+0000","last_became_peered":"2023-10-06T04:28:10.797232+0000","last_unstale":"2023-10-06T04:28:10.799625+0000","last_undegraded":"2023-10-06T04:28:10.799625+0000","last_fullsized":"2023-10-06T04:28:10.799625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:11.414923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769762+0000","last_change":"2023-10-06T04:28:05.742570+0000","last_active":"2023-10-06T04:28:10.769762+0000","last_peered":"2023-10-06T04:28:10.769762+0000","last_clean":"2023-10-06T04:28:10.769762+0000","last_became_active":"2023-10-06T04:28:05.742241+0000","last_became_peered":"2023-10-06T04:28:05.742241+0000","last_unstale":"2023-10-06T04:28:10.769762+0000","last_undegraded":"2023-10-06T04:28:10.769762+0000","last_fullsized":"2023-10-06T04:28:10.769762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:13.125425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770855+0000","last_change":"2023-10-06T04:28:06.337353+0000","last_active":"2023-10-06T04:28:10.770855+0000","last_peered":"2023-10-06T04:28:10.770855+0000","last_clean":"2023-10-06T04:28:10.770855+0000","last_became_active":"2023-10-06T04:28:06.337087+0000","last_became_peered":"2023-10-06T04:28:06.337087+0000","last_unstale":"2023-10-06T04:28:10.770855+0000","last_undegraded":"2023-10-06T04:28:10.770855+0000","last_fullsized":"2023-10-06T04:28:10.770855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:36.507036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802188+0000","last_change":"2023-10-06T04:28:10.800008+0000","last_active":"2023-10-06T04:28:10.802188+0000","last_peered":"2023-10-06T04:28:10.802188+0000","last_clean":"2023-10-06T04:28:10.802188+0000","last_became_active":"2023-10-06T04:28:10.799373+0000","last_became_peered":"2023-10-06T04:28:10.799373+0000","last_unstale":"2023-10-06T04:28:10.802188+0000","last_undegraded":"2023-10-06T04:28:10.802188+0000","last_fullsized":"2023-10-06T04:28:10.802188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:23.024555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.780048+0000","last_change":"2023-10-06T04:28:05.762026+0000","last_active":"2023-10-06T04:28:10.780048+0000","last_peered":"2023-10-06T04:28:10.780048+0000","last_clean":"2023-10-06T04:28:10.780048+0000","last_became_active":"2023-10-06T04:28:05.761745+0000","last_became_peered":"2023-10-06T04:28:05.761745+0000","last_unstale":"2023-10-06T04:28:10.780048+0000","last_undegraded":"2023-10-06T04:28:10.780048+0000","last_fullsized":"2023-10-06T04:28:10.780048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:25.024995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774954+0000","last_change":"2023-10-06T04:28:06.346072+0000","last_active":"2023-10-06T04:28:10.774954+0000","last_peered":"2023-10-06T04:28:10.774954+0000","last_clean":"2023-10-06T04:28:10.774954+0000","last_became_active":"2023-10-06T04:28:06.345770+0000","last_became_peered":"2023-10-06T04:28:06.345770+0000","last_unstale":"2023-10-06T04:28:10.774954+0000","last_undegraded":"2023-10-06T04:28:10.774954+0000","last_fullsized":"2023-10-06T04:28:10.774954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:53.248928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.785697+0000","last_change":"2023-10-06T04:28:10.784166+0000","last_active":"2023-10-06T04:28:10.785697+0000","last_peered":"2023-10-06T04:28:10.785697+0000","last_clean":"2023-10-06T04:28:10.785697+0000","last_became_active":"2023-10-06T04:28:10.783671+0000","last_became_peered":"2023-10-06T04:28:10.783671+0000","last_unstale":"2023-10-06T04:28:10.785697+0000","last_undegraded":"2023-10-06T04:28:10.785697+0000","last_fullsized":"2023-10-06T04:28:10.785697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:18.568583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776289+0000","last_change":"2023-10-06T04:28:05.762151+0000","last_active":"2023-10-06T04:28:10.776289+0000","last_peered":"2023-10-06T04:28:10.776289+0000","last_clean":"2023-10-06T04:28:10.776289+0000","last_became_active":"2023-10-06T04:28:05.761792+0000","last_became_peered":"2023-10-06T04:28:05.761792+0000","last_unstale":"2023-10-06T04:28:10.776289+0000","last_undegraded":"2023-10-06T04:28:10.776289+0000","last_fullsized":"2023-10-06T04:28:10.776289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:01.869120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769462+0000","last_change":"2023-10-06T04:28:06.350312+0000","last_active":"2023-10-06T04:28:10.769462+0000","last_peered":"2023-10-06T04:28:10.769462+0000","last_clean":"2023-10-06T04:28:10.769462+0000","last_became_active":"2023-10-06T04:28:06.349971+0000","last_became_peered":"2023-10-06T04:28:06.349971+0000","last_unstale":"2023-10-06T04:28:10.769462+0000","last_undegraded":"2023-10-06T04:28:10.769462+0000","last_fullsized":"2023-10-06T04:28:10.769462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:03.824145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.782164+0000","last_change":"2023-10-06T04:28:10.780132+0000","last_active":"2023-10-06T04:28:10.782164+0000","last_peered":"2023-10-06T04:28:10.782164+0000","last_clean":"2023-10-06T04:28:10.782164+0000","last_became_active":"2023-10-06T04:28:10.779808+0000","last_became_peered":"2023-10-06T04:28:10.779808+0000","last_unstale":"2023-10-06T04:28:10.782164+0000","last_undegraded":"2023-10-06T04:28:10.782164+0000","last_fullsized":"2023-10-06T04:28:10.782164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:36.272215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779299+0000","last_change":"2023-10-06T04:28:05.756128+0000","last_active":"2023-10-06T04:28:10.779299+0000","last_peered":"2023-10-06T04:28:10.779299+0000","last_clean":"2023-10-06T04:28:10.779299+0000","last_became_active":"2023-10-06T04:28:05.755749+0000","last_became_peered":"2023-10-06T04:28:05.755749+0000","last_unstale":"2023-10-06T04:28:10.779299+0000","last_undegraded":"2023-10-06T04:28:10.779299+0000","last_fullsized":"2023-10-06T04:28:10.779299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:53.511624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768694+0000","last_change":"2023-10-06T04:28:06.340325+0000","last_active":"2023-10-06T04:28:10.768694+0000","last_peered":"2023-10-06T04:28:10.768694+0000","last_clean":"2023-10-06T04:28:10.768694+0000","last_became_active":"2023-10-06T04:28:06.339640+0000","last_became_peered":"2023-10-06T04:28:06.339640+0000","last_unstale":"2023-10-06T04:28:10.768694+0000","last_undegraded":"2023-10-06T04:28:10.768694+0000","last_fullsized":"2023-10-06T04:28:10.768694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:13.160015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802745+0000","last_change":"2023-10-06T04:28:10.797879+0000","last_active":"2023-10-06T04:28:10.802745+0000","last_peered":"2023-10-06T04:28:10.802745+0000","last_clean":"2023-10-06T04:28:10.802745+0000","last_became_active":"2023-10-06T04:28:10.797454+0000","last_became_peered":"2023-10-06T04:28:10.797454+0000","last_unstale":"2023-10-06T04:28:10.802745+0000","last_undegraded":"2023-10-06T04:28:10.802745+0000","last_fullsized":"2023-10-06T04:28:10.802745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:21.953970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776131+0000","last_change":"2023-10-06T04:28:05.763894+0000","last_active":"2023-10-06T04:28:10.776131+0000","last_peered":"2023-10-06T04:28:10.776131+0000","last_clean":"2023-10-06T04:28:10.776131+0000","last_became_active":"2023-10-06T04:28:05.763596+0000","last_became_peered":"2023-10-06T04:28:05.763596+0000","last_unstale":"2023-10-06T04:28:10.776131+0000","last_undegraded":"2023-10-06T04:28:10.776131+0000","last_fullsized":"2023-10-06T04:28:10.776131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:31.777366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772230+0000","last_change":"2023-10-06T04:28:06.342227+0000","last_active":"2023-10-06T04:28:10.772230+0000","last_peered":"2023-10-06T04:28:10.772230+0000","last_clean":"2023-10-06T04:28:10.772230+0000","last_became_active":"2023-10-06T04:28:06.341974+0000","last_became_peered":"2023-10-06T04:28:06.341974+0000","last_unstale":"2023-10-06T04:28:10.772230+0000","last_undegraded":"2023-10-06T04:28:10.772230+0000","last_fullsized":"2023-10-06T04:28:10.772230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:34.925929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.795509+0000","last_change":"2023-10-06T04:28:10.790497+0000","last_active":"2023-10-06T04:28:10.795509+0000","last_peered":"2023-10-06T04:28:10.795509+0000","last_clean":"2023-10-06T04:28:10.795509+0000","last_became_active":"2023-10-06T04:28:10.790006+0000","last_became_peered":"2023-10-06T04:28:10.790006+0000","last_unstale":"2023-10-06T04:28:10.795509+0000","last_undegraded":"2023-10-06T04:28:10.795509+0000","last_fullsized":"2023-10-06T04:28:10.795509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:33.025399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771405+0000","last_change":"2023-10-06T04:28:05.762781+0000","last_active":"2023-10-06T04:28:10.771405+0000","last_peered":"2023-10-06T04:28:10.771405+0000","last_clean":"2023-10-06T04:28:10.771405+0000","last_became_active":"2023-10-06T04:28:05.762020+0000","last_became_peered":"2023-10-06T04:28:05.762020+0000","last_unstale":"2023-10-06T04:28:10.771405+0000","last_undegraded":"2023-10-06T04:28:10.771405+0000","last_fullsized":"2023-10-06T04:28:10.771405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:25.024995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770971+0000","last_change":"2023-10-06T04:28:06.349404+0000","last_active":"2023-10-06T04:28:10.770971+0000","last_peered":"2023-10-06T04:28:10.770971+0000","last_clean":"2023-10-06T04:28:10.770971+0000","last_became_active":"2023-10-06T04:28:06.349122+0000","last_became_peered":"2023-10-06T04:28:06.349122+0000","last_unstale":"2023-10-06T04:28:10.770971+0000","last_undegraded":"2023-10-06T04:28:10.770971+0000","last_fullsized":"2023-10-06T04:28:10.770971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:59.952485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.801165+0000","last_change":"2023-10-06T04:28:10.796293+0000","last_active":"2023-10-06T04:28:10.801165+0000","last_peered":"2023-10-06T04:28:10.801165+0000","last_clean":"2023-10-06T04:28:10.801165+0000","last_became_active":"2023-10-06T04:28:10.795652+0000","last_became_peered":"2023-10-06T04:28:10.795652+0000","last_unstale":"2023-10-06T04:28:10.801165+0000","last_undegraded":"2023-10-06T04:28:10.801165+0000","last_fullsized":"2023-10-06T04:28:10.801165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:32.517736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768694+0000","last_change":"2023-10-06T04:28:05.758453+0000","last_active":"2023-10-06T04:28:10.768694+0000","last_peered":"2023-10-06T04:28:10.768694+0000","last_clean":"2023-10-06T04:28:10.768694+0000","last_became_active":"2023-10-06T04:28:05.758154+0000","last_became_peered":"2023-10-06T04:28:05.758154+0000","last_unstale":"2023-10-06T04:28:10.768694+0000","last_undegraded":"2023-10-06T04:28:10.768694+0000","last_fullsized":"2023-10-06T04:28:10.768694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:24.180507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769342+0000","last_change":"2023-10-06T04:28:06.353299+0000","last_active":"2023-10-06T04:28:10.769342+0000","last_peered":"2023-10-06T04:28:10.769342+0000","last_clean":"2023-10-06T04:28:10.769342+0000","last_became_active":"2023-10-06T04:28:06.352474+0000","last_became_peered":"2023-10-06T04:28:06.352474+0000","last_unstale":"2023-10-06T04:28:10.769342+0000","last_undegraded":"2023-10-06T04:28:10.769342+0000","last_fullsized":"2023-10-06T04:28:10.769342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:28.491869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.798862+0000","last_change":"2023-10-06T04:28:10.792443+0000","last_active":"2023-10-06T04:28:10.798862+0000","last_peered":"2023-10-06T04:28:10.798862+0000","last_clean":"2023-10-06T04:28:10.798862+0000","last_became_active":"2023-10-06T04:28:10.791995+0000","last_became_peered":"2023-10-06T04:28:10.791995+0000","last_unstale":"2023-10-06T04:28:10.798862+0000","last_undegraded":"2023-10-06T04:28:10.798862+0000","last_fullsized":"2023-10-06T04:28:10.798862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:12.226268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769340+0000","last_change":"2023-10-06T04:28:05.757101+0000","last_active":"2023-10-06T04:28:10.769340+0000","last_peered":"2023-10-06T04:28:10.769340+0000","last_clean":"2023-10-06T04:28:10.769340+0000","last_became_active":"2023-10-06T04:28:05.756775+0000","last_became_peered":"2023-10-06T04:28:05.756775+0000","last_unstale":"2023-10-06T04:28:10.769340+0000","last_undegraded":"2023-10-06T04:28:10.769340+0000","last_fullsized":"2023-10-06T04:28:10.769340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:37.282042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769202+0000","last_change":"2023-10-06T04:28:06.351787+0000","last_active":"2023-10-06T04:28:10.769202+0000","last_peered":"2023-10-06T04:28:10.769202+0000","last_clean":"2023-10-06T04:28:10.769202+0000","last_became_active":"2023-10-06T04:28:06.351250+0000","last_became_peered":"2023-10-06T04:28:06.351250+0000","last_unstale":"2023-10-06T04:28:10.769202+0000","last_undegraded":"2023-10-06T04:28:10.769202+0000","last_fullsized":"2023-10-06T04:28:10.769202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:09.072192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802887+0000","last_change":"2023-10-06T04:28:10.798603+0000","last_active":"2023-10-06T04:28:10.802887+0000","last_peered":"2023-10-06T04:28:10.802887+0000","last_clean":"2023-10-06T04:28:10.802887+0000","last_became_active":"2023-10-06T04:28:10.798140+0000","last_became_peered":"2023-10-06T04:28:10.798140+0000","last_unstale":"2023-10-06T04:28:10.802887+0000","last_undegraded":"2023-10-06T04:28:10.802887+0000","last_fullsized":"2023-10-06T04:28:10.802887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:13.693194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771821+0000","last_change":"2023-10-06T04:28:05.761077+0000","last_active":"2023-10-06T04:28:10.771821+0000","last_peered":"2023-10-06T04:28:10.771821+0000","last_clean":"2023-10-06T04:28:10.771821+0000","last_became_active":"2023-10-06T04:28:05.760800+0000","last_became_peered":"2023-10-06T04:28:05.760800+0000","last_unstale":"2023-10-06T04:28:10.771821+0000","last_undegraded":"2023-10-06T04:28:10.771821+0000","last_fullsized":"2023-10-06T04:28:10.771821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:24.180507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776545+0000","last_change":"2023-10-06T04:28:06.338307+0000","last_active":"2023-10-06T04:28:10.776545+0000","last_peered":"2023-10-06T04:28:10.776545+0000","last_clean":"2023-10-06T04:28:10.776545+0000","last_became_active":"2023-10-06T04:28:06.338025+0000","last_became_peered":"2023-10-06T04:28:06.338025+0000","last_unstale":"2023-10-06T04:28:10.776545+0000","last_undegraded":"2023-10-06T04:28:10.776545+0000","last_fullsized":"2023-10-06T04:28:10.776545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:25.299896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802825+0000","last_change":"2023-10-06T04:28:10.796279+0000","last_active":"2023-10-06T04:28:10.802825+0000","last_peered":"2023-10-06T04:28:10.802825+0000","last_clean":"2023-10-06T04:28:10.802825+0000","last_became_active":"2023-10-06T04:28:10.795554+0000","last_became_peered":"2023-10-06T04:28:10.795554+0000","last_unstale":"2023-10-06T04:28:10.802825+0000","last_undegraded":"2023-10-06T04:28:10.802825+0000","last_fullsized":"2023-10-06T04:28:10.802825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:52.320723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770652+0000","last_change":"2023-10-06T04:28:05.754602+0000","last_active":"2023-10-06T04:28:10.770652+0000","last_peered":"2023-10-06T04:28:10.770652+0000","last_clean":"2023-10-06T04:28:10.770652+0000","last_became_active":"2023-10-06T04:28:05.754262+0000","last_became_peered":"2023-10-06T04:28:05.754262+0000","last_unstale":"2023-10-06T04:28:10.770652+0000","last_undegraded":"2023-10-06T04:28:10.770652+0000","last_fullsized":"2023-10-06T04:28:10.770652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:15.728042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769463+0000","last_change":"2023-10-06T04:28:00.325832+0000","last_active":"2023-10-06T04:28:10.769463+0000","last_peered":"2023-10-06T04:28:10.769463+0000","last_clean":"2023-10-06T04:28:10.769463+0000","last_became_active":"2023-10-06T04:28:00.325466+0000","last_became_peered":"2023-10-06T04:28:00.325466+0000","last_unstale":"2023-10-06T04:28:10.769463+0000","last_undegraded":"2023-10-06T04:28:10.769463+0000","last_fullsized":"2023-10-06T04:28:10.769463+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771741+0000","last_change":"2023-10-06T04:28:06.347871+0000","last_active":"2023-10-06T04:28:10.771741+0000","last_peered":"2023-10-06T04:28:10.771741+0000","last_clean":"2023-10-06T04:28:10.771741+0000","last_became_active":"2023-10-06T04:28:06.347598+0000","last_became_peered":"2023-10-06T04:28:06.347598+0000","last_unstale":"2023-10-06T04:28:10.771741+0000","last_undegraded":"2023-10-06T04:28:10.771741+0000","last_fullsized":"2023-10-06T04:28:10.771741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:03.824145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.809116+0000","last_change":"2023-10-06T04:28:10.805828+0000","last_active":"2023-10-06T04:28:10.809116+0000","last_peered":"2023-10-06T04:28:10.809116+0000","last_clean":"2023-10-06T04:28:10.809116+0000","last_became_active":"2023-10-06T04:28:10.805391+0000","last_became_peered":"2023-10-06T04:28:10.805391+0000","last_unstale":"2023-10-06T04:28:10.809116+0000","last_undegraded":"2023-10-06T04:28:10.809116+0000","last_fullsized":"2023-10-06T04:28:10.809116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:12.226268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770768+0000","last_change":"2023-10-06T04:28:00.175241+0000","last_active":"2023-10-06T04:28:10.770768+0000","last_peered":"2023-10-06T04:28:10.770768+0000","last_clean":"2023-10-06T04:28:10.770768+0000","last_became_active":"2023-10-06T04:28:00.174814+0000","last_became_peered":"2023-10-06T04:28:00.174814+0000","last_unstale":"2023-10-06T04:28:10.770768+0000","last_undegraded":"2023-10-06T04:28:10.770768+0000","last_fullsized":"2023-10-06T04:28:10.770768+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769844+0000","last_change":"2023-10-06T04:28:05.759716+0000","last_active":"2023-10-06T04:28:10.769844+0000","last_peered":"2023-10-06T04:28:10.769844+0000","last_clean":"2023-10-06T04:28:10.769844+0000","last_became_active":"2023-10-06T04:28:05.759378+0000","last_became_peered":"2023-10-06T04:28:05.759378+0000","last_unstale":"2023-10-06T04:28:10.769844+0000","last_undegraded":"2023-10-06T04:28:10.769844+0000","last_fullsized":"2023-10-06T04:28:10.769844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:31.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769414+0000","last_change":"2023-10-06T04:28:06.345648+0000","last_active":"2023-10-06T04:28:10.769414+0000","last_peered":"2023-10-06T04:28:10.769414+0000","last_clean":"2023-10-06T04:28:10.769414+0000","last_became_active":"2023-10-06T04:28:06.345327+0000","last_became_peered":"2023-10-06T04:28:06.345327+0000","last_unstale":"2023-10-06T04:28:10.769414+0000","last_undegraded":"2023-10-06T04:28:10.769414+0000","last_fullsized":"2023-10-06T04:28:10.769414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:30.857061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.799671+0000","last_change":"2023-10-06T04:28:10.798759+0000","last_active":"2023-10-06T04:28:10.799671+0000","last_peered":"2023-10-06T04:28:10.799671+0000","last_clean":"2023-10-06T04:28:10.799671+0000","last_became_active":"2023-10-06T04:28:10.798359+0000","last_became_peered":"2023-10-06T04:28:10.798359+0000","last_unstale":"2023-10-06T04:28:10.799671+0000","last_undegraded":"2023-10-06T04:28:10.799671+0000","last_fullsized":"2023-10-06T04:28:10.799671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:21.459093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.773701+0000","last_change":"2023-10-06T04:28:00.175086+0000","last_active":"2023-10-06T04:28:10.773701+0000","last_peered":"2023-10-06T04:28:10.773701+0000","last_clean":"2023-10-06T04:28:10.773701+0000","last_became_active":"2023-10-06T04:28:00.174735+0000","last_became_peered":"2023-10-06T04:28:00.174735+0000","last_unstale":"2023-10-06T04:28:10.773701+0000","last_undegraded":"2023-10-06T04:28:10.773701+0000","last_fullsized":"2023-10-06T04:28:10.773701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.777992+0000","last_change":"2023-10-06T04:28:01.176177+0000","last_active":"2023-10-06T04:28:10.777992+0000","last_peered":"2023-10-06T04:28:10.777992+0000","last_clean":"2023-10-06T04:28:10.777992+0000","last_became_active":"2023-10-06T04:28:01.175255+0000","last_became_peered":"2023-10-06T04:28:01.175255+0000","last_unstale":"2023-10-06T04:28:10.777992+0000","last_undegraded":"2023-10-06T04:28:10.777992+0000","last_fullsized":"2023-10-06T04:28:10.777992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:00.161020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:00.161020+0000","last_clean_scrub_stamp":"2023-10-06T04:28:00.161020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:29.208067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769407+0000","last_change":"2023-10-06T04:28:05.748512+0000","last_active":"2023-10-06T04:28:10.769407+0000","last_peered":"2023-10-06T04:28:10.769407+0000","last_clean":"2023-10-06T04:28:10.769407+0000","last_became_active":"2023-10-06T04:28:05.748197+0000","last_became_peered":"2023-10-06T04:28:05.748197+0000","last_unstale":"2023-10-06T04:28:10.769407+0000","last_undegraded":"2023-10-06T04:28:10.769407+0000","last_fullsized":"2023-10-06T04:28:10.769407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:31.777366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770089+0000","last_change":"2023-10-06T04:28:06.346860+0000","last_active":"2023-10-06T04:28:10.770089+0000","last_peered":"2023-10-06T04:28:10.770089+0000","last_clean":"2023-10-06T04:28:10.770089+0000","last_became_active":"2023-10-06T04:28:06.346244+0000","last_became_peered":"2023-10-06T04:28:06.346244+0000","last_unstale":"2023-10-06T04:28:10.770089+0000","last_undegraded":"2023-10-06T04:28:10.770089+0000","last_fullsized":"2023-10-06T04:28:10.770089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:25.299896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.799239+0000","last_change":"2023-10-06T04:28:10.796043+0000","last_active":"2023-10-06T04:28:10.799239+0000","last_peered":"2023-10-06T04:28:10.799239+0000","last_clean":"2023-10-06T04:28:10.799239+0000","last_became_active":"2023-10-06T04:28:10.794267+0000","last_became_peered":"2023-10-06T04:28:10.794267+0000","last_unstale":"2023-10-06T04:28:10.799239+0000","last_undegraded":"2023-10-06T04:28:10.799239+0000","last_fullsized":"2023-10-06T04:28:10.799239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:13.098060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776644+0000","last_change":"2023-10-06T04:28:00.344573+0000","last_active":"2023-10-06T04:28:10.776644+0000","last_peered":"2023-10-06T04:28:10.776644+0000","last_clean":"2023-10-06T04:28:10.776644+0000","last_became_active":"2023-10-06T04:28:00.344324+0000","last_became_peered":"2023-10-06T04:28:00.344324+0000","last_unstale":"2023-10-06T04:28:10.776644+0000","last_undegraded":"2023-10-06T04:28:10.776644+0000","last_fullsized":"2023-10-06T04:28:10.776644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:24.184826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.775065+0000","last_change":"2023-10-06T04:28:05.757315+0000","last_active":"2023-10-06T04:28:10.775065+0000","last_peered":"2023-10-06T04:28:10.775065+0000","last_clean":"2023-10-06T04:28:10.775065+0000","last_became_active":"2023-10-06T04:28:05.756903+0000","last_became_peered":"2023-10-06T04:28:05.756903+0000","last_unstale":"2023-10-06T04:28:10.775065+0000","last_undegraded":"2023-10-06T04:28:10.775065+0000","last_fullsized":"2023-10-06T04:28:10.775065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:37.282042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.773864+0000","last_change":"2023-10-06T04:28:06.346567+0000","last_active":"2023-10-06T04:28:10.773864+0000","last_peered":"2023-10-06T04:28:10.773864+0000","last_clean":"2023-10-06T04:28:10.773864+0000","last_became_active":"2023-10-06T04:28:06.343751+0000","last_became_peered":"2023-10-06T04:28:06.343751+0000","last_unstale":"2023-10-06T04:28:10.773864+0000","last_undegraded":"2023-10-06T04:28:10.773864+0000","last_fullsized":"2023-10-06T04:28:10.773864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:53.248928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.798693+0000","last_change":"2023-10-06T04:28:10.788813+0000","last_active":"2023-10-06T04:28:10.798693+0000","last_peered":"2023-10-06T04:28:10.798693+0000","last_clean":"2023-10-06T04:28:10.798693+0000","last_became_active":"2023-10-06T04:28:10.788350+0000","last_became_peered":"2023-10-06T04:28:10.788350+0000","last_unstale":"2023-10-06T04:28:10.798693+0000","last_undegraded":"2023-10-06T04:28:10.798693+0000","last_fullsized":"2023-10-06T04:28:10.798693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:02.062950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.777569+0000","last_change":"2023-10-06T04:28:00.343571+0000","last_active":"2023-10-06T04:28:10.777569+0000","last_peered":"2023-10-06T04:28:10.777569+0000","last_clean":"2023-10-06T04:28:10.777569+0000","last_became_active":"2023-10-06T04:28:00.343268+0000","last_became_peered":"2023-10-06T04:28:00.343268+0000","last_unstale":"2023-10-06T04:28:10.777569+0000","last_undegraded":"2023-10-06T04:28:10.777569+0000","last_fullsized":"2023-10-06T04:28:10.777569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:00.931419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770595+0000","last_change":"2023-10-06T04:28:05.760969+0000","last_active":"2023-10-06T04:28:10.770595+0000","last_peered":"2023-10-06T04:28:10.770595+0000","last_clean":"2023-10-06T04:28:10.770595+0000","last_became_active":"2023-10-06T04:28:05.758813+0000","last_became_peered":"2023-10-06T04:28:05.758813+0000","last_unstale":"2023-10-06T04:28:10.770595+0000","last_undegraded":"2023-10-06T04:28:10.770595+0000","last_fullsized":"2023-10-06T04:28:10.770595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:13.125425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769104+0000","last_change":"2023-10-06T04:28:06.354285+0000","last_active":"2023-10-06T04:28:10.769104+0000","last_peered":"2023-10-06T04:28:10.769104+0000","last_clean":"2023-10-06T04:28:10.769104+0000","last_became_active":"2023-10-06T04:28:06.354002+0000","last_became_peered":"2023-10-06T04:28:06.354002+0000","last_unstale":"2023-10-06T04:28:10.769104+0000","last_undegraded":"2023-10-06T04:28:10.769104+0000","last_fullsized":"2023-10-06T04:28:10.769104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:15.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.793988+0000","last_change":"2023-10-06T04:28:10.792299+0000","last_active":"2023-10-06T04:28:10.793988+0000","last_peered":"2023-10-06T04:28:10.793988+0000","last_clean":"2023-10-06T04:28:10.793988+0000","last_became_active":"2023-10-06T04:28:10.791854+0000","last_became_peered":"2023-10-06T04:28:10.791854+0000","last_unstale":"2023-10-06T04:28:10.793988+0000","last_undegraded":"2023-10-06T04:28:10.793988+0000","last_fullsized":"2023-10-06T04:28:10.793988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:08.567157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774747+0000","last_change":"2023-10-06T04:28:00.344460+0000","last_active":"2023-10-06T04:28:10.774747+0000","last_peered":"2023-10-06T04:28:10.774747+0000","last_clean":"2023-10-06T04:28:10.774747+0000","last_became_active":"2023-10-06T04:28:00.343280+0000","last_became_peered":"2023-10-06T04:28:00.343280+0000","last_unstale":"2023-10-06T04:28:10.774747+0000","last_undegraded":"2023-10-06T04:28:10.774747+0000","last_fullsized":"2023-10-06T04:28:10.774747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768452+0000","last_change":"2023-10-06T04:28:05.757503+0000","last_active":"2023-10-06T04:28:10.768452+0000","last_peered":"2023-10-06T04:28:10.768452+0000","last_clean":"2023-10-06T04:28:10.768452+0000","last_became_active":"2023-10-06T04:28:05.757218+0000","last_became_peered":"2023-10-06T04:28:05.757218+0000","last_unstale":"2023-10-06T04:28:10.768452+0000","last_undegraded":"2023-10-06T04:28:10.768452+0000","last_fullsized":"2023-10-06T04:28:10.768452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:31.777366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774659+0000","last_change":"2023-10-06T04:28:06.334345+0000","last_active":"2023-10-06T04:28:10.774659+0000","last_peered":"2023-10-06T04:28:10.774659+0000","last_clean":"2023-10-06T04:28:10.774659+0000","last_became_active":"2023-10-06T04:28:06.334114+0000","last_became_peered":"2023-10-06T04:28:06.334114+0000","last_unstale":"2023-10-06T04:28:10.774659+0000","last_undegraded":"2023-10-06T04:28:10.774659+0000","last_fullsized":"2023-10-06T04:28:10.774659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:34.925929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.786275+0000","last_change":"2023-10-06T04:28:10.782630+0000","last_active":"2023-10-06T04:28:10.786275+0000","last_peered":"2023-10-06T04:28:10.786275+0000","last_clean":"2023-10-06T04:28:10.786275+0000","last_became_active":"2023-10-06T04:28:10.782267+0000","last_became_peered":"2023-10-06T04:28:10.782267+0000","last_unstale":"2023-10-06T04:28:10.786275+0000","last_undegraded":"2023-10-06T04:28:10.786275+0000","last_fullsized":"2023-10-06T04:28:10.786275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:11.414923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769001+0000","last_change":"2023-10-06T04:28:00.343592+0000","last_active":"2023-10-06T04:28:10.769001+0000","last_peered":"2023-10-06T04:28:10.769001+0000","last_clean":"2023-10-06T04:28:10.769001+0000","last_became_active":"2023-10-06T04:28:00.343313+0000","last_became_peered":"2023-10-06T04:28:00.343313+0000","last_unstale":"2023-10-06T04:28:10.769001+0000","last_undegraded":"2023-10-06T04:28:10.769001+0000","last_fullsized":"2023-10-06T04:28:10.769001+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:24.184826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774880+0000","last_change":"2023-10-06T04:28:05.760166+0000","last_active":"2023-10-06T04:28:10.774880+0000","last_peered":"2023-10-06T04:28:10.774880+0000","last_clean":"2023-10-06T04:28:10.774880+0000","last_became_active":"2023-10-06T04:28:05.759837+0000","last_became_peered":"2023-10-06T04:28:05.759837+0000","last_unstale":"2023-10-06T04:28:10.774880+0000","last_undegraded":"2023-10-06T04:28:10.774880+0000","last_fullsized":"2023-10-06T04:28:10.774880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:01:33.139108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772008+0000","last_change":"2023-10-06T04:28:06.340003+0000","last_active":"2023-10-06T04:28:10.772008+0000","last_peered":"2023-10-06T04:28:10.772008+0000","last_clean":"2023-10-06T04:28:10.772008+0000","last_became_active":"2023-10-06T04:28:06.339372+0000","last_became_peered":"2023-10-06T04:28:06.339372+0000","last_unstale":"2023-10-06T04:28:10.772008+0000","last_undegraded":"2023-10-06T04:28:10.772008+0000","last_fullsized":"2023-10-06T04:28:10.772008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:39.187212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.791694+0000","last_change":"2023-10-06T04:28:10.788742+0000","last_active":"2023-10-06T04:28:10.791694+0000","last_peered":"2023-10-06T04:28:10.791694+0000","last_clean":"2023-10-06T04:28:10.791694+0000","last_became_active":"2023-10-06T04:28:10.788218+0000","last_became_peered":"2023-10-06T04:28:10.788218+0000","last_unstale":"2023-10-06T04:28:10.791694+0000","last_undegraded":"2023-10-06T04:28:10.791694+0000","last_fullsized":"2023-10-06T04:28:10.791694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.241552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769530+0000","last_change":"2023-10-06T04:28:00.174563+0000","last_active":"2023-10-06T04:28:10.769530+0000","last_peered":"2023-10-06T04:28:10.769530+0000","last_clean":"2023-10-06T04:28:10.769530+0000","last_became_active":"2023-10-06T04:28:00.174265+0000","last_became_peered":"2023-10-06T04:28:00.174265+0000","last_unstale":"2023-10-06T04:28:10.769530+0000","last_undegraded":"2023-10-06T04:28:10.769530+0000","last_fullsized":"2023-10-06T04:28:10.769530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:00.931419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779588+0000","last_change":"2023-10-06T04:28:05.764045+0000","last_active":"2023-10-06T04:28:10.779588+0000","last_peered":"2023-10-06T04:28:10.779588+0000","last_clean":"2023-10-06T04:28:10.779588+0000","last_became_active":"2023-10-06T04:28:05.763751+0000","last_became_peered":"2023-10-06T04:28:05.763751+0000","last_unstale":"2023-10-06T04:28:10.779588+0000","last_undegraded":"2023-10-06T04:28:10.779588+0000","last_fullsized":"2023-10-06T04:28:10.779588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:31.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.780519+0000","last_change":"2023-10-06T04:28:06.341910+0000","last_active":"2023-10-06T04:28:10.780519+0000","last_peered":"2023-10-06T04:28:10.780519+0000","last_clean":"2023-10-06T04:28:10.780519+0000","last_became_active":"2023-10-06T04:28:06.340194+0000","last_became_peered":"2023-10-06T04:28:06.340194+0000","last_unstale":"2023-10-06T04:28:10.780519+0000","last_undegraded":"2023-10-06T04:28:10.780519+0000","last_fullsized":"2023-10-06T04:28:10.780519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:25.121736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.796035+0000","last_change":"2023-10-06T04:28:10.794957+0000","last_active":"2023-10-06T04:28:10.796035+0000","last_peered":"2023-10-06T04:28:10.796035+0000","last_clean":"2023-10-06T04:28:10.796035+0000","last_became_active":"2023-10-06T04:28:10.793329+0000","last_became_peered":"2023-10-06T04:28:10.793329+0000","last_unstale":"2023-10-06T04:28:10.796035+0000","last_undegraded":"2023-10-06T04:28:10.796035+0000","last_fullsized":"2023-10-06T04:28:10.796035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:11.414923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771921+0000","last_change":"2023-10-06T04:28:05.759061+0000","last_active":"2023-10-06T04:28:10.771921+0000","last_peered":"2023-10-06T04:28:10.771921+0000","last_clean":"2023-10-06T04:28:10.771921+0000","last_became_active":"2023-10-06T04:28:05.757716+0000","last_became_peered":"2023-10-06T04:28:05.757716+0000","last_unstale":"2023-10-06T04:28:10.771921+0000","last_undegraded":"2023-10-06T04:28:10.771921+0000","last_fullsized":"2023-10-06T04:28:10.771921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:37.282042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.766753+0000","last_change":"2023-10-06T04:28:06.339102+0000","last_active":"2023-10-06T04:28:10.766753+0000","last_peered":"2023-10-06T04:28:10.766753+0000","last_clean":"2023-10-06T04:28:10.766753+0000","last_became_active":"2023-10-06T04:28:06.338781+0000","last_became_peered":"2023-10-06T04:28:06.338781+0000","last_unstale":"2023-10-06T04:28:10.766753+0000","last_undegraded":"2023-10-06T04:28:10.766753+0000","last_fullsized":"2023-10-06T04:28:10.766753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:32.169844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.801878+0000","last_change":"2023-10-06T04:28:10.795685+0000","last_active":"2023-10-06T04:28:10.801878+0000","last_peered":"2023-10-06T04:28:10.801878+0000","last_clean":"2023-10-06T04:28:10.801878+0000","last_became_active":"2023-10-06T04:28:10.795281+0000","last_became_peered":"2023-10-06T04:28:10.795281+0000","last_unstale":"2023-10-06T04:28:10.801878+0000","last_undegraded":"2023-10-06T04:28:10.801878+0000","last_fullsized":"2023-10-06T04:28:10.801878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:11.414923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774978+0000","last_change":"2023-10-06T04:28:05.760540+0000","last_active":"2023-10-06T04:28:10.774978+0000","last_peered":"2023-10-06T04:28:10.774978+0000","last_clean":"2023-10-06T04:28:10.774978+0000","last_became_active":"2023-10-06T04:28:05.760213+0000","last_became_peered":"2023-10-06T04:28:05.760213+0000","last_unstale":"2023-10-06T04:28:10.774978+0000","last_undegraded":"2023-10-06T04:28:10.774978+0000","last_fullsized":"2023-10-06T04:28:10.774978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:13.125425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768541+0000","last_change":"2023-10-06T04:28:06.351862+0000","last_active":"2023-10-06T04:28:10.768541+0000","last_peered":"2023-10-06T04:28:10.768541+0000","last_clean":"2023-10-06T04:28:10.768541+0000","last_became_active":"2023-10-06T04:28:06.351613+0000","last_became_peered":"2023-10-06T04:28:06.351613+0000","last_unstale":"2023-10-06T04:28:10.768541+0000","last_undegraded":"2023-10-06T04:28:10.768541+0000","last_fullsized":"2023-10-06T04:28:10.768541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:36.507036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.798917+0000","last_change":"2023-10-06T04:28:10.791630+0000","last_active":"2023-10-06T04:28:10.798917+0000","last_peered":"2023-10-06T04:28:10.798917+0000","last_clean":"2023-10-06T04:28:10.798917+0000","last_became_active":"2023-10-06T04:28:10.791196+0000","last_became_peered":"2023-10-06T04:28:10.791196+0000","last_unstale":"2023-10-06T04:28:10.798917+0000","last_undegraded":"2023-10-06T04:28:10.798917+0000","last_fullsized":"2023-10-06T04:28:10.798917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.241552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779937+0000","last_change":"2023-10-06T04:28:05.761937+0000","last_active":"2023-10-06T04:28:10.779937+0000","last_peered":"2023-10-06T04:28:10.779937+0000","last_clean":"2023-10-06T04:28:10.779937+0000","last_became_active":"2023-10-06T04:28:05.761666+0000","last_became_peered":"2023-10-06T04:28:05.761666+0000","last_unstale":"2023-10-06T04:28:10.779937+0000","last_undegraded":"2023-10-06T04:28:10.779937+0000","last_fullsized":"2023-10-06T04:28:10.779937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:15.728042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770368+0000","last_change":"2023-10-06T04:28:06.350532+0000","last_active":"2023-10-06T04:28:10.770368+0000","last_peered":"2023-10-06T04:28:10.770368+0000","last_clean":"2023-10-06T04:28:10.770368+0000","last_became_active":"2023-10-06T04:28:06.349418+0000","last_became_peered":"2023-10-06T04:28:06.349418+0000","last_unstale":"2023-10-06T04:28:10.770368+0000","last_undegraded":"2023-10-06T04:28:10.770368+0000","last_fullsized":"2023-10-06T04:28:10.770368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:17.928102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802894+0000","last_change":"2023-10-06T04:28:10.798677+0000","last_active":"2023-10-06T04:28:10.802894+0000","last_peered":"2023-10-06T04:28:10.802894+0000","last_clean":"2023-10-06T04:28:10.802894+0000","last_became_active":"2023-10-06T04:28:10.798151+0000","last_became_peered":"2023-10-06T04:28:10.798151+0000","last_unstale":"2023-10-06T04:28:10.802894+0000","last_undegraded":"2023-10-06T04:28:10.802894+0000","last_fullsized":"2023-10-06T04:28:10.802894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:41.693487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.773597+0000","last_change":"2023-10-06T04:28:05.763239+0000","last_active":"2023-10-06T04:28:10.773597+0000","last_peered":"2023-10-06T04:28:10.773597+0000","last_clean":"2023-10-06T04:28:10.773597+0000","last_became_active":"2023-10-06T04:28:05.762943+0000","last_became_peered":"2023-10-06T04:28:05.762943+0000","last_unstale":"2023-10-06T04:28:10.773597+0000","last_undegraded":"2023-10-06T04:28:10.773597+0000","last_fullsized":"2023-10-06T04:28:10.773597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:31.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772811+0000","last_change":"2023-10-06T04:28:06.333362+0000","last_active":"2023-10-06T04:28:10.772811+0000","last_peered":"2023-10-06T04:28:10.772811+0000","last_clean":"2023-10-06T04:28:10.772811+0000","last_became_active":"2023-10-06T04:28:06.333122+0000","last_became_peered":"2023-10-06T04:28:06.333122+0000","last_unstale":"2023-10-06T04:28:10.772811+0000","last_undegraded":"2023-10-06T04:28:10.772811+0000","last_fullsized":"2023-10-06T04:28:10.772811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:14.542716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.795717+0000","last_change":"2023-10-06T04:28:10.791565+0000","last_active":"2023-10-06T04:28:10.795717+0000","last_peered":"2023-10-06T04:28:10.795717+0000","last_clean":"2023-10-06T04:28:10.795717+0000","last_became_active":"2023-10-06T04:28:10.791139+0000","last_became_peered":"2023-10-06T04:28:10.791139+0000","last_unstale":"2023-10-06T04:28:10.795717+0000","last_undegraded":"2023-10-06T04:28:10.795717+0000","last_fullsized":"2023-10-06T04:28:10.795717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:43.446834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770222+0000","last_change":"2023-10-06T04:28:05.755877+0000","last_active":"2023-10-06T04:28:10.770222+0000","last_peered":"2023-10-06T04:28:10.770222+0000","last_clean":"2023-10-06T04:28:10.770222+0000","last_became_active":"2023-10-06T04:28:05.755458+0000","last_became_peered":"2023-10-06T04:28:05.755458+0000","last_unstale":"2023-10-06T04:28:10.770222+0000","last_undegraded":"2023-10-06T04:28:10.770222+0000","last_fullsized":"2023-10-06T04:28:10.770222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:25.024995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770660+0000","last_change":"2023-10-06T04:28:06.344756+0000","last_active":"2023-10-06T04:28:10.770660+0000","last_peered":"2023-10-06T04:28:10.770660+0000","last_clean":"2023-10-06T04:28:10.770660+0000","last_became_active":"2023-10-06T04:28:06.344479+0000","last_became_peered":"2023-10-06T04:28:06.344479+0000","last_unstale":"2023-10-06T04:28:10.770660+0000","last_undegraded":"2023-10-06T04:28:10.770660+0000","last_fullsized":"2023-10-06T04:28:10.770660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:14.542716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769743+0000","last_change":"2023-10-06T04:28:06.332177+0000","last_active":"2023-10-06T04:28:10.769743+0000","last_peered":"2023-10-06T04:28:10.769743+0000","last_clean":"2023-10-06T04:28:10.769743+0000","last_became_active":"2023-10-06T04:28:06.331845+0000","last_became_peered":"2023-10-06T04:28:06.331845+0000","last_unstale":"2023-10-06T04:28:10.769743+0000","last_undegraded":"2023-10-06T04:28:10.769743+0000","last_fullsized":"2023-10-06T04:28:10.769743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:25.837873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772592+0000","last_change":"2023-10-06T04:28:06.341336+0000","last_active":"2023-10-06T04:28:10.772592+0000","last_peered":"2023-10-06T04:28:10.772592+0000","last_clean":"2023-10-06T04:28:10.772592+0000","last_became_active":"2023-10-06T04:28:06.341066+0000","last_became_peered":"2023-10-06T04:28:06.341066+0000","last_unstale":"2023-10-06T04:28:10.772592+0000","last_undegraded":"2023-10-06T04:28:10.772592+0000","last_fullsized":"2023-10-06T04:28:10.772592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:28.999532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770451+0000","last_change":"2023-10-06T04:28:06.346211+0000","last_active":"2023-10-06T04:28:10.770451+0000","last_peered":"2023-10-06T04:28:10.770451+0000","last_clean":"2023-10-06T04:28:10.770451+0000","last_became_active":"2023-10-06T04:28:06.345932+0000","last_became_peered":"2023-10-06T04:28:06.345932+0000","last_unstale":"2023-10-06T04:28:10.770451+0000","last_undegraded":"2023-10-06T04:28:10.770451+0000","last_fullsized":"2023-10-06T04:28:10.770451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:47.925435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771314+0000","last_change":"2023-10-06T04:28:06.337534+0000","last_active":"2023-10-06T04:28:10.771314+0000","last_peered":"2023-10-06T04:28:10.771314+0000","last_clean":"2023-10-06T04:28:10.771314+0000","last_became_active":"2023-10-06T04:28:06.337280+0000","last_became_peered":"2023-10-06T04:28:06.337280+0000","last_unstale":"2023-10-06T04:28:10.771314+0000","last_undegraded":"2023-10-06T04:28:10.771314+0000","last_fullsized":"2023-10-06T04:28:10.771314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:27.073025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774746+0000","last_change":"2023-10-06T04:28:06.336249+0000","last_active":"2023-10-06T04:28:10.774746+0000","last_peered":"2023-10-06T04:28:10.774746+0000","last_clean":"2023-10-06T04:28:10.774746+0000","last_became_active":"2023-10-06T04:28:06.335726+0000","last_became_peered":"2023-10-06T04:28:06.335726+0000","last_unstale":"2023-10-06T04:28:10.774746+0000","last_undegraded":"2023-10-06T04:28:10.774746+0000","last_fullsized":"2023-10-06T04:28:10.774746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:25.837873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":702778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302224,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069616,"statfs":{"total":96636764160,"available":96327286784,"internally_reserved":0,"allocated":860160,"data_stored":699826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":109034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301640,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070200,"statfs":{"total":96636764160,"available":96327884800,"internally_reserved":0,"allocated":262144,"data_stored":108480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":108570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":113228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":109104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:28:28.747 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:28:28.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.956+0000 7fac6119d700 1 Processor -- start 2023-10-06T04:28:28.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.956+0000 7fac6119d700 1 -- start start 2023-10-06T04:28:28.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.957+0000 7fac6119d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fac5c159390 0x7fac5c0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:28.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.957+0000 7fac6119d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fac5c159760 0x7fac5c0aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:28.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.957+0000 7fac6119d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5c0686c0 con 0x7fac5c0ab240 2023-10-06T04:28:28.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.957+0000 7fac6119d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5c068c80 con 0x7fac5c159760 2023-10-06T04:28:28.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.957+0000 7fac6119d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5c0ab660 con 0x7fac5c159390 2023-10-06T04:28:28.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.958+0000 7fac5b7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fac5c159760 0x7fac5c0aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:28.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.958+0000 7fac5b7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fac5c159760 0x7fac5c0aad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52214/0 (socket says 172.21.15.60:52214) 2023-10-06T04:28:28.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.958+0000 7fac5b7fe700 1 -- 172.21.15.60:0/2337648745 learned_addr learned my addr 172.21.15.60:0/2337648745 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:28.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.958+0000 7fac5bfff700 1 --2- 172.21.15.60:0/2337648745 >> v2:172.21.15.135:3300/0 conn(0x7fac5c159390 0x7fac5c0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:28.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.958+0000 7fac5b7fe700 1 -- 172.21.15.60:0/2337648745 >> v2:172.21.15.135:3300/0 conn(0x7fac5c159390 msgr2=0x7fac5c0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:28.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.958+0000 7fac5b7fe700 1 --2- 172.21.15.60:0/2337648745 >> v2:172.21.15.135:3300/0 conn(0x7fac5c159390 0x7fac5c0ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.958+0000 7fac5b7fe700 1 -- 172.21.15.60:0/2337648745 >> v1:172.21.15.135:6789/0 conn(0x7fac5c0ab240 legacy=0x7fac5c069110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:28.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.958+0000 7fac5b7fe700 1 -- 172.21.15.60:0/2337648745 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c0ace20 con 0x7fac5c159760 2023-10-06T04:28:28.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.958+0000 7fac5b7fe700 1 --2- 172.21.15.60:0/2337648745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac5c159760 0x7fac5c0aad00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fac5c06eb90 tx=0x7fac50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d595c2d15ffef0a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:28.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.959+0000 7fac5affd700 1 -- 172.21.15.60:0/2337648745 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5000b820 con 0x7fac5c159760 2023-10-06T04:28:28.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.959+0000 7fac5affd700 1 -- 172.21.15.60:0/2337648745 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5000b980 con 0x7fac5c159760 2023-10-06T04:28:28.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.959+0000 7fac5affd700 1 -- 172.21.15.60:0/2337648745 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5000bd20 con 0x7fac5c159760 2023-10-06T04:28:28.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.959+0000 7fac6119d700 1 -- 172.21.15.60:0/2337648745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac5c159760 msgr2=0x7fac5c0aad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.959+0000 7fac6119d700 1 --2- 172.21.15.60:0/2337648745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac5c159760 0x7fac5c0aad00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fac5c06eb90 tx=0x7fac50009250 comp rx=0 tx=0).stop 2023-10-06T04:28:28.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.959+0000 7fac6119d700 1 -- 172.21.15.60:0/2337648745 shutdown_connections 2023-10-06T04:28:28.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.959+0000 7fac6119d700 1 --2- 172.21.15.60:0/2337648745 >> v2:172.21.15.135:3300/0 conn(0x7fac5c159390 0x7fac5c0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.959+0000 7fac6119d700 1 --2- 172.21.15.60:0/2337648745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac5c159760 0x7fac5c0aad00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.959+0000 7fac6119d700 1 -- 172.21.15.60:0/2337648745 >> 172.21.15.60:0/2337648745 conn(0x7fac5c097410 msgr2=0x7fac5c067d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:28.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.959+0000 7fac6119d700 1 -- 172.21.15.60:0/2337648745 shutdown_connections 2023-10-06T04:28:28.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.959+0000 7fac6119d700 1 -- 172.21.15.60:0/2337648745 wait complete. 2023-10-06T04:28:28.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.961+0000 7fac6119d700 1 Processor -- start 2023-10-06T04:28:28.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.961+0000 7fac6119d700 1 -- start start 2023-10-06T04:28:28.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.962+0000 7fac6119d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac5c0ab240 0x7fac5c153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:28.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.962+0000 7fac6119d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac5c159390 0x7fac5c15a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:28.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.962+0000 7fac6119d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac5c159760 0x7fac5c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:28.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.962+0000 7fac6119d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c15cc40 con 0x7fac5c159390 2023-10-06T04:28:28.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.962+0000 7fac6119d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0b10d0 con 0x7fac5c0ab240 2023-10-06T04:28:28.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.962+0000 7fac6119d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c1544c0 con 0x7fac5c159760 2023-10-06T04:28:28.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.962+0000 7fac5b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac5c159390 0x7fac5c15a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:28.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.962+0000 7fac5b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac5c159390 0x7fac5c15a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52230/0 (socket says 172.21.15.60:52230) 2023-10-06T04:28:28.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.962+0000 7fac5b7fe700 1 -- 172.21.15.60:0/3459398884 learned_addr learned my addr 172.21.15.60:0/3459398884 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:28.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.962+0000 7fac5bfff700 1 --2- 172.21.15.60:0/3459398884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac5c0ab240 0x7fac5c153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:28.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.962+0000 7fac6099c700 1 --2- 172.21.15.60:0/3459398884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac5c159760 0x7fac5c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:28.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.962+0000 7fac5b7fe700 1 -- 172.21.15.60:0/3459398884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac5c159760 msgr2=0x7fac5c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.962+0000 7fac5b7fe700 1 --2- 172.21.15.60:0/3459398884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac5c159760 0x7fac5c15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.962+0000 7fac5b7fe700 1 -- 172.21.15.60:0/3459398884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac5c0ab240 msgr2=0x7fac5c153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:28.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.962+0000 7fac5b7fe700 1 --2- 172.21.15.60:0/3459398884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac5c0ab240 0x7fac5c153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:28.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.962+0000 7fac5b7fe700 1 -- 172.21.15.60:0/3459398884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac500094f0 con 0x7fac5c159390 2023-10-06T04:28:28.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.963+0000 7fac5b7fe700 1 --2- 172.21.15.60:0/3459398884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac5c159390 0x7fac5c15a1b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fac50009290 tx=0x7fac50016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:28.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.963+0000 7fac43fff700 1 -- 172.21.15.60:0/3459398884 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac50011e20 con 0x7fac5c159390 2023-10-06T04:28:28.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.963+0000 7fac43fff700 1 -- 172.21.15.60:0/3459398884 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac50020070 con 0x7fac5c159390 2023-10-06T04:28:28.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.963+0000 7fac43fff700 1 -- 172.21.15.60:0/3459398884 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5001b6a0 con 0x7fac5c159390 2023-10-06T04:28:28.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.963+0000 7fac6119d700 1 -- 172.21.15.60:0/3459398884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5c15c3a0 con 0x7fac5c159390 2023-10-06T04:28:28.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.963+0000 7fac6119d700 1 -- 172.21.15.60:0/3459398884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5c15c960 con 0x7fac5c159390 2023-10-06T04:28:28.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.964+0000 7fac6119d700 1 -- 172.21.15.60:0/3459398884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5c0b1240 con 0x7fac5c159390 2023-10-06T04:28:28.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.965+0000 7fac43fff700 1 -- 172.21.15.60:0/3459398884 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac50022030 con 0x7fac5c159390 2023-10-06T04:28:28.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.966+0000 7fac43fff700 1 --2- 172.21.15.60:0/3459398884 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fac48066f30 0x7fac480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:28.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.966+0000 7fac43fff700 1 -- 172.21.15.60:0/3459398884 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fac50086970 con 0x7fac5c159390 2023-10-06T04:28:28.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.966+0000 7fac5bfff700 1 --2- 172.21.15.60:0/3459398884 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fac48066f30 0x7fac480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:28.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.967+0000 7fac5bfff700 1 --2- 172.21.15.60:0/3459398884 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fac48066f30 0x7fac480693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fac4c006fd0 tx=0x7fac4c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:28.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:28.970+0000 7fac43fff700 1 -- 172.21.15.60:0/3459398884 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac500536f0 con 0x7fac5c159390 2023-10-06T04:28:29.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.170+0000 7fac6119d700 1 -- 172.21.15.60:0/3459398884 --> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac5c0b1240 con 0x7fac48066f30 2023-10-06T04:28:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.181+0000 7fac43fff700 1 -- 172.21.15.60:0/3459398884 <== mgr.4098 v2:172.21.15.60:6832/85285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367621 (secure 0 0 0) 0x7fac5c0b1240 con 0x7fac48066f30 2023-10-06T04:28:29.187 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:29.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.186+0000 7fac6119d700 1 -- 172.21.15.60:0/3459398884 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fac48066f30 msgr2=0x7fac480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:29.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.186+0000 7fac6119d700 1 --2- 172.21.15.60:0/3459398884 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fac48066f30 0x7fac480693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fac4c006fd0 tx=0x7fac4c008040 comp rx=0 tx=0).stop 2023-10-06T04:28:29.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.186+0000 7fac6119d700 1 -- 172.21.15.60:0/3459398884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac5c159390 msgr2=0x7fac5c15a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:29.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.186+0000 7fac6119d700 1 --2- 172.21.15.60:0/3459398884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac5c159390 0x7fac5c15a1b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fac50009290 tx=0x7fac50016000 comp rx=0 tx=0).stop 2023-10-06T04:28:29.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.186+0000 7fac6119d700 1 -- 172.21.15.60:0/3459398884 shutdown_connections 2023-10-06T04:28:29.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.186+0000 7fac6119d700 1 --2- 172.21.15.60:0/3459398884 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fac48066f30 0x7fac480693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:29.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.186+0000 7fac6119d700 1 --2- 172.21.15.60:0/3459398884 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fac5c159760 0x7fac5c15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:29.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.186+0000 7fac6119d700 1 --2- 172.21.15.60:0/3459398884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac5c0ab240 0x7fac5c153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:29.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.186+0000 7fac6119d700 1 --2- 172.21.15.60:0/3459398884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac5c159390 0x7fac5c15a1b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:29.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.186+0000 7fac6119d700 1 -- 172.21.15.60:0/3459398884 >> 172.21.15.60:0/3459398884 conn(0x7fac5c097410 msgr2=0x7fac5c06cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:29.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.186+0000 7fac6119d700 1 -- 172.21.15.60:0/3459398884 shutdown_connections 2023-10-06T04:28:29.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.186+0000 7fac6119d700 1 -- 172.21.15.60:0/3459398884 wait complete. 2023-10-06T04:28:29.191 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-06T04:28:29.206 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-10-06T04:28:27.314710+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397972,"kb_used_data":3284,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752576748,"statfs":{"total":773094113280,"available":770638589952,"internally_reserved":0,"allocated":3362816,"data_stored":2060478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002651"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.767703+0000","last_change":"2023-10-06T04:28:06.333183+0000","last_active":"2023-10-06T04:28:10.767703+0000","last_peered":"2023-10-06T04:28:10.767703+0000","last_clean":"2023-10-06T04:28:10.767703+0000","last_became_active":"2023-10-06T04:28:06.332860+0000","last_became_peered":"2023-10-06T04:28:06.332860+0000","last_unstale":"2023-10-06T04:28:10.767703+0000","last_undegraded":"2023-10-06T04:28:10.767703+0000","last_fullsized":"2023-10-06T04:28:10.767703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:32.786074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.778681+0000","last_change":"2023-10-06T04:28:06.344458+0000","last_active":"2023-10-06T04:28:10.778681+0000","last_peered":"2023-10-06T04:28:10.778681+0000","last_clean":"2023-10-06T04:28:10.778681+0000","last_became_active":"2023-10-06T04:28:06.344197+0000","last_became_peered":"2023-10-06T04:28:06.344197+0000","last_unstale":"2023-10-06T04:28:10.778681+0000","last_undegraded":"2023-10-06T04:28:10.778681+0000","last_fullsized":"2023-10-06T04:28:10.778681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:34.925929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769634+0000","last_change":"2023-10-06T04:28:06.349096+0000","last_active":"2023-10-06T04:28:10.769634+0000","last_peered":"2023-10-06T04:28:10.769634+0000","last_clean":"2023-10-06T04:28:10.769634+0000","last_became_active":"2023-10-06T04:28:06.348569+0000","last_became_peered":"2023-10-06T04:28:06.348569+0000","last_unstale":"2023-10-06T04:28:10.769634+0000","last_undegraded":"2023-10-06T04:28:10.769634+0000","last_fullsized":"2023-10-06T04:28:10.769634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:32.246348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768718+0000","last_change":"2023-10-06T04:28:06.343369+0000","last_active":"2023-10-06T04:28:10.768718+0000","last_peered":"2023-10-06T04:28:10.768718+0000","last_clean":"2023-10-06T04:28:10.768718+0000","last_became_active":"2023-10-06T04:28:06.342720+0000","last_became_peered":"2023-10-06T04:28:06.342720+0000","last_unstale":"2023-10-06T04:28:10.768718+0000","last_undegraded":"2023-10-06T04:28:10.768718+0000","last_fullsized":"2023-10-06T04:28:10.768718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:25.121736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772088+0000","last_change":"2023-10-06T04:28:06.340210+0000","last_active":"2023-10-06T04:28:10.772088+0000","last_peered":"2023-10-06T04:28:10.772088+0000","last_clean":"2023-10-06T04:28:10.772088+0000","last_became_active":"2023-10-06T04:28:06.339725+0000","last_became_peered":"2023-10-06T04:28:06.339725+0000","last_unstale":"2023-10-06T04:28:10.772088+0000","last_undegraded":"2023-10-06T04:28:10.772088+0000","last_fullsized":"2023-10-06T04:28:10.772088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:59.952485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770264+0000","last_change":"2023-10-06T04:28:06.348877+0000","last_active":"2023-10-06T04:28:10.770264+0000","last_peered":"2023-10-06T04:28:10.770264+0000","last_clean":"2023-10-06T04:28:10.770264+0000","last_became_active":"2023-10-06T04:28:06.348593+0000","last_became_peered":"2023-10-06T04:28:06.348593+0000","last_unstale":"2023-10-06T04:28:10.770264+0000","last_undegraded":"2023-10-06T04:28:10.770264+0000","last_fullsized":"2023-10-06T04:28:10.770264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:58.373238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774127+0000","last_change":"2023-10-06T04:28:06.341608+0000","last_active":"2023-10-06T04:28:10.774127+0000","last_peered":"2023-10-06T04:28:10.774127+0000","last_clean":"2023-10-06T04:28:10.774127+0000","last_became_active":"2023-10-06T04:28:06.341341+0000","last_became_peered":"2023-10-06T04:28:06.341341+0000","last_unstale":"2023-10-06T04:28:10.774127+0000","last_undegraded":"2023-10-06T04:28:10.774127+0000","last_fullsized":"2023-10-06T04:28:10.774127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:25.299896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.775047+0000","last_change":"2023-10-06T04:28:06.352230+0000","last_active":"2023-10-06T04:28:10.775047+0000","last_peered":"2023-10-06T04:28:10.775047+0000","last_clean":"2023-10-06T04:28:10.775047+0000","last_became_active":"2023-10-06T04:28:06.351946+0000","last_became_peered":"2023-10-06T04:28:06.351946+0000","last_unstale":"2023-10-06T04:28:10.775047+0000","last_undegraded":"2023-10-06T04:28:10.775047+0000","last_fullsized":"2023-10-06T04:28:10.775047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:39.187212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769280+0000","last_change":"2023-10-06T04:28:06.349388+0000","last_active":"2023-10-06T04:28:10.769280+0000","last_peered":"2023-10-06T04:28:10.769280+0000","last_clean":"2023-10-06T04:28:10.769280+0000","last_became_active":"2023-10-06T04:28:06.349059+0000","last_became_peered":"2023-10-06T04:28:06.349059+0000","last_unstale":"2023-10-06T04:28:10.769280+0000","last_undegraded":"2023-10-06T04:28:10.769280+0000","last_fullsized":"2023-10-06T04:28:10.769280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:17.928102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.778830+0000","last_change":"2023-10-06T04:28:06.346835+0000","last_active":"2023-10-06T04:28:10.778830+0000","last_peered":"2023-10-06T04:28:10.778830+0000","last_clean":"2023-10-06T04:28:10.778830+0000","last_became_active":"2023-10-06T04:28:06.346555+0000","last_became_peered":"2023-10-06T04:28:06.346555+0000","last_unstale":"2023-10-06T04:28:10.778830+0000","last_undegraded":"2023-10-06T04:28:10.778830+0000","last_fullsized":"2023-10-06T04:28:10.778830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:27.073025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769556+0000","last_change":"2023-10-06T04:28:06.349715+0000","last_active":"2023-10-06T04:28:10.769556+0000","last_peered":"2023-10-06T04:28:10.769556+0000","last_clean":"2023-10-06T04:28:10.769556+0000","last_became_active":"2023-10-06T04:28:06.347463+0000","last_became_peered":"2023-10-06T04:28:06.347463+0000","last_unstale":"2023-10-06T04:28:10.769556+0000","last_undegraded":"2023-10-06T04:28:10.769556+0000","last_fullsized":"2023-10-06T04:28:10.769556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:20.864954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.766598+0000","last_change":"2023-10-06T04:28:06.352759+0000","last_active":"2023-10-06T04:28:10.766598+0000","last_peered":"2023-10-06T04:28:10.766598+0000","last_clean":"2023-10-06T04:28:10.766598+0000","last_became_active":"2023-10-06T04:28:06.352427+0000","last_became_peered":"2023-10-06T04:28:06.352427+0000","last_unstale":"2023-10-06T04:28:10.766598+0000","last_undegraded":"2023-10-06T04:28:10.766598+0000","last_fullsized":"2023-10-06T04:28:10.766598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:14.134133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768223+0000","last_change":"2023-10-06T04:28:06.331950+0000","last_active":"2023-10-06T04:28:10.768223+0000","last_peered":"2023-10-06T04:28:10.768223+0000","last_clean":"2023-10-06T04:28:10.768223+0000","last_became_active":"2023-10-06T04:28:06.331660+0000","last_became_peered":"2023-10-06T04:28:06.331660+0000","last_unstale":"2023-10-06T04:28:10.768223+0000","last_undegraded":"2023-10-06T04:28:10.768223+0000","last_fullsized":"2023-10-06T04:28:10.768223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:01:34.147816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.775071+0000","last_change":"2023-10-06T04:28:06.344093+0000","last_active":"2023-10-06T04:28:10.775071+0000","last_peered":"2023-10-06T04:28:10.775071+0000","last_clean":"2023-10-06T04:28:10.775071+0000","last_became_active":"2023-10-06T04:28:06.343647+0000","last_became_peered":"2023-10-06T04:28:06.343647+0000","last_unstale":"2023-10-06T04:28:10.775071+0000","last_undegraded":"2023-10-06T04:28:10.775071+0000","last_fullsized":"2023-10-06T04:28:10.775071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:25.299896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.773879+0000","last_change":"2023-10-06T04:28:06.341653+0000","last_active":"2023-10-06T04:28:10.773879+0000","last_peered":"2023-10-06T04:28:10.773879+0000","last_clean":"2023-10-06T04:28:10.773879+0000","last_became_active":"2023-10-06T04:28:06.341377+0000","last_became_peered":"2023-10-06T04:28:06.341377+0000","last_unstale":"2023-10-06T04:28:10.773879+0000","last_undegraded":"2023-10-06T04:28:10.773879+0000","last_fullsized":"2023-10-06T04:28:10.773879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:15.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770685+0000","last_change":"2023-10-06T04:28:06.348854+0000","last_active":"2023-10-06T04:28:10.770685+0000","last_peered":"2023-10-06T04:28:10.770685+0000","last_clean":"2023-10-06T04:28:10.770685+0000","last_became_active":"2023-10-06T04:28:06.348503+0000","last_became_peered":"2023-10-06T04:28:06.348503+0000","last_unstale":"2023-10-06T04:28:10.770685+0000","last_undegraded":"2023-10-06T04:28:10.770685+0000","last_fullsized":"2023-10-06T04:28:10.770685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:28.999532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769974+0000","last_change":"2023-10-06T04:28:06.344544+0000","last_active":"2023-10-06T04:28:10.769974+0000","last_peered":"2023-10-06T04:28:10.769974+0000","last_clean":"2023-10-06T04:28:10.769974+0000","last_became_active":"2023-10-06T04:28:06.342776+0000","last_became_peered":"2023-10-06T04:28:06.342776+0000","last_unstale":"2023-10-06T04:28:10.769974+0000","last_undegraded":"2023-10-06T04:28:10.769974+0000","last_fullsized":"2023-10-06T04:28:10.769974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:14.542716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769109+0000","last_change":"2023-10-06T04:28:06.352912+0000","last_active":"2023-10-06T04:28:10.769109+0000","last_peered":"2023-10-06T04:28:10.769109+0000","last_clean":"2023-10-06T04:28:10.769109+0000","last_became_active":"2023-10-06T04:28:06.352449+0000","last_became_peered":"2023-10-06T04:28:06.352449+0000","last_unstale":"2023-10-06T04:28:10.769109+0000","last_undegraded":"2023-10-06T04:28:10.769109+0000","last_fullsized":"2023-10-06T04:28:10.769109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:07.389056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768234+0000","last_change":"2023-10-06T04:28:06.339688+0000","last_active":"2023-10-06T04:28:10.768234+0000","last_peered":"2023-10-06T04:28:10.768234+0000","last_clean":"2023-10-06T04:28:10.768234+0000","last_became_active":"2023-10-06T04:28:06.339427+0000","last_became_peered":"2023-10-06T04:28:06.339427+0000","last_unstale":"2023-10-06T04:28:10.768234+0000","last_undegraded":"2023-10-06T04:28:10.768234+0000","last_fullsized":"2023-10-06T04:28:10.768234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:25.189214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771104+0000","last_change":"2023-10-06T04:28:06.351544+0000","last_active":"2023-10-06T04:28:10.771104+0000","last_peered":"2023-10-06T04:28:10.771104+0000","last_clean":"2023-10-06T04:28:10.771104+0000","last_became_active":"2023-10-06T04:28:06.351250+0000","last_became_peered":"2023-10-06T04:28:06.351250+0000","last_unstale":"2023-10-06T04:28:10.771104+0000","last_undegraded":"2023-10-06T04:28:10.771104+0000","last_fullsized":"2023-10-06T04:28:10.771104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:20.083329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776616+0000","last_change":"2023-10-06T04:28:06.339922+0000","last_active":"2023-10-06T04:28:10.776616+0000","last_peered":"2023-10-06T04:28:10.776616+0000","last_clean":"2023-10-06T04:28:10.776616+0000","last_became_active":"2023-10-06T04:28:06.339645+0000","last_became_peered":"2023-10-06T04:28:06.339645+0000","last_unstale":"2023-10-06T04:28:10.776616+0000","last_undegraded":"2023-10-06T04:28:10.776616+0000","last_fullsized":"2023-10-06T04:28:10.776616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:34.925929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769587+0000","last_change":"2023-10-06T04:28:06.340838+0000","last_active":"2023-10-06T04:28:10.769587+0000","last_peered":"2023-10-06T04:28:10.769587+0000","last_clean":"2023-10-06T04:28:10.769587+0000","last_became_active":"2023-10-06T04:28:06.340585+0000","last_became_peered":"2023-10-06T04:28:06.340585+0000","last_unstale":"2023-10-06T04:28:10.769587+0000","last_undegraded":"2023-10-06T04:28:10.769587+0000","last_fullsized":"2023-10-06T04:28:10.769587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:15.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772671+0000","last_change":"2023-10-06T04:28:06.341897+0000","last_active":"2023-10-06T04:28:10.772671+0000","last_peered":"2023-10-06T04:28:10.772671+0000","last_clean":"2023-10-06T04:28:10.772671+0000","last_became_active":"2023-10-06T04:28:06.341660+0000","last_became_peered":"2023-10-06T04:28:06.341660+0000","last_unstale":"2023-10-06T04:28:10.772671+0000","last_undegraded":"2023-10-06T04:28:10.772671+0000","last_fullsized":"2023-10-06T04:28:10.772671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:20.864954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.777630+0000","last_change":"2023-10-06T04:28:06.351307+0000","last_active":"2023-10-06T04:28:10.777630+0000","last_peered":"2023-10-06T04:28:10.777630+0000","last_clean":"2023-10-06T04:28:10.777630+0000","last_became_active":"2023-10-06T04:28:06.351018+0000","last_became_peered":"2023-10-06T04:28:06.351018+0000","last_unstale":"2023-10-06T04:28:10.777630+0000","last_undegraded":"2023-10-06T04:28:10.777630+0000","last_fullsized":"2023-10-06T04:28:10.777630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:39.187212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.773769+0000","last_change":"2023-10-06T04:28:06.335571+0000","last_active":"2023-10-06T04:28:10.773769+0000","last_peered":"2023-10-06T04:28:10.773769+0000","last_clean":"2023-10-06T04:28:10.773769+0000","last_became_active":"2023-10-06T04:28:06.335306+0000","last_became_peered":"2023-10-06T04:28:06.335306+0000","last_unstale":"2023-10-06T04:28:10.773769+0000","last_undegraded":"2023-10-06T04:28:10.773769+0000","last_fullsized":"2023-10-06T04:28:10.773769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:13.160015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.781232+0000","last_change":"2023-10-06T04:28:06.334344+0000","last_active":"2023-10-06T04:28:10.781232+0000","last_peered":"2023-10-06T04:28:10.781232+0000","last_clean":"2023-10-06T04:28:10.781232+0000","last_became_active":"2023-10-06T04:28:06.334085+0000","last_became_peered":"2023-10-06T04:28:06.334085+0000","last_unstale":"2023-10-06T04:28:10.781232+0000","last_undegraded":"2023-10-06T04:28:10.781232+0000","last_fullsized":"2023-10-06T04:28:10.781232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:30.857061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779760+0000","last_change":"2023-10-06T04:28:06.347690+0000","last_active":"2023-10-06T04:28:10.779760+0000","last_peered":"2023-10-06T04:28:10.779760+0000","last_clean":"2023-10-06T04:28:10.779760+0000","last_became_active":"2023-10-06T04:28:06.347352+0000","last_became_peered":"2023-10-06T04:28:06.347352+0000","last_unstale":"2023-10-06T04:28:10.779760+0000","last_undegraded":"2023-10-06T04:28:10.779760+0000","last_fullsized":"2023-10-06T04:28:10.779760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:15.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802995+0000","last_change":"2023-10-06T04:28:10.801453+0000","last_active":"2023-10-06T04:28:10.802995+0000","last_peered":"2023-10-06T04:28:10.802995+0000","last_clean":"2023-10-06T04:28:10.802995+0000","last_became_active":"2023-10-06T04:28:10.801079+0000","last_became_peered":"2023-10-06T04:28:10.801079+0000","last_unstale":"2023-10-06T04:28:10.802995+0000","last_undegraded":"2023-10-06T04:28:10.802995+0000","last_fullsized":"2023-10-06T04:28:10.802995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:36.131936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770166+0000","last_change":"2023-10-06T04:28:05.761188+0000","last_active":"2023-10-06T04:28:10.770166+0000","last_peered":"2023-10-06T04:28:10.770166+0000","last_clean":"2023-10-06T04:28:10.770166+0000","last_became_active":"2023-10-06T04:28:05.760899+0000","last_became_peered":"2023-10-06T04:28:05.760899+0000","last_unstale":"2023-10-06T04:28:10.770166+0000","last_undegraded":"2023-10-06T04:28:10.770166+0000","last_fullsized":"2023-10-06T04:28:10.770166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:01:33.139108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770473+0000","last_change":"2023-10-06T04:28:06.341518+0000","last_active":"2023-10-06T04:28:10.770473+0000","last_peered":"2023-10-06T04:28:10.770473+0000","last_clean":"2023-10-06T04:28:10.770473+0000","last_became_active":"2023-10-06T04:28:06.341202+0000","last_became_peered":"2023-10-06T04:28:06.341202+0000","last_unstale":"2023-10-06T04:28:10.770473+0000","last_undegraded":"2023-10-06T04:28:10.770473+0000","last_fullsized":"2023-10-06T04:28:10.770473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:59.952485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.801053+0000","last_change":"2023-10-06T04:28:10.795457+0000","last_active":"2023-10-06T04:28:10.801053+0000","last_peered":"2023-10-06T04:28:10.801053+0000","last_clean":"2023-10-06T04:28:10.801053+0000","last_became_active":"2023-10-06T04:28:10.795098+0000","last_became_peered":"2023-10-06T04:28:10.795098+0000","last_unstale":"2023-10-06T04:28:10.801053+0000","last_undegraded":"2023-10-06T04:28:10.801053+0000","last_fullsized":"2023-10-06T04:28:10.801053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:13.098060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776901+0000","last_change":"2023-10-06T04:28:05.756129+0000","last_active":"2023-10-06T04:28:10.776901+0000","last_peered":"2023-10-06T04:28:10.776901+0000","last_clean":"2023-10-06T04:28:10.776901+0000","last_became_active":"2023-10-06T04:28:05.755795+0000","last_became_peered":"2023-10-06T04:28:05.755795+0000","last_unstale":"2023-10-06T04:28:10.776901+0000","last_undegraded":"2023-10-06T04:28:10.776901+0000","last_fullsized":"2023-10-06T04:28:10.776901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:31.777366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769931+0000","last_change":"2023-10-06T04:28:06.345205+0000","last_active":"2023-10-06T04:28:10.769931+0000","last_peered":"2023-10-06T04:28:10.769931+0000","last_clean":"2023-10-06T04:28:10.769931+0000","last_became_active":"2023-10-06T04:28:06.342334+0000","last_became_peered":"2023-10-06T04:28:06.342334+0000","last_unstale":"2023-10-06T04:28:10.769931+0000","last_undegraded":"2023-10-06T04:28:10.769931+0000","last_fullsized":"2023-10-06T04:28:10.769931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:27.073025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.793941+0000","last_change":"2023-10-06T04:28:10.792492+0000","last_active":"2023-10-06T04:28:10.793941+0000","last_peered":"2023-10-06T04:28:10.793941+0000","last_clean":"2023-10-06T04:28:10.793941+0000","last_became_active":"2023-10-06T04:28:10.791665+0000","last_became_peered":"2023-10-06T04:28:10.791665+0000","last_unstale":"2023-10-06T04:28:10.793941+0000","last_undegraded":"2023-10-06T04:28:10.793941+0000","last_fullsized":"2023-10-06T04:28:10.793941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:52.113969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771973+0000","last_change":"2023-10-06T04:28:05.766695+0000","last_active":"2023-10-06T04:28:10.771973+0000","last_peered":"2023-10-06T04:28:10.771973+0000","last_clean":"2023-10-06T04:28:10.771973+0000","last_became_active":"2023-10-06T04:28:05.766394+0000","last_became_peered":"2023-10-06T04:28:05.766394+0000","last_unstale":"2023-10-06T04:28:10.771973+0000","last_undegraded":"2023-10-06T04:28:10.771973+0000","last_fullsized":"2023-10-06T04:28:10.771973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:01.869120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769616+0000","last_change":"2023-10-06T04:28:06.340699+0000","last_active":"2023-10-06T04:28:10.769616+0000","last_peered":"2023-10-06T04:28:10.769616+0000","last_clean":"2023-10-06T04:28:10.769616+0000","last_became_active":"2023-10-06T04:28:06.339789+0000","last_became_peered":"2023-10-06T04:28:06.339789+0000","last_unstale":"2023-10-06T04:28:10.769616+0000","last_undegraded":"2023-10-06T04:28:10.769616+0000","last_fullsized":"2023-10-06T04:28:10.769616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:30.857061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.807709+0000","last_change":"2023-10-06T04:28:10.804204+0000","last_active":"2023-10-06T04:28:10.807709+0000","last_peered":"2023-10-06T04:28:10.807709+0000","last_clean":"2023-10-06T04:28:10.807709+0000","last_became_active":"2023-10-06T04:28:10.803790+0000","last_became_peered":"2023-10-06T04:28:10.803790+0000","last_unstale":"2023-10-06T04:28:10.807709+0000","last_undegraded":"2023-10-06T04:28:10.807709+0000","last_fullsized":"2023-10-06T04:28:10.807709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:24.109196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770090+0000","last_change":"2023-10-06T04:28:05.755711+0000","last_active":"2023-10-06T04:28:10.770090+0000","last_peered":"2023-10-06T04:28:10.770090+0000","last_clean":"2023-10-06T04:28:10.770090+0000","last_became_active":"2023-10-06T04:28:05.755078+0000","last_became_peered":"2023-10-06T04:28:05.755078+0000","last_unstale":"2023-10-06T04:28:10.770090+0000","last_undegraded":"2023-10-06T04:28:10.770090+0000","last_fullsized":"2023-10-06T04:28:10.770090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:13.125425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771897+0000","last_change":"2023-10-06T04:28:06.341424+0000","last_active":"2023-10-06T04:28:10.771897+0000","last_peered":"2023-10-06T04:28:10.771897+0000","last_clean":"2023-10-06T04:28:10.771897+0000","last_became_active":"2023-10-06T04:28:06.341143+0000","last_became_peered":"2023-10-06T04:28:06.341143+0000","last_unstale":"2023-10-06T04:28:10.771897+0000","last_undegraded":"2023-10-06T04:28:10.771897+0000","last_fullsized":"2023-10-06T04:28:10.771897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:58.373238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802044+0000","last_change":"2023-10-06T04:28:10.795677+0000","last_active":"2023-10-06T04:28:10.802044+0000","last_peered":"2023-10-06T04:28:10.802044+0000","last_clean":"2023-10-06T04:28:10.802044+0000","last_became_active":"2023-10-06T04:28:10.795322+0000","last_became_peered":"2023-10-06T04:28:10.795322+0000","last_unstale":"2023-10-06T04:28:10.802044+0000","last_undegraded":"2023-10-06T04:28:10.802044+0000","last_fullsized":"2023-10-06T04:28:10.802044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:43.446834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.778777+0000","last_change":"2023-10-06T04:28:05.755211+0000","last_active":"2023-10-06T04:28:10.778777+0000","last_peered":"2023-10-06T04:28:10.778777+0000","last_clean":"2023-10-06T04:28:10.778777+0000","last_became_active":"2023-10-06T04:28:05.754921+0000","last_became_peered":"2023-10-06T04:28:05.754921+0000","last_unstale":"2023-10-06T04:28:10.778777+0000","last_undegraded":"2023-10-06T04:28:10.778777+0000","last_fullsized":"2023-10-06T04:28:10.778777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:24.180507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772506+0000","last_change":"2023-10-06T04:28:06.337449+0000","last_active":"2023-10-06T04:28:10.772506+0000","last_peered":"2023-10-06T04:28:10.772506+0000","last_clean":"2023-10-06T04:28:10.772506+0000","last_became_active":"2023-10-06T04:28:06.337164+0000","last_became_peered":"2023-10-06T04:28:06.337164+0000","last_unstale":"2023-10-06T04:28:10.772506+0000","last_undegraded":"2023-10-06T04:28:10.772506+0000","last_fullsized":"2023-10-06T04:28:10.772506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:39.187212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.809084+0000","last_change":"2023-10-06T04:28:10.805106+0000","last_active":"2023-10-06T04:28:10.809084+0000","last_peered":"2023-10-06T04:28:10.809084+0000","last_clean":"2023-10-06T04:28:10.809084+0000","last_became_active":"2023-10-06T04:28:10.804660+0000","last_became_peered":"2023-10-06T04:28:10.804660+0000","last_unstale":"2023-10-06T04:28:10.809084+0000","last_undegraded":"2023-10-06T04:28:10.809084+0000","last_fullsized":"2023-10-06T04:28:10.809084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:33:06.767121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779391+0000","last_change":"2023-10-06T04:28:05.763511+0000","last_active":"2023-10-06T04:28:10.779391+0000","last_peered":"2023-10-06T04:28:10.779391+0000","last_clean":"2023-10-06T04:28:10.779391+0000","last_became_active":"2023-10-06T04:28:05.763165+0000","last_became_peered":"2023-10-06T04:28:05.763165+0000","last_unstale":"2023-10-06T04:28:10.779391+0000","last_undegraded":"2023-10-06T04:28:10.779391+0000","last_fullsized":"2023-10-06T04:28:10.779391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:58.212679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.780725+0000","last_change":"2023-10-06T04:28:06.335419+0000","last_active":"2023-10-06T04:28:10.780725+0000","last_peered":"2023-10-06T04:28:10.780725+0000","last_clean":"2023-10-06T04:28:10.780725+0000","last_became_active":"2023-10-06T04:28:06.335165+0000","last_became_peered":"2023-10-06T04:28:06.335165+0000","last_unstale":"2023-10-06T04:28:10.780725+0000","last_undegraded":"2023-10-06T04:28:10.780725+0000","last_fullsized":"2023-10-06T04:28:10.780725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:15.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.795671+0000","last_change":"2023-10-06T04:28:10.791897+0000","last_active":"2023-10-06T04:28:10.795671+0000","last_peered":"2023-10-06T04:28:10.795671+0000","last_clean":"2023-10-06T04:28:10.795671+0000","last_became_active":"2023-10-06T04:28:10.791427+0000","last_became_peered":"2023-10-06T04:28:10.791427+0000","last_unstale":"2023-10-06T04:28:10.795671+0000","last_undegraded":"2023-10-06T04:28:10.795671+0000","last_fullsized":"2023-10-06T04:28:10.795671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:23.024555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T04:28:20.129303+0000","last_change":"2023-10-06T04:28:05.756961+0000","last_active":"2023-10-06T04:28:20.129303+0000","last_peered":"2023-10-06T04:28:20.129303+0000","last_clean":"2023-10-06T04:28:20.129303+0000","last_became_active":"2023-10-06T04:28:05.756443+0000","last_became_peered":"2023-10-06T04:28:05.756443+0000","last_unstale":"2023-10-06T04:28:20.129303+0000","last_undegraded":"2023-10-06T04:28:20.129303+0000","last_fullsized":"2023-10-06T04:28:20.129303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:15.728042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768364+0000","last_change":"2023-10-06T04:28:06.350205+0000","last_active":"2023-10-06T04:28:10.768364+0000","last_peered":"2023-10-06T04:28:10.768364+0000","last_clean":"2023-10-06T04:28:10.768364+0000","last_became_active":"2023-10-06T04:28:06.347777+0000","last_became_peered":"2023-10-06T04:28:06.347777+0000","last_unstale":"2023-10-06T04:28:10.768364+0000","last_undegraded":"2023-10-06T04:28:10.768364+0000","last_fullsized":"2023-10-06T04:28:10.768364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:24:58.690599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.800408+0000","last_change":"2023-10-06T04:28:10.799162+0000","last_active":"2023-10-06T04:28:10.800408+0000","last_peered":"2023-10-06T04:28:10.800408+0000","last_clean":"2023-10-06T04:28:10.800408+0000","last_became_active":"2023-10-06T04:28:10.798723+0000","last_became_peered":"2023-10-06T04:28:10.798723+0000","last_unstale":"2023-10-06T04:28:10.800408+0000","last_undegraded":"2023-10-06T04:28:10.800408+0000","last_fullsized":"2023-10-06T04:28:10.800408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:57.373019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776524+0000","last_change":"2023-10-06T04:28:05.762181+0000","last_active":"2023-10-06T04:28:10.776524+0000","last_peered":"2023-10-06T04:28:10.776524+0000","last_clean":"2023-10-06T04:28:10.776524+0000","last_became_active":"2023-10-06T04:28:05.761833+0000","last_became_peered":"2023-10-06T04:28:05.761833+0000","last_unstale":"2023-10-06T04:28:10.776524+0000","last_undegraded":"2023-10-06T04:28:10.776524+0000","last_fullsized":"2023-10-06T04:28:10.776524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:31.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770860+0000","last_change":"2023-10-06T04:28:06.340906+0000","last_active":"2023-10-06T04:28:10.770860+0000","last_peered":"2023-10-06T04:28:10.770860+0000","last_clean":"2023-10-06T04:28:10.770860+0000","last_became_active":"2023-10-06T04:28:06.340662+0000","last_became_peered":"2023-10-06T04:28:06.340662+0000","last_unstale":"2023-10-06T04:28:10.770860+0000","last_undegraded":"2023-10-06T04:28:10.770860+0000","last_fullsized":"2023-10-06T04:28:10.770860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:17.928102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.809048+0000","last_change":"2023-10-06T04:28:10.804183+0000","last_active":"2023-10-06T04:28:10.809048+0000","last_peered":"2023-10-06T04:28:10.809048+0000","last_clean":"2023-10-06T04:28:10.809048+0000","last_became_active":"2023-10-06T04:28:10.803784+0000","last_became_peered":"2023-10-06T04:28:10.803784+0000","last_unstale":"2023-10-06T04:28:10.809048+0000","last_undegraded":"2023-10-06T04:28:10.809048+0000","last_fullsized":"2023-10-06T04:28:10.809048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:36:31.800551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769741+0000","last_change":"2023-10-06T04:28:05.750972+0000","last_active":"2023-10-06T04:28:10.769741+0000","last_peered":"2023-10-06T04:28:10.769741+0000","last_clean":"2023-10-06T04:28:10.769741+0000","last_became_active":"2023-10-06T04:28:05.750669+0000","last_became_peered":"2023-10-06T04:28:05.750669+0000","last_unstale":"2023-10-06T04:28:10.769741+0000","last_undegraded":"2023-10-06T04:28:10.769741+0000","last_fullsized":"2023-10-06T04:28:10.769741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:24.180507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779676+0000","last_change":"2023-10-06T04:28:06.347817+0000","last_active":"2023-10-06T04:28:10.779676+0000","last_peered":"2023-10-06T04:28:10.779676+0000","last_clean":"2023-10-06T04:28:10.779676+0000","last_became_active":"2023-10-06T04:28:06.347502+0000","last_became_peered":"2023-10-06T04:28:06.347502+0000","last_unstale":"2023-10-06T04:28:10.779676+0000","last_undegraded":"2023-10-06T04:28:10.779676+0000","last_fullsized":"2023-10-06T04:28:10.779676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:13.160015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.809120+0000","last_change":"2023-10-06T04:28:10.805867+0000","last_active":"2023-10-06T04:28:10.809120+0000","last_peered":"2023-10-06T04:28:10.809120+0000","last_clean":"2023-10-06T04:28:10.809120+0000","last_became_active":"2023-10-06T04:28:10.805292+0000","last_became_peered":"2023-10-06T04:28:10.805292+0000","last_unstale":"2023-10-06T04:28:10.809120+0000","last_undegraded":"2023-10-06T04:28:10.809120+0000","last_fullsized":"2023-10-06T04:28:10.809120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:21.459093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774023+0000","last_change":"2023-10-06T04:28:05.758582+0000","last_active":"2023-10-06T04:28:10.774023+0000","last_peered":"2023-10-06T04:28:10.774023+0000","last_clean":"2023-10-06T04:28:10.774023+0000","last_became_active":"2023-10-06T04:28:05.758300+0000","last_became_peered":"2023-10-06T04:28:05.758300+0000","last_unstale":"2023-10-06T04:28:10.774023+0000","last_undegraded":"2023-10-06T04:28:10.774023+0000","last_fullsized":"2023-10-06T04:28:10.774023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:46.282985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770173+0000","last_change":"2023-10-06T04:28:06.347051+0000","last_active":"2023-10-06T04:28:10.770173+0000","last_peered":"2023-10-06T04:28:10.770173+0000","last_clean":"2023-10-06T04:28:10.770173+0000","last_became_active":"2023-10-06T04:28:06.346605+0000","last_became_peered":"2023-10-06T04:28:06.346605+0000","last_unstale":"2023-10-06T04:28:10.770173+0000","last_undegraded":"2023-10-06T04:28:10.770173+0000","last_fullsized":"2023-10-06T04:28:10.770173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:28.999532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.799625+0000","last_change":"2023-10-06T04:28:10.797651+0000","last_active":"2023-10-06T04:28:10.799625+0000","last_peered":"2023-10-06T04:28:10.799625+0000","last_clean":"2023-10-06T04:28:10.799625+0000","last_became_active":"2023-10-06T04:28:10.797232+0000","last_became_peered":"2023-10-06T04:28:10.797232+0000","last_unstale":"2023-10-06T04:28:10.799625+0000","last_undegraded":"2023-10-06T04:28:10.799625+0000","last_fullsized":"2023-10-06T04:28:10.799625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:11.414923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769762+0000","last_change":"2023-10-06T04:28:05.742570+0000","last_active":"2023-10-06T04:28:10.769762+0000","last_peered":"2023-10-06T04:28:10.769762+0000","last_clean":"2023-10-06T04:28:10.769762+0000","last_became_active":"2023-10-06T04:28:05.742241+0000","last_became_peered":"2023-10-06T04:28:05.742241+0000","last_unstale":"2023-10-06T04:28:10.769762+0000","last_undegraded":"2023-10-06T04:28:10.769762+0000","last_fullsized":"2023-10-06T04:28:10.769762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:13.125425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770855+0000","last_change":"2023-10-06T04:28:06.337353+0000","last_active":"2023-10-06T04:28:10.770855+0000","last_peered":"2023-10-06T04:28:10.770855+0000","last_clean":"2023-10-06T04:28:10.770855+0000","last_became_active":"2023-10-06T04:28:06.337087+0000","last_became_peered":"2023-10-06T04:28:06.337087+0000","last_unstale":"2023-10-06T04:28:10.770855+0000","last_undegraded":"2023-10-06T04:28:10.770855+0000","last_fullsized":"2023-10-06T04:28:10.770855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:36.507036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802188+0000","last_change":"2023-10-06T04:28:10.800008+0000","last_active":"2023-10-06T04:28:10.802188+0000","last_peered":"2023-10-06T04:28:10.802188+0000","last_clean":"2023-10-06T04:28:10.802188+0000","last_became_active":"2023-10-06T04:28:10.799373+0000","last_became_peered":"2023-10-06T04:28:10.799373+0000","last_unstale":"2023-10-06T04:28:10.802188+0000","last_undegraded":"2023-10-06T04:28:10.802188+0000","last_fullsized":"2023-10-06T04:28:10.802188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:23.024555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.780048+0000","last_change":"2023-10-06T04:28:05.762026+0000","last_active":"2023-10-06T04:28:10.780048+0000","last_peered":"2023-10-06T04:28:10.780048+0000","last_clean":"2023-10-06T04:28:10.780048+0000","last_became_active":"2023-10-06T04:28:05.761745+0000","last_became_peered":"2023-10-06T04:28:05.761745+0000","last_unstale":"2023-10-06T04:28:10.780048+0000","last_undegraded":"2023-10-06T04:28:10.780048+0000","last_fullsized":"2023-10-06T04:28:10.780048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:25.024995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774954+0000","last_change":"2023-10-06T04:28:06.346072+0000","last_active":"2023-10-06T04:28:10.774954+0000","last_peered":"2023-10-06T04:28:10.774954+0000","last_clean":"2023-10-06T04:28:10.774954+0000","last_became_active":"2023-10-06T04:28:06.345770+0000","last_became_peered":"2023-10-06T04:28:06.345770+0000","last_unstale":"2023-10-06T04:28:10.774954+0000","last_undegraded":"2023-10-06T04:28:10.774954+0000","last_fullsized":"2023-10-06T04:28:10.774954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:53.248928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.785697+0000","last_change":"2023-10-06T04:28:10.784166+0000","last_active":"2023-10-06T04:28:10.785697+0000","last_peered":"2023-10-06T04:28:10.785697+0000","last_clean":"2023-10-06T04:28:10.785697+0000","last_became_active":"2023-10-06T04:28:10.783671+0000","last_became_peered":"2023-10-06T04:28:10.783671+0000","last_unstale":"2023-10-06T04:28:10.785697+0000","last_undegraded":"2023-10-06T04:28:10.785697+0000","last_fullsized":"2023-10-06T04:28:10.785697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:18.568583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776289+0000","last_change":"2023-10-06T04:28:05.762151+0000","last_active":"2023-10-06T04:28:10.776289+0000","last_peered":"2023-10-06T04:28:10.776289+0000","last_clean":"2023-10-06T04:28:10.776289+0000","last_became_active":"2023-10-06T04:28:05.761792+0000","last_became_peered":"2023-10-06T04:28:05.761792+0000","last_unstale":"2023-10-06T04:28:10.776289+0000","last_undegraded":"2023-10-06T04:28:10.776289+0000","last_fullsized":"2023-10-06T04:28:10.776289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:01.869120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769462+0000","last_change":"2023-10-06T04:28:06.350312+0000","last_active":"2023-10-06T04:28:10.769462+0000","last_peered":"2023-10-06T04:28:10.769462+0000","last_clean":"2023-10-06T04:28:10.769462+0000","last_became_active":"2023-10-06T04:28:06.349971+0000","last_became_peered":"2023-10-06T04:28:06.349971+0000","last_unstale":"2023-10-06T04:28:10.769462+0000","last_undegraded":"2023-10-06T04:28:10.769462+0000","last_fullsized":"2023-10-06T04:28:10.769462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:03.824145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.782164+0000","last_change":"2023-10-06T04:28:10.780132+0000","last_active":"2023-10-06T04:28:10.782164+0000","last_peered":"2023-10-06T04:28:10.782164+0000","last_clean":"2023-10-06T04:28:10.782164+0000","last_became_active":"2023-10-06T04:28:10.779808+0000","last_became_peered":"2023-10-06T04:28:10.779808+0000","last_unstale":"2023-10-06T04:28:10.782164+0000","last_undegraded":"2023-10-06T04:28:10.782164+0000","last_fullsized":"2023-10-06T04:28:10.782164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:36.272215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779299+0000","last_change":"2023-10-06T04:28:05.756128+0000","last_active":"2023-10-06T04:28:10.779299+0000","last_peered":"2023-10-06T04:28:10.779299+0000","last_clean":"2023-10-06T04:28:10.779299+0000","last_became_active":"2023-10-06T04:28:05.755749+0000","last_became_peered":"2023-10-06T04:28:05.755749+0000","last_unstale":"2023-10-06T04:28:10.779299+0000","last_undegraded":"2023-10-06T04:28:10.779299+0000","last_fullsized":"2023-10-06T04:28:10.779299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:53.511624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768694+0000","last_change":"2023-10-06T04:28:06.340325+0000","last_active":"2023-10-06T04:28:10.768694+0000","last_peered":"2023-10-06T04:28:10.768694+0000","last_clean":"2023-10-06T04:28:10.768694+0000","last_became_active":"2023-10-06T04:28:06.339640+0000","last_became_peered":"2023-10-06T04:28:06.339640+0000","last_unstale":"2023-10-06T04:28:10.768694+0000","last_undegraded":"2023-10-06T04:28:10.768694+0000","last_fullsized":"2023-10-06T04:28:10.768694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:13.160015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802745+0000","last_change":"2023-10-06T04:28:10.797879+0000","last_active":"2023-10-06T04:28:10.802745+0000","last_peered":"2023-10-06T04:28:10.802745+0000","last_clean":"2023-10-06T04:28:10.802745+0000","last_became_active":"2023-10-06T04:28:10.797454+0000","last_became_peered":"2023-10-06T04:28:10.797454+0000","last_unstale":"2023-10-06T04:28:10.802745+0000","last_undegraded":"2023-10-06T04:28:10.802745+0000","last_fullsized":"2023-10-06T04:28:10.802745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:21.953970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776131+0000","last_change":"2023-10-06T04:28:05.763894+0000","last_active":"2023-10-06T04:28:10.776131+0000","last_peered":"2023-10-06T04:28:10.776131+0000","last_clean":"2023-10-06T04:28:10.776131+0000","last_became_active":"2023-10-06T04:28:05.763596+0000","last_became_peered":"2023-10-06T04:28:05.763596+0000","last_unstale":"2023-10-06T04:28:10.776131+0000","last_undegraded":"2023-10-06T04:28:10.776131+0000","last_fullsized":"2023-10-06T04:28:10.776131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:31.777366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772230+0000","last_change":"2023-10-06T04:28:06.342227+0000","last_active":"2023-10-06T04:28:10.772230+0000","last_peered":"2023-10-06T04:28:10.772230+0000","last_clean":"2023-10-06T04:28:10.772230+0000","last_became_active":"2023-10-06T04:28:06.341974+0000","last_became_peered":"2023-10-06T04:28:06.341974+0000","last_unstale":"2023-10-06T04:28:10.772230+0000","last_undegraded":"2023-10-06T04:28:10.772230+0000","last_fullsized":"2023-10-06T04:28:10.772230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:34.925929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.795509+0000","last_change":"2023-10-06T04:28:10.790497+0000","last_active":"2023-10-06T04:28:10.795509+0000","last_peered":"2023-10-06T04:28:10.795509+0000","last_clean":"2023-10-06T04:28:10.795509+0000","last_became_active":"2023-10-06T04:28:10.790006+0000","last_became_peered":"2023-10-06T04:28:10.790006+0000","last_unstale":"2023-10-06T04:28:10.795509+0000","last_undegraded":"2023-10-06T04:28:10.795509+0000","last_fullsized":"2023-10-06T04:28:10.795509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:33.025399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771405+0000","last_change":"2023-10-06T04:28:05.762781+0000","last_active":"2023-10-06T04:28:10.771405+0000","last_peered":"2023-10-06T04:28:10.771405+0000","last_clean":"2023-10-06T04:28:10.771405+0000","last_became_active":"2023-10-06T04:28:05.762020+0000","last_became_peered":"2023-10-06T04:28:05.762020+0000","last_unstale":"2023-10-06T04:28:10.771405+0000","last_undegraded":"2023-10-06T04:28:10.771405+0000","last_fullsized":"2023-10-06T04:28:10.771405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:25.024995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770971+0000","last_change":"2023-10-06T04:28:06.349404+0000","last_active":"2023-10-06T04:28:10.770971+0000","last_peered":"2023-10-06T04:28:10.770971+0000","last_clean":"2023-10-06T04:28:10.770971+0000","last_became_active":"2023-10-06T04:28:06.349122+0000","last_became_peered":"2023-10-06T04:28:06.349122+0000","last_unstale":"2023-10-06T04:28:10.770971+0000","last_undegraded":"2023-10-06T04:28:10.770971+0000","last_fullsized":"2023-10-06T04:28:10.770971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:59.952485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.801165+0000","last_change":"2023-10-06T04:28:10.796293+0000","last_active":"2023-10-06T04:28:10.801165+0000","last_peered":"2023-10-06T04:28:10.801165+0000","last_clean":"2023-10-06T04:28:10.801165+0000","last_became_active":"2023-10-06T04:28:10.795652+0000","last_became_peered":"2023-10-06T04:28:10.795652+0000","last_unstale":"2023-10-06T04:28:10.801165+0000","last_undegraded":"2023-10-06T04:28:10.801165+0000","last_fullsized":"2023-10-06T04:28:10.801165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:32.517736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768694+0000","last_change":"2023-10-06T04:28:05.758453+0000","last_active":"2023-10-06T04:28:10.768694+0000","last_peered":"2023-10-06T04:28:10.768694+0000","last_clean":"2023-10-06T04:28:10.768694+0000","last_became_active":"2023-10-06T04:28:05.758154+0000","last_became_peered":"2023-10-06T04:28:05.758154+0000","last_unstale":"2023-10-06T04:28:10.768694+0000","last_undegraded":"2023-10-06T04:28:10.768694+0000","last_fullsized":"2023-10-06T04:28:10.768694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:24.180507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769342+0000","last_change":"2023-10-06T04:28:06.353299+0000","last_active":"2023-10-06T04:28:10.769342+0000","last_peered":"2023-10-06T04:28:10.769342+0000","last_clean":"2023-10-06T04:28:10.769342+0000","last_became_active":"2023-10-06T04:28:06.352474+0000","last_became_peered":"2023-10-06T04:28:06.352474+0000","last_unstale":"2023-10-06T04:28:10.769342+0000","last_undegraded":"2023-10-06T04:28:10.769342+0000","last_fullsized":"2023-10-06T04:28:10.769342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:28.491869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.798862+0000","last_change":"2023-10-06T04:28:10.792443+0000","last_active":"2023-10-06T04:28:10.798862+0000","last_peered":"2023-10-06T04:28:10.798862+0000","last_clean":"2023-10-06T04:28:10.798862+0000","last_became_active":"2023-10-06T04:28:10.791995+0000","last_became_peered":"2023-10-06T04:28:10.791995+0000","last_unstale":"2023-10-06T04:28:10.798862+0000","last_undegraded":"2023-10-06T04:28:10.798862+0000","last_fullsized":"2023-10-06T04:28:10.798862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:12.226268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769340+0000","last_change":"2023-10-06T04:28:05.757101+0000","last_active":"2023-10-06T04:28:10.769340+0000","last_peered":"2023-10-06T04:28:10.769340+0000","last_clean":"2023-10-06T04:28:10.769340+0000","last_became_active":"2023-10-06T04:28:05.756775+0000","last_became_peered":"2023-10-06T04:28:05.756775+0000","last_unstale":"2023-10-06T04:28:10.769340+0000","last_undegraded":"2023-10-06T04:28:10.769340+0000","last_fullsized":"2023-10-06T04:28:10.769340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:37.282042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769202+0000","last_change":"2023-10-06T04:28:06.351787+0000","last_active":"2023-10-06T04:28:10.769202+0000","last_peered":"2023-10-06T04:28:10.769202+0000","last_clean":"2023-10-06T04:28:10.769202+0000","last_became_active":"2023-10-06T04:28:06.351250+0000","last_became_peered":"2023-10-06T04:28:06.351250+0000","last_unstale":"2023-10-06T04:28:10.769202+0000","last_undegraded":"2023-10-06T04:28:10.769202+0000","last_fullsized":"2023-10-06T04:28:10.769202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:09.072192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802887+0000","last_change":"2023-10-06T04:28:10.798603+0000","last_active":"2023-10-06T04:28:10.802887+0000","last_peered":"2023-10-06T04:28:10.802887+0000","last_clean":"2023-10-06T04:28:10.802887+0000","last_became_active":"2023-10-06T04:28:10.798140+0000","last_became_peered":"2023-10-06T04:28:10.798140+0000","last_unstale":"2023-10-06T04:28:10.802887+0000","last_undegraded":"2023-10-06T04:28:10.802887+0000","last_fullsized":"2023-10-06T04:28:10.802887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:13.693194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771821+0000","last_change":"2023-10-06T04:28:05.761077+0000","last_active":"2023-10-06T04:28:10.771821+0000","last_peered":"2023-10-06T04:28:10.771821+0000","last_clean":"2023-10-06T04:28:10.771821+0000","last_became_active":"2023-10-06T04:28:05.760800+0000","last_became_peered":"2023-10-06T04:28:05.760800+0000","last_unstale":"2023-10-06T04:28:10.771821+0000","last_undegraded":"2023-10-06T04:28:10.771821+0000","last_fullsized":"2023-10-06T04:28:10.771821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:24.180507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776545+0000","last_change":"2023-10-06T04:28:06.338307+0000","last_active":"2023-10-06T04:28:10.776545+0000","last_peered":"2023-10-06T04:28:10.776545+0000","last_clean":"2023-10-06T04:28:10.776545+0000","last_became_active":"2023-10-06T04:28:06.338025+0000","last_became_peered":"2023-10-06T04:28:06.338025+0000","last_unstale":"2023-10-06T04:28:10.776545+0000","last_undegraded":"2023-10-06T04:28:10.776545+0000","last_fullsized":"2023-10-06T04:28:10.776545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:25.299896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802825+0000","last_change":"2023-10-06T04:28:10.796279+0000","last_active":"2023-10-06T04:28:10.802825+0000","last_peered":"2023-10-06T04:28:10.802825+0000","last_clean":"2023-10-06T04:28:10.802825+0000","last_became_active":"2023-10-06T04:28:10.795554+0000","last_became_peered":"2023-10-06T04:28:10.795554+0000","last_unstale":"2023-10-06T04:28:10.802825+0000","last_undegraded":"2023-10-06T04:28:10.802825+0000","last_fullsized":"2023-10-06T04:28:10.802825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:33:52.320723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770652+0000","last_change":"2023-10-06T04:28:05.754602+0000","last_active":"2023-10-06T04:28:10.770652+0000","last_peered":"2023-10-06T04:28:10.770652+0000","last_clean":"2023-10-06T04:28:10.770652+0000","last_became_active":"2023-10-06T04:28:05.754262+0000","last_became_peered":"2023-10-06T04:28:05.754262+0000","last_unstale":"2023-10-06T04:28:10.770652+0000","last_undegraded":"2023-10-06T04:28:10.770652+0000","last_fullsized":"2023-10-06T04:28:10.770652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:15.728042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769463+0000","last_change":"2023-10-06T04:28:00.325832+0000","last_active":"2023-10-06T04:28:10.769463+0000","last_peered":"2023-10-06T04:28:10.769463+0000","last_clean":"2023-10-06T04:28:10.769463+0000","last_became_active":"2023-10-06T04:28:00.325466+0000","last_became_peered":"2023-10-06T04:28:00.325466+0000","last_unstale":"2023-10-06T04:28:10.769463+0000","last_undegraded":"2023-10-06T04:28:10.769463+0000","last_fullsized":"2023-10-06T04:28:10.769463+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771741+0000","last_change":"2023-10-06T04:28:06.347871+0000","last_active":"2023-10-06T04:28:10.771741+0000","last_peered":"2023-10-06T04:28:10.771741+0000","last_clean":"2023-10-06T04:28:10.771741+0000","last_became_active":"2023-10-06T04:28:06.347598+0000","last_became_peered":"2023-10-06T04:28:06.347598+0000","last_unstale":"2023-10-06T04:28:10.771741+0000","last_undegraded":"2023-10-06T04:28:10.771741+0000","last_fullsized":"2023-10-06T04:28:10.771741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:03.824145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.809116+0000","last_change":"2023-10-06T04:28:10.805828+0000","last_active":"2023-10-06T04:28:10.809116+0000","last_peered":"2023-10-06T04:28:10.809116+0000","last_clean":"2023-10-06T04:28:10.809116+0000","last_became_active":"2023-10-06T04:28:10.805391+0000","last_became_peered":"2023-10-06T04:28:10.805391+0000","last_unstale":"2023-10-06T04:28:10.809116+0000","last_undegraded":"2023-10-06T04:28:10.809116+0000","last_fullsized":"2023-10-06T04:28:10.809116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:12.226268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770768+0000","last_change":"2023-10-06T04:28:00.175241+0000","last_active":"2023-10-06T04:28:10.770768+0000","last_peered":"2023-10-06T04:28:10.770768+0000","last_clean":"2023-10-06T04:28:10.770768+0000","last_became_active":"2023-10-06T04:28:00.174814+0000","last_became_peered":"2023-10-06T04:28:00.174814+0000","last_unstale":"2023-10-06T04:28:10.770768+0000","last_undegraded":"2023-10-06T04:28:10.770768+0000","last_fullsized":"2023-10-06T04:28:10.770768+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769844+0000","last_change":"2023-10-06T04:28:05.759716+0000","last_active":"2023-10-06T04:28:10.769844+0000","last_peered":"2023-10-06T04:28:10.769844+0000","last_clean":"2023-10-06T04:28:10.769844+0000","last_became_active":"2023-10-06T04:28:05.759378+0000","last_became_peered":"2023-10-06T04:28:05.759378+0000","last_unstale":"2023-10-06T04:28:10.769844+0000","last_undegraded":"2023-10-06T04:28:10.769844+0000","last_fullsized":"2023-10-06T04:28:10.769844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:31.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769414+0000","last_change":"2023-10-06T04:28:06.345648+0000","last_active":"2023-10-06T04:28:10.769414+0000","last_peered":"2023-10-06T04:28:10.769414+0000","last_clean":"2023-10-06T04:28:10.769414+0000","last_became_active":"2023-10-06T04:28:06.345327+0000","last_became_peered":"2023-10-06T04:28:06.345327+0000","last_unstale":"2023-10-06T04:28:10.769414+0000","last_undegraded":"2023-10-06T04:28:10.769414+0000","last_fullsized":"2023-10-06T04:28:10.769414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:51:30.857061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.799671+0000","last_change":"2023-10-06T04:28:10.798759+0000","last_active":"2023-10-06T04:28:10.799671+0000","last_peered":"2023-10-06T04:28:10.799671+0000","last_clean":"2023-10-06T04:28:10.799671+0000","last_became_active":"2023-10-06T04:28:10.798359+0000","last_became_peered":"2023-10-06T04:28:10.798359+0000","last_unstale":"2023-10-06T04:28:10.799671+0000","last_undegraded":"2023-10-06T04:28:10.799671+0000","last_fullsized":"2023-10-06T04:28:10.799671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:21.459093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.773701+0000","last_change":"2023-10-06T04:28:00.175086+0000","last_active":"2023-10-06T04:28:10.773701+0000","last_peered":"2023-10-06T04:28:10.773701+0000","last_clean":"2023-10-06T04:28:10.773701+0000","last_became_active":"2023-10-06T04:28:00.174735+0000","last_became_peered":"2023-10-06T04:28:00.174735+0000","last_unstale":"2023-10-06T04:28:10.773701+0000","last_undegraded":"2023-10-06T04:28:10.773701+0000","last_fullsized":"2023-10-06T04:28:10.773701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.777992+0000","last_change":"2023-10-06T04:28:01.176177+0000","last_active":"2023-10-06T04:28:10.777992+0000","last_peered":"2023-10-06T04:28:10.777992+0000","last_clean":"2023-10-06T04:28:10.777992+0000","last_became_active":"2023-10-06T04:28:01.175255+0000","last_became_peered":"2023-10-06T04:28:01.175255+0000","last_unstale":"2023-10-06T04:28:10.777992+0000","last_undegraded":"2023-10-06T04:28:10.777992+0000","last_fullsized":"2023-10-06T04:28:10.777992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:00.161020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:00.161020+0000","last_clean_scrub_stamp":"2023-10-06T04:28:00.161020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:29.208067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769407+0000","last_change":"2023-10-06T04:28:05.748512+0000","last_active":"2023-10-06T04:28:10.769407+0000","last_peered":"2023-10-06T04:28:10.769407+0000","last_clean":"2023-10-06T04:28:10.769407+0000","last_became_active":"2023-10-06T04:28:05.748197+0000","last_became_peered":"2023-10-06T04:28:05.748197+0000","last_unstale":"2023-10-06T04:28:10.769407+0000","last_undegraded":"2023-10-06T04:28:10.769407+0000","last_fullsized":"2023-10-06T04:28:10.769407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:31.777366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770089+0000","last_change":"2023-10-06T04:28:06.346860+0000","last_active":"2023-10-06T04:28:10.770089+0000","last_peered":"2023-10-06T04:28:10.770089+0000","last_clean":"2023-10-06T04:28:10.770089+0000","last_became_active":"2023-10-06T04:28:06.346244+0000","last_became_peered":"2023-10-06T04:28:06.346244+0000","last_unstale":"2023-10-06T04:28:10.770089+0000","last_undegraded":"2023-10-06T04:28:10.770089+0000","last_fullsized":"2023-10-06T04:28:10.770089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:25.299896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.799239+0000","last_change":"2023-10-06T04:28:10.796043+0000","last_active":"2023-10-06T04:28:10.799239+0000","last_peered":"2023-10-06T04:28:10.799239+0000","last_clean":"2023-10-06T04:28:10.799239+0000","last_became_active":"2023-10-06T04:28:10.794267+0000","last_became_peered":"2023-10-06T04:28:10.794267+0000","last_unstale":"2023-10-06T04:28:10.799239+0000","last_undegraded":"2023-10-06T04:28:10.799239+0000","last_fullsized":"2023-10-06T04:28:10.799239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:09:13.098060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.776644+0000","last_change":"2023-10-06T04:28:00.344573+0000","last_active":"2023-10-06T04:28:10.776644+0000","last_peered":"2023-10-06T04:28:10.776644+0000","last_clean":"2023-10-06T04:28:10.776644+0000","last_became_active":"2023-10-06T04:28:00.344324+0000","last_became_peered":"2023-10-06T04:28:00.344324+0000","last_unstale":"2023-10-06T04:28:10.776644+0000","last_undegraded":"2023-10-06T04:28:10.776644+0000","last_fullsized":"2023-10-06T04:28:10.776644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:24.184826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.775065+0000","last_change":"2023-10-06T04:28:05.757315+0000","last_active":"2023-10-06T04:28:10.775065+0000","last_peered":"2023-10-06T04:28:10.775065+0000","last_clean":"2023-10-06T04:28:10.775065+0000","last_became_active":"2023-10-06T04:28:05.756903+0000","last_became_peered":"2023-10-06T04:28:05.756903+0000","last_unstale":"2023-10-06T04:28:10.775065+0000","last_undegraded":"2023-10-06T04:28:10.775065+0000","last_fullsized":"2023-10-06T04:28:10.775065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:37.282042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.773864+0000","last_change":"2023-10-06T04:28:06.346567+0000","last_active":"2023-10-06T04:28:10.773864+0000","last_peered":"2023-10-06T04:28:10.773864+0000","last_clean":"2023-10-06T04:28:10.773864+0000","last_became_active":"2023-10-06T04:28:06.343751+0000","last_became_peered":"2023-10-06T04:28:06.343751+0000","last_unstale":"2023-10-06T04:28:10.773864+0000","last_undegraded":"2023-10-06T04:28:10.773864+0000","last_fullsized":"2023-10-06T04:28:10.773864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:51:53.248928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.798693+0000","last_change":"2023-10-06T04:28:10.788813+0000","last_active":"2023-10-06T04:28:10.798693+0000","last_peered":"2023-10-06T04:28:10.798693+0000","last_clean":"2023-10-06T04:28:10.798693+0000","last_became_active":"2023-10-06T04:28:10.788350+0000","last_became_peered":"2023-10-06T04:28:10.788350+0000","last_unstale":"2023-10-06T04:28:10.798693+0000","last_undegraded":"2023-10-06T04:28:10.798693+0000","last_fullsized":"2023-10-06T04:28:10.798693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:27:02.062950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.777569+0000","last_change":"2023-10-06T04:28:00.343571+0000","last_active":"2023-10-06T04:28:10.777569+0000","last_peered":"2023-10-06T04:28:10.777569+0000","last_clean":"2023-10-06T04:28:10.777569+0000","last_became_active":"2023-10-06T04:28:00.343268+0000","last_became_peered":"2023-10-06T04:28:00.343268+0000","last_unstale":"2023-10-06T04:28:10.777569+0000","last_undegraded":"2023-10-06T04:28:10.777569+0000","last_fullsized":"2023-10-06T04:28:10.777569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:00.931419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770595+0000","last_change":"2023-10-06T04:28:05.760969+0000","last_active":"2023-10-06T04:28:10.770595+0000","last_peered":"2023-10-06T04:28:10.770595+0000","last_clean":"2023-10-06T04:28:10.770595+0000","last_became_active":"2023-10-06T04:28:05.758813+0000","last_became_peered":"2023-10-06T04:28:05.758813+0000","last_unstale":"2023-10-06T04:28:10.770595+0000","last_undegraded":"2023-10-06T04:28:10.770595+0000","last_fullsized":"2023-10-06T04:28:10.770595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:13.125425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769104+0000","last_change":"2023-10-06T04:28:06.354285+0000","last_active":"2023-10-06T04:28:10.769104+0000","last_peered":"2023-10-06T04:28:10.769104+0000","last_clean":"2023-10-06T04:28:10.769104+0000","last_became_active":"2023-10-06T04:28:06.354002+0000","last_became_peered":"2023-10-06T04:28:06.354002+0000","last_unstale":"2023-10-06T04:28:10.769104+0000","last_undegraded":"2023-10-06T04:28:10.769104+0000","last_fullsized":"2023-10-06T04:28:10.769104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:15.119695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.793988+0000","last_change":"2023-10-06T04:28:10.792299+0000","last_active":"2023-10-06T04:28:10.793988+0000","last_peered":"2023-10-06T04:28:10.793988+0000","last_clean":"2023-10-06T04:28:10.793988+0000","last_became_active":"2023-10-06T04:28:10.791854+0000","last_became_peered":"2023-10-06T04:28:10.791854+0000","last_unstale":"2023-10-06T04:28:10.793988+0000","last_undegraded":"2023-10-06T04:28:10.793988+0000","last_fullsized":"2023-10-06T04:28:10.793988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:08.567157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774747+0000","last_change":"2023-10-06T04:28:00.344460+0000","last_active":"2023-10-06T04:28:10.774747+0000","last_peered":"2023-10-06T04:28:10.774747+0000","last_clean":"2023-10-06T04:28:10.774747+0000","last_became_active":"2023-10-06T04:28:00.343280+0000","last_became_peered":"2023-10-06T04:28:00.343280+0000","last_unstale":"2023-10-06T04:28:10.774747+0000","last_undegraded":"2023-10-06T04:28:10.774747+0000","last_fullsized":"2023-10-06T04:28:10.774747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768452+0000","last_change":"2023-10-06T04:28:05.757503+0000","last_active":"2023-10-06T04:28:10.768452+0000","last_peered":"2023-10-06T04:28:10.768452+0000","last_clean":"2023-10-06T04:28:10.768452+0000","last_became_active":"2023-10-06T04:28:05.757218+0000","last_became_peered":"2023-10-06T04:28:05.757218+0000","last_unstale":"2023-10-06T04:28:10.768452+0000","last_undegraded":"2023-10-06T04:28:10.768452+0000","last_fullsized":"2023-10-06T04:28:10.768452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:31.777366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774659+0000","last_change":"2023-10-06T04:28:06.334345+0000","last_active":"2023-10-06T04:28:10.774659+0000","last_peered":"2023-10-06T04:28:10.774659+0000","last_clean":"2023-10-06T04:28:10.774659+0000","last_became_active":"2023-10-06T04:28:06.334114+0000","last_became_peered":"2023-10-06T04:28:06.334114+0000","last_unstale":"2023-10-06T04:28:10.774659+0000","last_undegraded":"2023-10-06T04:28:10.774659+0000","last_fullsized":"2023-10-06T04:28:10.774659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:34.925929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.786275+0000","last_change":"2023-10-06T04:28:10.782630+0000","last_active":"2023-10-06T04:28:10.786275+0000","last_peered":"2023-10-06T04:28:10.786275+0000","last_clean":"2023-10-06T04:28:10.786275+0000","last_became_active":"2023-10-06T04:28:10.782267+0000","last_became_peered":"2023-10-06T04:28:10.782267+0000","last_unstale":"2023-10-06T04:28:10.786275+0000","last_undegraded":"2023-10-06T04:28:10.786275+0000","last_fullsized":"2023-10-06T04:28:10.786275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:11.414923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769001+0000","last_change":"2023-10-06T04:28:00.343592+0000","last_active":"2023-10-06T04:28:10.769001+0000","last_peered":"2023-10-06T04:28:10.769001+0000","last_clean":"2023-10-06T04:28:10.769001+0000","last_became_active":"2023-10-06T04:28:00.343313+0000","last_became_peered":"2023-10-06T04:28:00.343313+0000","last_unstale":"2023-10-06T04:28:10.769001+0000","last_undegraded":"2023-10-06T04:28:10.769001+0000","last_fullsized":"2023-10-06T04:28:10.769001+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:24.184826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774880+0000","last_change":"2023-10-06T04:28:05.760166+0000","last_active":"2023-10-06T04:28:10.774880+0000","last_peered":"2023-10-06T04:28:10.774880+0000","last_clean":"2023-10-06T04:28:10.774880+0000","last_became_active":"2023-10-06T04:28:05.759837+0000","last_became_peered":"2023-10-06T04:28:05.759837+0000","last_unstale":"2023-10-06T04:28:10.774880+0000","last_undegraded":"2023-10-06T04:28:10.774880+0000","last_fullsized":"2023-10-06T04:28:10.774880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:01:33.139108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772008+0000","last_change":"2023-10-06T04:28:06.340003+0000","last_active":"2023-10-06T04:28:10.772008+0000","last_peered":"2023-10-06T04:28:10.772008+0000","last_clean":"2023-10-06T04:28:10.772008+0000","last_became_active":"2023-10-06T04:28:06.339372+0000","last_became_peered":"2023-10-06T04:28:06.339372+0000","last_unstale":"2023-10-06T04:28:10.772008+0000","last_undegraded":"2023-10-06T04:28:10.772008+0000","last_fullsized":"2023-10-06T04:28:10.772008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:29:39.187212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.791694+0000","last_change":"2023-10-06T04:28:10.788742+0000","last_active":"2023-10-06T04:28:10.791694+0000","last_peered":"2023-10-06T04:28:10.791694+0000","last_clean":"2023-10-06T04:28:10.791694+0000","last_became_active":"2023-10-06T04:28:10.788218+0000","last_became_peered":"2023-10-06T04:28:10.788218+0000","last_unstale":"2023-10-06T04:28:10.791694+0000","last_undegraded":"2023-10-06T04:28:10.791694+0000","last_fullsized":"2023-10-06T04:28:10.791694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.241552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769530+0000","last_change":"2023-10-06T04:28:00.174563+0000","last_active":"2023-10-06T04:28:10.769530+0000","last_peered":"2023-10-06T04:28:10.769530+0000","last_clean":"2023-10-06T04:28:10.769530+0000","last_became_active":"2023-10-06T04:28:00.174265+0000","last_became_peered":"2023-10-06T04:28:00.174265+0000","last_unstale":"2023-10-06T04:28:10.769530+0000","last_undegraded":"2023-10-06T04:28:10.769530+0000","last_fullsized":"2023-10-06T04:28:10.769530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:00.931419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779588+0000","last_change":"2023-10-06T04:28:05.764045+0000","last_active":"2023-10-06T04:28:10.779588+0000","last_peered":"2023-10-06T04:28:10.779588+0000","last_clean":"2023-10-06T04:28:10.779588+0000","last_became_active":"2023-10-06T04:28:05.763751+0000","last_became_peered":"2023-10-06T04:28:05.763751+0000","last_unstale":"2023-10-06T04:28:10.779588+0000","last_undegraded":"2023-10-06T04:28:10.779588+0000","last_fullsized":"2023-10-06T04:28:10.779588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:31.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.780519+0000","last_change":"2023-10-06T04:28:06.341910+0000","last_active":"2023-10-06T04:28:10.780519+0000","last_peered":"2023-10-06T04:28:10.780519+0000","last_clean":"2023-10-06T04:28:10.780519+0000","last_became_active":"2023-10-06T04:28:06.340194+0000","last_became_peered":"2023-10-06T04:28:06.340194+0000","last_unstale":"2023-10-06T04:28:10.780519+0000","last_undegraded":"2023-10-06T04:28:10.780519+0000","last_fullsized":"2023-10-06T04:28:10.780519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:25.121736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.796035+0000","last_change":"2023-10-06T04:28:10.794957+0000","last_active":"2023-10-06T04:28:10.796035+0000","last_peered":"2023-10-06T04:28:10.796035+0000","last_clean":"2023-10-06T04:28:10.796035+0000","last_became_active":"2023-10-06T04:28:10.793329+0000","last_became_peered":"2023-10-06T04:28:10.793329+0000","last_unstale":"2023-10-06T04:28:10.796035+0000","last_undegraded":"2023-10-06T04:28:10.796035+0000","last_fullsized":"2023-10-06T04:28:10.796035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:11.414923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771921+0000","last_change":"2023-10-06T04:28:05.759061+0000","last_active":"2023-10-06T04:28:10.771921+0000","last_peered":"2023-10-06T04:28:10.771921+0000","last_clean":"2023-10-06T04:28:10.771921+0000","last_became_active":"2023-10-06T04:28:05.757716+0000","last_became_peered":"2023-10-06T04:28:05.757716+0000","last_unstale":"2023-10-06T04:28:10.771921+0000","last_undegraded":"2023-10-06T04:28:10.771921+0000","last_fullsized":"2023-10-06T04:28:10.771921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:37.282042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.766753+0000","last_change":"2023-10-06T04:28:06.339102+0000","last_active":"2023-10-06T04:28:10.766753+0000","last_peered":"2023-10-06T04:28:10.766753+0000","last_clean":"2023-10-06T04:28:10.766753+0000","last_became_active":"2023-10-06T04:28:06.338781+0000","last_became_peered":"2023-10-06T04:28:06.338781+0000","last_unstale":"2023-10-06T04:28:10.766753+0000","last_undegraded":"2023-10-06T04:28:10.766753+0000","last_fullsized":"2023-10-06T04:28:10.766753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:32.169844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.801878+0000","last_change":"2023-10-06T04:28:10.795685+0000","last_active":"2023-10-06T04:28:10.801878+0000","last_peered":"2023-10-06T04:28:10.801878+0000","last_clean":"2023-10-06T04:28:10.801878+0000","last_became_active":"2023-10-06T04:28:10.795281+0000","last_became_peered":"2023-10-06T04:28:10.795281+0000","last_unstale":"2023-10-06T04:28:10.801878+0000","last_undegraded":"2023-10-06T04:28:10.801878+0000","last_fullsized":"2023-10-06T04:28:10.801878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:11.414923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774978+0000","last_change":"2023-10-06T04:28:05.760540+0000","last_active":"2023-10-06T04:28:10.774978+0000","last_peered":"2023-10-06T04:28:10.774978+0000","last_clean":"2023-10-06T04:28:10.774978+0000","last_became_active":"2023-10-06T04:28:05.760213+0000","last_became_peered":"2023-10-06T04:28:05.760213+0000","last_unstale":"2023-10-06T04:28:10.774978+0000","last_undegraded":"2023-10-06T04:28:10.774978+0000","last_fullsized":"2023-10-06T04:28:10.774978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:13.125425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.768541+0000","last_change":"2023-10-06T04:28:06.351862+0000","last_active":"2023-10-06T04:28:10.768541+0000","last_peered":"2023-10-06T04:28:10.768541+0000","last_clean":"2023-10-06T04:28:10.768541+0000","last_became_active":"2023-10-06T04:28:06.351613+0000","last_became_peered":"2023-10-06T04:28:06.351613+0000","last_unstale":"2023-10-06T04:28:10.768541+0000","last_undegraded":"2023-10-06T04:28:10.768541+0000","last_fullsized":"2023-10-06T04:28:10.768541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:36.507036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.798917+0000","last_change":"2023-10-06T04:28:10.791630+0000","last_active":"2023-10-06T04:28:10.798917+0000","last_peered":"2023-10-06T04:28:10.798917+0000","last_clean":"2023-10-06T04:28:10.798917+0000","last_became_active":"2023-10-06T04:28:10.791196+0000","last_became_peered":"2023-10-06T04:28:10.791196+0000","last_unstale":"2023-10-06T04:28:10.798917+0000","last_undegraded":"2023-10-06T04:28:10.798917+0000","last_fullsized":"2023-10-06T04:28:10.798917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:32.241552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.779937+0000","last_change":"2023-10-06T04:28:05.761937+0000","last_active":"2023-10-06T04:28:10.779937+0000","last_peered":"2023-10-06T04:28:10.779937+0000","last_clean":"2023-10-06T04:28:10.779937+0000","last_became_active":"2023-10-06T04:28:05.761666+0000","last_became_peered":"2023-10-06T04:28:05.761666+0000","last_unstale":"2023-10-06T04:28:10.779937+0000","last_undegraded":"2023-10-06T04:28:10.779937+0000","last_fullsized":"2023-10-06T04:28:10.779937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:03:15.728042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770368+0000","last_change":"2023-10-06T04:28:06.350532+0000","last_active":"2023-10-06T04:28:10.770368+0000","last_peered":"2023-10-06T04:28:10.770368+0000","last_clean":"2023-10-06T04:28:10.770368+0000","last_became_active":"2023-10-06T04:28:06.349418+0000","last_became_peered":"2023-10-06T04:28:06.349418+0000","last_unstale":"2023-10-06T04:28:10.770368+0000","last_undegraded":"2023-10-06T04:28:10.770368+0000","last_fullsized":"2023-10-06T04:28:10.770368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:08:17.928102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.802894+0000","last_change":"2023-10-06T04:28:10.798677+0000","last_active":"2023-10-06T04:28:10.802894+0000","last_peered":"2023-10-06T04:28:10.802894+0000","last_clean":"2023-10-06T04:28:10.802894+0000","last_became_active":"2023-10-06T04:28:10.798151+0000","last_became_peered":"2023-10-06T04:28:10.798151+0000","last_unstale":"2023-10-06T04:28:10.802894+0000","last_undegraded":"2023-10-06T04:28:10.802894+0000","last_fullsized":"2023-10-06T04:28:10.802894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:41.693487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.773597+0000","last_change":"2023-10-06T04:28:05.763239+0000","last_active":"2023-10-06T04:28:10.773597+0000","last_peered":"2023-10-06T04:28:10.773597+0000","last_clean":"2023-10-06T04:28:10.773597+0000","last_became_active":"2023-10-06T04:28:05.762943+0000","last_became_peered":"2023-10-06T04:28:05.762943+0000","last_unstale":"2023-10-06T04:28:10.773597+0000","last_undegraded":"2023-10-06T04:28:10.773597+0000","last_fullsized":"2023-10-06T04:28:10.773597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:02:31.161136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772811+0000","last_change":"2023-10-06T04:28:06.333362+0000","last_active":"2023-10-06T04:28:10.772811+0000","last_peered":"2023-10-06T04:28:10.772811+0000","last_clean":"2023-10-06T04:28:10.772811+0000","last_became_active":"2023-10-06T04:28:06.333122+0000","last_became_peered":"2023-10-06T04:28:06.333122+0000","last_unstale":"2023-10-06T04:28:10.772811+0000","last_undegraded":"2023-10-06T04:28:10.772811+0000","last_fullsized":"2023-10-06T04:28:10.772811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:14.542716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.795717+0000","last_change":"2023-10-06T04:28:10.791565+0000","last_active":"2023-10-06T04:28:10.795717+0000","last_peered":"2023-10-06T04:28:10.795717+0000","last_clean":"2023-10-06T04:28:10.795717+0000","last_became_active":"2023-10-06T04:28:10.791139+0000","last_became_peered":"2023-10-06T04:28:10.791139+0000","last_unstale":"2023-10-06T04:28:10.795717+0000","last_undegraded":"2023-10-06T04:28:10.795717+0000","last_fullsized":"2023-10-06T04:28:10.795717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:09.751460+0000","last_clean_scrub_stamp":"2023-10-06T04:28:09.751460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:43.446834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770222+0000","last_change":"2023-10-06T04:28:05.755877+0000","last_active":"2023-10-06T04:28:10.770222+0000","last_peered":"2023-10-06T04:28:10.770222+0000","last_clean":"2023-10-06T04:28:10.770222+0000","last_became_active":"2023-10-06T04:28:05.755458+0000","last_became_peered":"2023-10-06T04:28:05.755458+0000","last_unstale":"2023-10-06T04:28:10.770222+0000","last_undegraded":"2023-10-06T04:28:10.770222+0000","last_fullsized":"2023-10-06T04:28:10.770222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:04.716886+0000","last_clean_scrub_stamp":"2023-10-06T04:28:04.716886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:25.024995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770660+0000","last_change":"2023-10-06T04:28:06.344756+0000","last_active":"2023-10-06T04:28:10.770660+0000","last_peered":"2023-10-06T04:28:10.770660+0000","last_clean":"2023-10-06T04:28:10.770660+0000","last_became_active":"2023-10-06T04:28:06.344479+0000","last_became_peered":"2023-10-06T04:28:06.344479+0000","last_unstale":"2023-10-06T04:28:10.770660+0000","last_undegraded":"2023-10-06T04:28:10.770660+0000","last_fullsized":"2023-10-06T04:28:10.770660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:14.542716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.769743+0000","last_change":"2023-10-06T04:28:06.332177+0000","last_active":"2023-10-06T04:28:10.769743+0000","last_peered":"2023-10-06T04:28:10.769743+0000","last_clean":"2023-10-06T04:28:10.769743+0000","last_became_active":"2023-10-06T04:28:06.331845+0000","last_became_peered":"2023-10-06T04:28:06.331845+0000","last_unstale":"2023-10-06T04:28:10.769743+0000","last_undegraded":"2023-10-06T04:28:10.769743+0000","last_fullsized":"2023-10-06T04:28:10.769743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:25.837873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.772592+0000","last_change":"2023-10-06T04:28:06.341336+0000","last_active":"2023-10-06T04:28:10.772592+0000","last_peered":"2023-10-06T04:28:10.772592+0000","last_clean":"2023-10-06T04:28:10.772592+0000","last_became_active":"2023-10-06T04:28:06.341066+0000","last_became_peered":"2023-10-06T04:28:06.341066+0000","last_unstale":"2023-10-06T04:28:10.772592+0000","last_undegraded":"2023-10-06T04:28:10.772592+0000","last_fullsized":"2023-10-06T04:28:10.772592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:28.999532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.770451+0000","last_change":"2023-10-06T04:28:06.346211+0000","last_active":"2023-10-06T04:28:10.770451+0000","last_peered":"2023-10-06T04:28:10.770451+0000","last_clean":"2023-10-06T04:28:10.770451+0000","last_became_active":"2023-10-06T04:28:06.345932+0000","last_became_peered":"2023-10-06T04:28:06.345932+0000","last_unstale":"2023-10-06T04:28:10.770451+0000","last_undegraded":"2023-10-06T04:28:10.770451+0000","last_fullsized":"2023-10-06T04:28:10.770451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:47.925435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.771314+0000","last_change":"2023-10-06T04:28:06.337534+0000","last_active":"2023-10-06T04:28:10.771314+0000","last_peered":"2023-10-06T04:28:10.771314+0000","last_clean":"2023-10-06T04:28:10.771314+0000","last_became_active":"2023-10-06T04:28:06.337280+0000","last_became_peered":"2023-10-06T04:28:06.337280+0000","last_unstale":"2023-10-06T04:28:10.771314+0000","last_undegraded":"2023-10-06T04:28:10.771314+0000","last_fullsized":"2023-10-06T04:28:10.771314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:10:27.073025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T04:28:10.774746+0000","last_change":"2023-10-06T04:28:06.336249+0000","last_active":"2023-10-06T04:28:10.774746+0000","last_peered":"2023-10-06T04:28:10.774746+0000","last_clean":"2023-10-06T04:28:10.774746+0000","last_became_active":"2023-10-06T04:28:06.335726+0000","last_became_peered":"2023-10-06T04:28:06.335726+0000","last_unstale":"2023-10-06T04:28:10.774746+0000","last_undegraded":"2023-10-06T04:28:10.774746+0000","last_fullsized":"2023-10-06T04:28:10.774746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:05.725593+0000","last_clean_scrub_stamp":"2023-10-06T04:28:05.725593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:25.837873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":702778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":266240,"data_stored":109458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302224,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069616,"statfs":{"total":96636764160,"available":96327286784,"internally_reserved":0,"allocated":860160,"data_stored":699826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":109034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301640,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070200,"statfs":{"total":96636764160,"available":96327884800,"internally_reserved":0,"allocated":262144,"data_stored":108480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":108570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":113228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":109104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:28:29.214 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T04:28:29.214 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T04:28:29.214 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T04:28:29.214 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T04:28:29.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.430+0000 7fa00219d700 1 Processor -- start 2023-10-06T04:28:29.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.430+0000 7fa00219d700 1 -- start start 2023-10-06T04:28:29.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.432+0000 7fa00219d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ffc0cb5a0 0x7f9ffc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:29.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.432+0000 7fa00219d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ffc159450 0x7f9ffc159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:29.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.432+0000 7fa00219d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ffc159dd0 con 0x7f9ffc06f310 2023-10-06T04:28:29.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.432+0000 7fa00219d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ffc06ebc0 con 0x7f9ffc159450 2023-10-06T04:28:29.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.432+0000 7fa00219d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc06e040 con 0x7f9ffc0cb5a0 2023-10-06T04:28:29.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.432+0000 7fa00199c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ffc159450 0x7f9ffc159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:29.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.432+0000 7fa00199c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ffc159450 0x7f9ffc159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52236/0 (socket says 172.21.15.60:52236) 2023-10-06T04:28:29.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.432+0000 7fa00199c700 1 -- 172.21.15.60:0/3412105941 learned_addr learned my addr 172.21.15.60:0/3412105941 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:29.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.432+0000 7fa00119b700 1 --2- 172.21.15.60:0/3412105941 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ffc0cb5a0 0x7f9ffc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:29.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.433+0000 7fa00199c700 1 -- 172.21.15.60:0/3412105941 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ffc0cb5a0 msgr2=0x7f9ffc0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:29.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.433+0000 7fa00199c700 1 --2- 172.21.15.60:0/3412105941 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ffc0cb5a0 0x7f9ffc0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:29.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.433+0000 7fa00199c700 1 -- 172.21.15.60:0/3412105941 >> v1:172.21.15.135:6789/0 conn(0x7f9ffc06f310 legacy=0x7f9ffc06d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:29.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.433+0000 7fa00199c700 1 -- 172.21.15.60:0/3412105941 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ffc06e320 con 0x7f9ffc159450 2023-10-06T04:28:29.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.433+0000 7fa00199c700 1 --2- 172.21.15.60:0/3412105941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc159450 0x7f9ffc159890 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400c0d0 tx=0x7f9ff400a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4720090c73e552ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:29.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.433+0000 7f9ff3fff700 1 -- 172.21.15.60:0/3412105941 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff400a0d0 con 0x7f9ffc159450 2023-10-06T04:28:29.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.433+0000 7f9ff3fff700 1 -- 172.21.15.60:0/3412105941 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff400a230 con 0x7f9ffc159450 2023-10-06T04:28:29.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.433+0000 7f9ff3fff700 1 -- 172.21.15.60:0/3412105941 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff400cd20 con 0x7f9ffc159450 2023-10-06T04:28:29.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.433+0000 7fa00219d700 1 -- 172.21.15.60:0/3412105941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc159450 msgr2=0x7f9ffc159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:29.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.433+0000 7fa00219d700 1 --2- 172.21.15.60:0/3412105941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc159450 0x7f9ffc159890 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400c0d0 tx=0x7f9ff400a950 comp rx=0 tx=0).stop 2023-10-06T04:28:29.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.434+0000 7fa00219d700 1 -- 172.21.15.60:0/3412105941 shutdown_connections 2023-10-06T04:28:29.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.434+0000 7fa00219d700 1 --2- 172.21.15.60:0/3412105941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc159450 0x7f9ffc159890 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:29.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.434+0000 7fa00219d700 1 --2- 172.21.15.60:0/3412105941 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ffc0cb5a0 0x7f9ffc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:29.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.434+0000 7fa00219d700 1 -- 172.21.15.60:0/3412105941 >> 172.21.15.60:0/3412105941 conn(0x7f9ffc068080 msgr2=0x7f9ffc0cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:29.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.434+0000 7fa00219d700 1 -- 172.21.15.60:0/3412105941 shutdown_connections 2023-10-06T04:28:29.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.434+0000 7fa00219d700 1 -- 172.21.15.60:0/3412105941 wait complete. 2023-10-06T04:28:29.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.435+0000 7fa00219d700 1 Processor -- start 2023-10-06T04:28:29.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.435+0000 7fa00219d700 1 -- start start 2023-10-06T04:28:29.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.436+0000 7fa00219d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc0cb5a0 0x7f9ffc14eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:29.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.436+0000 7fa00219d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ffc159450 0x7f9ffc152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:29.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.436+0000 7fa00219d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ffc153090 0x7f9ffc166420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:29.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.436+0000 7fa00219d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc14e6d0 con 0x7f9ffc0cb5a0 2023-10-06T04:28:29.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.436+0000 7fa00219d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc14dac0 con 0x7f9ffc153090 2023-10-06T04:28:29.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.436+0000 7fa00219d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc14dda0 con 0x7f9ffc159450 2023-10-06T04:28:29.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.436+0000 7fa00119b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc0cb5a0 0x7f9ffc14eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:29.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.436+0000 7fa00119b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc0cb5a0 0x7f9ffc14eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52246/0 (socket says 172.21.15.60:52246) 2023-10-06T04:28:29.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.436+0000 7fa00119b700 1 -- 172.21.15.60:0/2890337660 learned_addr learned my addr 172.21.15.60:0/2890337660 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.437+0000 7fa00199c700 1 --2- 172.21.15.60:0/2890337660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ffc153090 0x7f9ffc166420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.437+0000 7fa00099a700 1 --2- 172.21.15.60:0/2890337660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ffc159450 0x7f9ffc152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.437+0000 7fa00119b700 1 -- 172.21.15.60:0/2890337660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ffc159450 msgr2=0x7f9ffc152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.437+0000 7fa00119b700 1 --2- 172.21.15.60:0/2890337660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ffc159450 0x7f9ffc152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.437+0000 7fa00119b700 1 -- 172.21.15.60:0/2890337660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ffc153090 msgr2=0x7f9ffc166420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.437+0000 7fa00119b700 1 --2- 172.21.15.60:0/2890337660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ffc153090 0x7f9ffc166420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.437+0000 7fa00119b700 1 -- 172.21.15.60:0/2890337660 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff400abf0 con 0x7f9ffc0cb5a0 2023-10-06T04:28:29.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.437+0000 7fa00119b700 1 --2- 172.21.15.60:0/2890337660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc0cb5a0 0x7f9ffc14eb60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8010f70 tx=0x7f9ff800b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:29.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.437+0000 7f9ff17fa700 1 -- 172.21.15.60:0/2890337660 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff800ee10 con 0x7f9ffc0cb5a0 2023-10-06T04:28:29.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.437+0000 7f9ff17fa700 1 -- 172.21.15.60:0/2890337660 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff8011450 con 0x7f9ffc0cb5a0 2023-10-06T04:28:29.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.437+0000 7f9ff17fa700 1 -- 172.21.15.60:0/2890337660 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff80117d0 con 0x7f9ffc0cb5a0 2023-10-06T04:28:29.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.437+0000 7fa00219d700 1 -- 172.21.15.60:0/2890337660 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ffc14e080 con 0x7f9ffc0cb5a0 2023-10-06T04:28:29.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.438+0000 7fa00219d700 1 -- 172.21.15.60:0/2890337660 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ffc14f0a0 con 0x7f9ffc0cb5a0 2023-10-06T04:28:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.439+0000 7fa00219d700 1 -- 172.21.15.60:0/2890337660 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ffc05f230 con 0x7f9ffc0cb5a0 2023-10-06T04:28:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.440+0000 7f9ff17fa700 1 -- 172.21.15.60:0/2890337660 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ff8011b80 con 0x7f9ffc0cb5a0 2023-10-06T04:28:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.440+0000 7f9ff17fa700 1 --2- 172.21.15.60:0/2890337660 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f9fe0066f30 0x7f9fe00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.441+0000 7f9ff17fa700 1 -- 172.21.15.60:0/2890337660 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9ff8087660 con 0x7f9ffc0cb5a0 2023-10-06T04:28:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.441+0000 7fa00099a700 1 --2- 172.21.15.60:0/2890337660 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f9fe0066f30 0x7f9fe00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.441+0000 7fa00099a700 1 --2- 172.21.15.60:0/2890337660 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f9fe0066f30 0x7f9fe00693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc156b00 tx=0x7f9fec007ec0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:29.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.445+0000 7f9ff17fa700 1 -- 172.21.15.60:0/2890337660 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ff80543e0 con 0x7f9ffc0cb5a0 2023-10-06T04:28:29.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.687+0000 7fa00219d700 1 -- 172.21.15.60:0/2890337660 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9ffc06e600 con 0x7f9ffc0cb5a0 2023-10-06T04:28:29.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.688+0000 7f9ff17fa700 1 -- 172.21.15.60:0/2890337660 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f9ff8057a00 con 0x7f9ffc0cb5a0 2023-10-06T04:28:29.690 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:29.691 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T04:28:29.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.690+0000 7fa00219d700 1 -- 172.21.15.60:0/2890337660 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f9fe0066f30 msgr2=0x7f9fe00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:29.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.690+0000 7fa00219d700 1 --2- 172.21.15.60:0/2890337660 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f9fe0066f30 0x7f9fe00693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc156b00 tx=0x7f9fec007ec0 comp rx=0 tx=0).stop 2023-10-06T04:28:29.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.690+0000 7fa00219d700 1 -- 172.21.15.60:0/2890337660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc0cb5a0 msgr2=0x7f9ffc14eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:29.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.690+0000 7fa00219d700 1 --2- 172.21.15.60:0/2890337660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc0cb5a0 0x7f9ffc14eb60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8010f70 tx=0x7f9ff800b430 comp rx=0 tx=0).stop 2023-10-06T04:28:29.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.690+0000 7fa00219d700 1 -- 172.21.15.60:0/2890337660 shutdown_connections 2023-10-06T04:28:29.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.690+0000 7fa00219d700 1 --2- 172.21.15.60:0/2890337660 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f9fe0066f30 0x7f9fe00693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:29.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.690+0000 7fa00219d700 1 --2- 172.21.15.60:0/2890337660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ffc0cb5a0 0x7f9ffc14eb60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:29.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.690+0000 7fa00219d700 1 --2- 172.21.15.60:0/2890337660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ffc153090 0x7f9ffc166420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:29.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.690+0000 7fa00219d700 1 --2- 172.21.15.60:0/2890337660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9ffc159450 0x7f9ffc152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:29.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.690+0000 7fa00219d700 1 -- 172.21.15.60:0/2890337660 >> 172.21.15.60:0/2890337660 conn(0x7f9ffc068080 msgr2=0x7f9ffc069510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:29.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.690+0000 7fa00219d700 1 -- 172.21.15.60:0/2890337660 shutdown_connections 2023-10-06T04:28:29.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.690+0000 7fa00219d700 1 -- 172.21.15.60:0/2890337660 wait complete. 2023-10-06T04:28:29.710 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T04:28:29.710 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:28:29.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.895+0000 7f52db39d700 1 Processor -- start 2023-10-06T04:28:29.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.895+0000 7f52db39d700 1 -- start start 2023-10-06T04:28:29.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.896+0000 7f52db39d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f52d4159760 0x7f52d40aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:29.899 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.896+0000 7f52db39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52d406a120 0x7f52d40ab240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:29.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.896+0000 7f52db39d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d40686c0 con 0x7f52d4159390 2023-10-06T04:28:29.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.896+0000 7f52db39d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d4068c80 con 0x7f52d4159760 2023-10-06T04:28:29.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.896+0000 7f52db39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d40ad0f0 con 0x7f52d406a120 2023-10-06T04:28:29.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.897+0000 7f52d9b9a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f52d4159760 0x7f52d40aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:29.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.897+0000 7f52d9b9a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f52d4159760 0x7f52d40aad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52250/0 (socket says 172.21.15.60:52250) 2023-10-06T04:28:29.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.897+0000 7f52d9b9a700 1 -- 172.21.15.60:0/1918795028 learned_addr learned my addr 172.21.15.60:0/1918795028 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:29.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.897+0000 7f52da39b700 1 --1- 172.21.15.60:0/1918795028 >> v1:172.21.15.135:6789/0 conn(0x7f52d4159390 0x7f52d40ac8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.60:56094/0 (socket says 172.21.15.60:56094) 2023-10-06T04:28:29.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.897+0000 7f52dab9c700 1 --2- 172.21.15.60:0/1918795028 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52d406a120 0x7f52d40ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:29.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.897+0000 7f52d9b9a700 1 -- 172.21.15.60:0/1918795028 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52d406a120 msgr2=0x7f52d40ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:29.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.897+0000 7f52d9b9a700 1 --2- 172.21.15.60:0/1918795028 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52d406a120 0x7f52d40ab240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:29.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.897+0000 7f52d9b9a700 1 -- 172.21.15.60:0/1918795028 >> v1:172.21.15.135:6789/0 conn(0x7f52d4159390 legacy=0x7f52d40ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:29.900 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.897+0000 7f52d9b9a700 1 -- 172.21.15.60:0/1918795028 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d40ad3d0 con 0x7f52d4159760 2023-10-06T04:28:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.897+0000 7f52d9b9a700 1 --2- 172.21.15.60:0/1918795028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52d4159760 0x7f52d40aad00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f52c40099b0 tx=0x7f52c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8bbf0425248e987 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.898+0000 7f52d9399700 1 -- 172.21.15.60:0/1918795028 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4009ea0 con 0x7f52d4159760 2023-10-06T04:28:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.898+0000 7f52d9399700 1 -- 172.21.15.60:0/1918795028 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c400b860 con 0x7f52d4159760 2023-10-06T04:28:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.898+0000 7f52d9399700 1 -- 172.21.15.60:0/1918795028 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c400bc00 con 0x7f52d4159760 2023-10-06T04:28:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.898+0000 7f52db39d700 1 -- 172.21.15.60:0/1918795028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52d4159760 msgr2=0x7f52d40aad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.898+0000 7f52db39d700 1 --2- 172.21.15.60:0/1918795028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52d4159760 0x7f52d40aad00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f52c40099b0 tx=0x7f52c4009250 comp rx=0 tx=0).stop 2023-10-06T04:28:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.898+0000 7f52db39d700 1 -- 172.21.15.60:0/1918795028 shutdown_connections 2023-10-06T04:28:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.898+0000 7f52db39d700 1 --2- 172.21.15.60:0/1918795028 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52d406a120 0x7f52d40ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.898+0000 7f52db39d700 1 --2- 172.21.15.60:0/1918795028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52d4159760 0x7f52d40aad00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.898+0000 7f52db39d700 1 -- 172.21.15.60:0/1918795028 >> 172.21.15.60:0/1918795028 conn(0x7f52d4097410 msgr2=0x7f52d4067d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.898+0000 7f52db39d700 1 -- 172.21.15.60:0/1918795028 shutdown_connections 2023-10-06T04:28:29.903 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.898+0000 7f52db39d700 1 -- 172.21.15.60:0/1918795028 wait complete. 2023-10-06T04:28:29.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.900+0000 7f52db39d700 1 Processor -- start 2023-10-06T04:28:29.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.900+0000 7f52db39d700 1 -- start start 2023-10-06T04:28:29.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.901+0000 7f52db39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52d406a120 0x7f52d4155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:29.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.901+0000 7f52db39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52d4159390 0x7f52d415adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:29.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.901+0000 7f52db39d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52d4159760 0x7f52d4169c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:29.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.901+0000 7f52db39d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d409aef0 con 0x7f52d4159760 2023-10-06T04:28:29.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.901+0000 7f52db39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d40cea00 con 0x7f52d4159390 2023-10-06T04:28:29.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.901+0000 7f52db39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d41555d0 con 0x7f52d406a120 2023-10-06T04:28:29.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.901+0000 7f52dab9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52d4159760 0x7f52d4169c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:29.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.901+0000 7f52da39b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52d406a120 0x7f52d4155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:29.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.901+0000 7f52dab9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52d4159760 0x7f52d4169c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52262/0 (socket says 172.21.15.60:52262) 2023-10-06T04:28:29.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.901+0000 7f52dab9c700 1 -- 172.21.15.60:0/148027233 learned_addr learned my addr 172.21.15.60:0/148027233 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:29.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.901+0000 7f52d9b9a700 1 --2- 172.21.15.60:0/148027233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52d4159390 0x7f52d415adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:29.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.902+0000 7f52dab9c700 1 -- 172.21.15.60:0/148027233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52d406a120 msgr2=0x7f52d4155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:29.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.902+0000 7f52dab9c700 1 --2- 172.21.15.60:0/148027233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52d406a120 0x7f52d4155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:29.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.902+0000 7f52dab9c700 1 -- 172.21.15.60:0/148027233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52d4159390 msgr2=0x7f52d415adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:29.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.902+0000 7f52dab9c700 1 --2- 172.21.15.60:0/148027233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52d4159390 0x7f52d415adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:29.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.902+0000 7f52dab9c700 1 -- 172.21.15.60:0/148027233 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c40094f0 con 0x7f52d4159760 2023-10-06T04:28:29.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.902+0000 7f52da39b700 1 --2- 172.21.15.60:0/148027233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52d406a120 0x7f52d4155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:29.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.902+0000 7f52d9b9a700 1 --2- 172.21.15.60:0/148027233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52d4159390 0x7f52d415adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:29.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.902+0000 7f52dab9c700 1 --2- 172.21.15.60:0/148027233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52d4159760 0x7f52d4169c10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f52cc009df0 tx=0x7f52cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:29.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.902+0000 7f52ca7fc700 1 -- 172.21.15.60:0/148027233 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00caa0 con 0x7f52d4159760 2023-10-06T04:28:29.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.902+0000 7f52ca7fc700 1 -- 172.21.15.60:0/148027233 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc00f040 con 0x7f52d4159760 2023-10-06T04:28:29.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.902+0000 7f52ca7fc700 1 -- 172.21.15.60:0/148027233 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00ce70 con 0x7f52d4159760 2023-10-06T04:28:29.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.902+0000 7f52db39d700 1 -- 172.21.15.60:0/148027233 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d416a7c0 con 0x7f52d4159760 2023-10-06T04:28:29.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.902+0000 7f52db39d700 1 -- 172.21.15.60:0/148027233 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d409ab80 con 0x7f52d4159760 2023-10-06T04:28:29.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.903+0000 7f52db39d700 1 -- 172.21.15.60:0/148027233 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d409b060 con 0x7f52d4159760 2023-10-06T04:28:29.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.904+0000 7f52ca7fc700 1 -- 172.21.15.60:0/148027233 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52cc014690 con 0x7f52d4159760 2023-10-06T04:28:29.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.905+0000 7f52ca7fc700 1 --2- 172.21.15.60:0/148027233 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f52b8066f30 0x7f52b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:29.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.905+0000 7f52ca7fc700 1 -- 172.21.15.60:0/148027233 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f52cc085230 con 0x7f52d4159760 2023-10-06T04:28:29.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.905+0000 7f52da39b700 1 --2- 172.21.15.60:0/148027233 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f52b8066f30 0x7f52b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:29.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.906+0000 7f52da39b700 1 --2- 172.21.15.60:0/148027233 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f52b8066f30 0x7f52b80693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f52d41677d0 tx=0x7f52d0007eb0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:29.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:29.909+0000 7f52ca7fc700 1 -- 172.21.15.60:0/148027233 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52cc055a40 con 0x7f52d4159760 2023-10-06T04:28:30.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.112+0000 7f52db39d700 1 -- 172.21.15.60:0/148027233 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52d405f230 con 0x7f52d4159760 2023-10-06T04:28:30.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.113+0000 7f52ca7fc700 1 -- 172.21.15.60:0/148027233 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f52cc05ce60 con 0x7f52d4159760 2023-10-06T04:28:30.116 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:30.116 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:28:11.290557+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:28:04.355358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:28:05.208550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:28:08.791979+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:28:30.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.115+0000 7f52db39d700 1 -- 172.21.15.60:0/148027233 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f52b8066f30 msgr2=0x7f52b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:30.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.115+0000 7f52db39d700 1 --2- 172.21.15.60:0/148027233 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f52b8066f30 0x7f52b80693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f52d41677d0 tx=0x7f52d0007eb0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.115+0000 7f52db39d700 1 -- 172.21.15.60:0/148027233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52d4159760 msgr2=0x7f52d4169c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:30.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.115+0000 7f52db39d700 1 --2- 172.21.15.60:0/148027233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52d4159760 0x7f52d4169c10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f52cc009df0 tx=0x7f52cc00b040 comp rx=0 tx=0).stop 2023-10-06T04:28:30.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.116+0000 7f52db39d700 1 -- 172.21.15.60:0/148027233 shutdown_connections 2023-10-06T04:28:30.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.116+0000 7f52db39d700 1 --2- 172.21.15.60:0/148027233 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f52b8066f30 0x7f52b80693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.116+0000 7f52db39d700 1 --2- 172.21.15.60:0/148027233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52d4159760 0x7f52d4169c10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.116+0000 7f52db39d700 1 --2- 172.21.15.60:0/148027233 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f52d406a120 0x7f52d4155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.116+0000 7f52db39d700 1 --2- 172.21.15.60:0/148027233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52d4159390 0x7f52d415adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.116+0000 7f52db39d700 1 -- 172.21.15.60:0/148027233 >> 172.21.15.60:0/148027233 conn(0x7f52d4097410 msgr2=0x7f52d4157620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:30.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.116+0000 7f52db39d700 1 -- 172.21.15.60:0/148027233 shutdown_connections 2023-10-06T04:28:30.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.116+0000 7f52db39d700 1 -- 172.21.15.60:0/148027233 wait complete. 2023-10-06T04:28:30.136 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:27:58.899938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:27:59.373527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:28:04.355358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:28:05.208550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:28:08.791979+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:28:30.138 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:28:30.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.325+0000 7ff443fff700 1 Processor -- start 2023-10-06T04:28:30.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.325+0000 7ff443fff700 1 -- start start 2023-10-06T04:28:30.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.327+0000 7ff443fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4441560f0 0x7ff444159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:30.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.327+0000 7ff443fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff44406e160 0x7ff44406e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:30.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.327+0000 7ff443fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44406eb00 con 0x7ff4440ae0b0 2023-10-06T04:28:30.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.327+0000 7ff443fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4440acad0 con 0x7ff44406e160 2023-10-06T04:28:30.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.327+0000 7ff443fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4441564c0 con 0x7ff4441560f0 2023-10-06T04:28:30.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.327+0000 7ff4437fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff44406e160 0x7ff44406e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:30.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.327+0000 7ff4437fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff44406e160 0x7ff44406e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52268/0 (socket says 172.21.15.60:52268) 2023-10-06T04:28:30.330 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.327+0000 7ff4437fe700 1 -- 172.21.15.60:0/3261746725 learned_addr learned my addr 172.21.15.60:0/3261746725 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:30.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.327+0000 7ff442ffd700 1 --2- 172.21.15.60:0/3261746725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4441560f0 0x7ff444159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:30.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.328+0000 7ff4437fe700 1 -- 172.21.15.60:0/3261746725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4441560f0 msgr2=0x7ff444159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:30.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.328+0000 7ff4437fe700 1 --2- 172.21.15.60:0/3261746725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4441560f0 0x7ff444159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.328+0000 7ff4437fe700 1 -- 172.21.15.60:0/3261746725 >> v1:172.21.15.135:6789/0 conn(0x7ff4440ae0b0 legacy=0x7ff4440c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:30.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.328+0000 7ff4437fe700 1 -- 172.21.15.60:0/3261746725 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44415a2d0 con 0x7ff44406e160 2023-10-06T04:28:30.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.328+0000 7ff442ffd700 1 --2- 172.21.15.60:0/3261746725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4441560f0 0x7ff444159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:30.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.328+0000 7ff4437fe700 1 --2- 172.21.15.60:0/3261746725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff44406e160 0x7ff44406e5c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009f20 tx=0x7ff43c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b9b1eb4dba4f1b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:30.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.328+0000 7ff441ffb700 1 -- 172.21.15.60:0/3261746725 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c00e070 con 0x7ff44406e160 2023-10-06T04:28:30.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.328+0000 7ff441ffb700 1 -- 172.21.15.60:0/3261746725 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c00ba80 con 0x7ff44406e160 2023-10-06T04:28:30.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.328+0000 7ff441ffb700 1 -- 172.21.15.60:0/3261746725 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c0092e0 con 0x7ff44406e160 2023-10-06T04:28:30.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.329+0000 7ff443fff700 1 -- 172.21.15.60:0/3261746725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff44406e160 msgr2=0x7ff44406e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:30.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.329+0000 7ff443fff700 1 --2- 172.21.15.60:0/3261746725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff44406e160 0x7ff44406e5c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009f20 tx=0x7ff43c009840 comp rx=0 tx=0).stop 2023-10-06T04:28:30.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.329+0000 7ff443fff700 1 -- 172.21.15.60:0/3261746725 shutdown_connections 2023-10-06T04:28:30.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.329+0000 7ff443fff700 1 --2- 172.21.15.60:0/3261746725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff44406e160 0x7ff44406e5c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.329+0000 7ff443fff700 1 --2- 172.21.15.60:0/3261746725 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4441560f0 0x7ff444159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.329+0000 7ff443fff700 1 -- 172.21.15.60:0/3261746725 >> 172.21.15.60:0/3261746725 conn(0x7ff4440cbed0 msgr2=0x7ff4440cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:30.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.329+0000 7ff443fff700 1 -- 172.21.15.60:0/3261746725 shutdown_connections 2023-10-06T04:28:30.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.329+0000 7ff443fff700 1 -- 172.21.15.60:0/3261746725 wait complete. 2023-10-06T04:28:30.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.330+0000 7ff443fff700 1 Processor -- start 2023-10-06T04:28:30.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.330+0000 7ff443fff700 1 -- start start 2023-10-06T04:28:30.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.331+0000 7ff443fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff44406e160 0x7ff444158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:30.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.331+0000 7ff443fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4440ae0b0 0x7ff4440c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:30.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.331+0000 7ff443fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4441560f0 0x7ff4440c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:30.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.331+0000 7ff443fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff444169990 con 0x7ff4441560f0 2023-10-06T04:28:30.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.331+0000 7ff443fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4440c79e0 con 0x7ff44406e160 2023-10-06T04:28:30.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.331+0000 7ff443fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff444169b80 con 0x7ff4440ae0b0 2023-10-06T04:28:30.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.332+0000 7ff4437fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4441560f0 0x7ff4440c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:30.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.332+0000 7ff4437fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4441560f0 0x7ff4440c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52278/0 (socket says 172.21.15.60:52278) 2023-10-06T04:28:30.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.332+0000 7ff4437fe700 1 -- 172.21.15.60:0/1038834326 learned_addr learned my addr 172.21.15.60:0/1038834326 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:30.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.332+0000 7ff4427fc700 1 --2- 172.21.15.60:0/1038834326 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4440ae0b0 0x7ff4440c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:30.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.332+0000 7ff442ffd700 1 --2- 172.21.15.60:0/1038834326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff44406e160 0x7ff444158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:30.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.332+0000 7ff4437fe700 1 -- 172.21.15.60:0/1038834326 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4440ae0b0 msgr2=0x7ff4440c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:30.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.332+0000 7ff4437fe700 1 --2- 172.21.15.60:0/1038834326 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4440ae0b0 0x7ff4440c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.332+0000 7ff4437fe700 1 -- 172.21.15.60:0/1038834326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff44406e160 msgr2=0x7ff444158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:30.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.332+0000 7ff4437fe700 1 --2- 172.21.15.60:0/1038834326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff44406e160 0x7ff444158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.332+0000 7ff4437fe700 1 -- 172.21.15.60:0/1038834326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c009ae0 con 0x7ff4441560f0 2023-10-06T04:28:30.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.333+0000 7ff4437fe700 1 --2- 172.21.15.60:0/1038834326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4441560f0 0x7ff4440c73f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff43c00b6c0 tx=0x7ff43c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:30.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.333+0000 7ff42affd700 1 -- 172.21.15.60:0/1038834326 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c0032f0 con 0x7ff4441560f0 2023-10-06T04:28:30.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.333+0000 7ff42affd700 1 -- 172.21.15.60:0/1038834326 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c008d50 con 0x7ff4441560f0 2023-10-06T04:28:30.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.333+0000 7ff42affd700 1 -- 172.21.15.60:0/1038834326 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c026690 con 0x7ff4441560f0 2023-10-06T04:28:30.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.333+0000 7ff443fff700 1 -- 172.21.15.60:0/1038834326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff444169e60 con 0x7ff4441560f0 2023-10-06T04:28:30.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.333+0000 7ff443fff700 1 -- 172.21.15.60:0/1038834326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff444159240 con 0x7ff4441560f0 2023-10-06T04:28:30.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.334+0000 7ff443fff700 1 -- 172.21.15.60:0/1038834326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44416a380 con 0x7ff4441560f0 2023-10-06T04:28:30.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.335+0000 7ff42affd700 1 -- 172.21.15.60:0/1038834326 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff43c003040 con 0x7ff4441560f0 2023-10-06T04:28:30.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.336+0000 7ff42affd700 1 --2- 172.21.15.60:0/1038834326 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff430066f30 0x7ff4300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:30.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.336+0000 7ff42affd700 1 -- 172.21.15.60:0/1038834326 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff43c086910 con 0x7ff4441560f0 2023-10-06T04:28:30.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.337+0000 7ff442ffd700 1 --2- 172.21.15.60:0/1038834326 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff430066f30 0x7ff4300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:30.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.337+0000 7ff442ffd700 1 --2- 172.21.15.60:0/1038834326 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff430066f30 0x7ff4300693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff434006f00 tx=0x7ff434008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:30.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.341+0000 7ff42affd700 1 -- 172.21.15.60:0/1038834326 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff44416a380 con 0x7ff4441560f0 2023-10-06T04:28:30.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.548+0000 7ff443fff700 1 -- 172.21.15.60:0/1038834326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff44416a380 con 0x7ff4441560f0 2023-10-06T04:28:30.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.549+0000 7ff42affd700 1 -- 172.21.15.60:0/1038834326 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff44416a380 con 0x7ff4441560f0 2023-10-06T04:28:30.551 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-10-06T04:28:30.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.551+0000 7ff443fff700 1 -- 172.21.15.60:0/1038834326 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff430066f30 msgr2=0x7ff4300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:30.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.551+0000 7ff443fff700 1 --2- 172.21.15.60:0/1038834326 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff430066f30 0x7ff4300693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff434006f00 tx=0x7ff434008040 comp rx=0 tx=0).stop 2023-10-06T04:28:30.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.551+0000 7ff443fff700 1 -- 172.21.15.60:0/1038834326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4441560f0 msgr2=0x7ff4440c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:30.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.551+0000 7ff443fff700 1 --2- 172.21.15.60:0/1038834326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4441560f0 0x7ff4440c73f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff43c00b6c0 tx=0x7ff43c018000 comp rx=0 tx=0).stop 2023-10-06T04:28:30.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.551+0000 7ff443fff700 1 -- 172.21.15.60:0/1038834326 shutdown_connections 2023-10-06T04:28:30.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.551+0000 7ff443fff700 1 --2- 172.21.15.60:0/1038834326 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff430066f30 0x7ff4300693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.551+0000 7ff443fff700 1 --2- 172.21.15.60:0/1038834326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4441560f0 0x7ff4440c73f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.551+0000 7ff443fff700 1 --2- 172.21.15.60:0/1038834326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff44406e160 0x7ff444158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.551+0000 7ff443fff700 1 --2- 172.21.15.60:0/1038834326 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff4440ae0b0 0x7ff4440c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.551+0000 7ff443fff700 1 -- 172.21.15.60:0/1038834326 >> 172.21.15.60:0/1038834326 conn(0x7ff4440cbed0 msgr2=0x7ff4440aec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:30.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.552+0000 7ff443fff700 1 -- 172.21.15.60:0/1038834326 shutdown_connections 2023-10-06T04:28:30.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.552+0000 7ff443fff700 1 -- 172.21.15.60:0/1038834326 wait complete. 2023-10-06T04:28:30.571 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:28:30.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.759+0000 7f481ab9d700 1 Processor -- start 2023-10-06T04:28:30.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.759+0000 7f481ab9d700 1 -- start start 2023-10-06T04:28:30.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.760+0000 7f481ab9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f48140b2620 0x7f48140cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:30.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.760+0000 7f481ab9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48140cf1b0 0x7f48140cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:30.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.760+0000 7f481ab9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48140cc970 con 0x7f48140b29f0 2023-10-06T04:28:30.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.760+0000 7f481ab9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48140cbd60 con 0x7f48140b2620 2023-10-06T04:28:30.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.760+0000 7f481ab9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48140cc040 con 0x7f48140cf1b0 2023-10-06T04:28:30.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.760+0000 7f4819b9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f48140b2620 0x7f48140cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:30.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.760+0000 7f4819b9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f48140b2620 0x7f48140cccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52280/0 (socket says 172.21.15.60:52280) 2023-10-06T04:28:30.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.760+0000 7f4819b9b700 1 -- 172.21.15.60:0/3675210958 learned_addr learned my addr 172.21.15.60:0/3675210958 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:30.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.761+0000 7f481a39c700 1 --2- 172.21.15.60:0/3675210958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48140cf1b0 0x7f48140cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:30.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.761+0000 7f4819b9b700 1 -- 172.21.15.60:0/3675210958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48140cf1b0 msgr2=0x7f48140cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:30.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.761+0000 7f4819b9b700 1 --2- 172.21.15.60:0/3675210958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48140cf1b0 0x7f48140cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.761+0000 7f4819b9b700 1 -- 172.21.15.60:0/3675210958 >> v1:172.21.15.135:6789/0 conn(0x7f48140b29f0 legacy=0x7f48140ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:30.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.761+0000 7f4819b9b700 1 -- 172.21.15.60:0/3675210958 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48140cc320 con 0x7f48140b2620 2023-10-06T04:28:30.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.761+0000 7f4819b9b700 1 --2- 172.21.15.60:0/3675210958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48140b2620 0x7f48140cccb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4810009990 tx=0x7f4810009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97fcc2a3c6ac96da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:30.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.761+0000 7f4818b99700 1 -- 172.21.15.60:0/3675210958 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4810005c10 con 0x7f48140b2620 2023-10-06T04:28:30.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.761+0000 7f4818b99700 1 -- 172.21.15.60:0/3675210958 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4810005d70 con 0x7f48140b2620 2023-10-06T04:28:30.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.761+0000 7f4818b99700 1 -- 172.21.15.60:0/3675210958 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481000b880 con 0x7f48140b2620 2023-10-06T04:28:30.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.762+0000 7f481ab9d700 1 -- 172.21.15.60:0/3675210958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48140b2620 msgr2=0x7f48140cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:30.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.762+0000 7f481ab9d700 1 --2- 172.21.15.60:0/3675210958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48140b2620 0x7f48140cccb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4810009990 tx=0x7f4810009220 comp rx=0 tx=0).stop 2023-10-06T04:28:30.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.762+0000 7f481ab9d700 1 -- 172.21.15.60:0/3675210958 shutdown_connections 2023-10-06T04:28:30.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.762+0000 7f481ab9d700 1 --2- 172.21.15.60:0/3675210958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48140cf1b0 0x7f48140cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.762+0000 7f481ab9d700 1 --2- 172.21.15.60:0/3675210958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48140b2620 0x7f48140cccb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.762+0000 7f481ab9d700 1 -- 172.21.15.60:0/3675210958 >> 172.21.15.60:0/3675210958 conn(0x7f4814099520 msgr2=0x7f481406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:30.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.762+0000 7f481ab9d700 1 -- 172.21.15.60:0/3675210958 shutdown_connections 2023-10-06T04:28:30.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.762+0000 7f481ab9d700 1 -- 172.21.15.60:0/3675210958 wait complete. 2023-10-06T04:28:30.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.764+0000 7f481ab9d700 1 Processor -- start 2023-10-06T04:28:30.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.764+0000 7f481ab9d700 1 -- start start 2023-10-06T04:28:30.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.765+0000 7f481ab9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48140b2620 0x7f4814151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:30.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.765+0000 7f481ab9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48140b29f0 0x7f48141573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:30.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.765+0000 7f481ab9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48140cf1b0 0x7f4814157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:30.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.765+0000 7f481ab9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481416a360 con 0x7f48140b29f0 2023-10-06T04:28:30.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.765+0000 7f481ab9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4814151f90 con 0x7f48140cf1b0 2023-10-06T04:28:30.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.765+0000 7f481ab9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481416a900 con 0x7f48140b2620 2023-10-06T04:28:30.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.765+0000 7f481939a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48140b29f0 0x7f48141573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:30.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.765+0000 7f481939a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48140b29f0 0x7f48141573d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52286/0 (socket says 172.21.15.60:52286) 2023-10-06T04:28:30.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.765+0000 7f481939a700 1 -- 172.21.15.60:0/1585817859 learned_addr learned my addr 172.21.15.60:0/1585817859 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:30.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.765+0000 7f4819b9b700 1 --2- 172.21.15.60:0/1585817859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48140b2620 0x7f4814151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:30.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.765+0000 7f481a39c700 1 --2- 172.21.15.60:0/1585817859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48140cf1b0 0x7f4814157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:30.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.765+0000 7f481939a700 1 -- 172.21.15.60:0/1585817859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48140b2620 msgr2=0x7f4814151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:30.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.765+0000 7f481939a700 1 --2- 172.21.15.60:0/1585817859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48140b2620 0x7f4814151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.765+0000 7f481939a700 1 -- 172.21.15.60:0/1585817859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48140cf1b0 msgr2=0x7f4814157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.765+0000 7f481939a700 1 --2- 172.21.15.60:0/1585817859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48140cf1b0 0x7f4814157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.765+0000 7f481939a700 1 -- 172.21.15.60:0/1585817859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4810009480 con 0x7f48140b29f0 2023-10-06T04:28:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.766+0000 7f481939a700 1 --2- 172.21.15.60:0/1585817859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48140b29f0 0x7f48141573d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f480400c7c0 tx=0x7f4804007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.766+0000 7f4809ffb700 1 -- 172.21.15.60:0/1585817859 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804011590 con 0x7f48140b29f0 2023-10-06T04:28:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.766+0000 7f4809ffb700 1 -- 172.21.15.60:0/1585817859 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48040116f0 con 0x7f48140b29f0 2023-10-06T04:28:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.766+0000 7f4809ffb700 1 -- 172.21.15.60:0/1585817859 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804011ab0 con 0x7f48140b29f0 2023-10-06T04:28:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.766+0000 7f481ab9d700 1 -- 172.21.15.60:0/1585817859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4814169a30 con 0x7f48140b29f0 2023-10-06T04:28:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.766+0000 7f481ab9d700 1 -- 172.21.15.60:0/1585817859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4814169ff0 con 0x7f48140b29f0 2023-10-06T04:28:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.767+0000 7f481ab9d700 1 -- 172.21.15.60:0/1585817859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481416a510 con 0x7f48140b29f0 2023-10-06T04:28:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.768+0000 7f4809ffb700 1 -- 172.21.15.60:0/1585817859 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f480401b3b0 con 0x7f48140b29f0 2023-10-06T04:28:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.768+0000 7f4809ffb700 1 --2- 172.21.15.60:0/1585817859 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f47f8066f30 0x7f47f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.769+0000 7f4809ffb700 1 -- 172.21.15.60:0/1585817859 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4804083f40 con 0x7f48140b29f0 2023-10-06T04:28:30.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.769+0000 7f4819b9b700 1 --2- 172.21.15.60:0/1585817859 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f47f8066f30 0x7f47f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:30.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.769+0000 7f4819b9b700 1 --2- 172.21.15.60:0/1585817859 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f47f8066f30 0x7f47f80693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4814153300 tx=0x7f4810016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:30.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.772+0000 7f4809ffb700 1 -- 172.21.15.60:0/1585817859 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f481416a510 con 0x7f48140b29f0 2023-10-06T04:28:30.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.974+0000 7f481ab9d700 1 -- 172.21.15.60:0/1585817859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f481416a6d0 con 0x7f48140b29f0 2023-10-06T04:28:30.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.975+0000 7f4809ffb700 1 -- 172.21.15.60:0/1585817859 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4804017020 con 0x7f48140b29f0 2023-10-06T04:28:30.977 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-06T04:28:30.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.977+0000 7f481ab9d700 1 -- 172.21.15.60:0/1585817859 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f47f8066f30 msgr2=0x7f47f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:30.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.977+0000 7f481ab9d700 1 --2- 172.21.15.60:0/1585817859 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f47f8066f30 0x7f47f80693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4814153300 tx=0x7f4810016000 comp rx=0 tx=0).stop 2023-10-06T04:28:30.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.977+0000 7f481ab9d700 1 -- 172.21.15.60:0/1585817859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48140b29f0 msgr2=0x7f48141573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:30.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.977+0000 7f481ab9d700 1 --2- 172.21.15.60:0/1585817859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48140b29f0 0x7f48141573d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f480400c7c0 tx=0x7f4804007f50 comp rx=0 tx=0).stop 2023-10-06T04:28:30.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.977+0000 7f481ab9d700 1 -- 172.21.15.60:0/1585817859 shutdown_connections 2023-10-06T04:28:30.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.977+0000 7f481ab9d700 1 --2- 172.21.15.60:0/1585817859 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f47f8066f30 0x7f47f80693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.977+0000 7f481ab9d700 1 --2- 172.21.15.60:0/1585817859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48140cf1b0 0x7f4814157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.977+0000 7f481ab9d700 1 --2- 172.21.15.60:0/1585817859 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f48140b2620 0x7f4814151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.977+0000 7f481ab9d700 1 --2- 172.21.15.60:0/1585817859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48140b29f0 0x7f48141573d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:30.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.977+0000 7f481ab9d700 1 -- 172.21.15.60:0/1585817859 >> 172.21.15.60:0/1585817859 conn(0x7f4814099520 msgr2=0x7f48140689a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:30.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.977+0000 7f481ab9d700 1 -- 172.21.15.60:0/1585817859 shutdown_connections 2023-10-06T04:28:30.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:30.978+0000 7f481ab9d700 1 -- 172.21.15.60:0/1585817859 wait complete. 2023-10-06T04:28:30.997 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:28:31.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.186+0000 7f1a6d59d700 1 Processor -- start 2023-10-06T04:28:31.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.186+0000 7f1a6d59d700 1 -- start start 2023-10-06T04:28:31.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.187+0000 7f1a6d59d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1a680b2620 0x7f1a680cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:31.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.187+0000 7f1a6d59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a680cf1b0 0x7f1a680cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:31.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.187+0000 7f1a6d59d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a680cc970 con 0x7f1a680b29f0 2023-10-06T04:28:31.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.187+0000 7f1a6d59d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a680cbd60 con 0x7f1a680b2620 2023-10-06T04:28:31.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.187+0000 7f1a6d59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a680cc040 con 0x7f1a680cf1b0 2023-10-06T04:28:31.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.188+0000 7f1a677fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1a680b29f0 0x7f1a680ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57052/0 (socket says 172.21.15.60:57052) 2023-10-06T04:28:31.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.188+0000 7f1a677fe700 1 -- 172.21.15.60:0/16898560 learned_addr learned my addr 172.21.15.60:0/16898560 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:31.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.188+0000 7f1a67fff700 1 --2- 172.21.15.60:0/16898560 >> v2:172.21.15.135:3300/0 conn(0x7f1a680b2620 0x7f1a680cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:31.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.188+0000 7f1a6cd9c700 1 --2- 172.21.15.60:0/16898560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a680cf1b0 0x7f1a680cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:31.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.188+0000 7f1a66ffd700 1 -- 172.21.15.60:0/16898560 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227428225 0 0) 0x7f1a680cc970 con 0x7f1a680b29f0 2023-10-06T04:28:31.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.188+0000 7f1a66ffd700 1 -- 172.21.15.60:0/16898560 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a50003570 con 0x7f1a680b29f0 2023-10-06T04:28:31.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.188+0000 7f1a6cd9c700 1 -- 172.21.15.60:0/16898560 >> v2:172.21.15.135:3300/0 conn(0x7f1a680b2620 msgr2=0x7f1a680cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:31.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.188+0000 7f1a6cd9c700 1 --2- 172.21.15.60:0/16898560 >> v2:172.21.15.135:3300/0 conn(0x7f1a680b2620 0x7f1a680cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:31.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.188+0000 7f1a6cd9c700 1 -- 172.21.15.60:0/16898560 >> v1:172.21.15.60:6789/0 conn(0x7f1a680b29f0 legacy=0x7f1a680ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:31.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.188+0000 7f1a6cd9c700 1 -- 172.21.15.60:0/16898560 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a680cc320 con 0x7f1a680cf1b0 2023-10-06T04:28:31.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.189+0000 7f1a6cd9c700 1 --2- 172.21.15.60:0/16898560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a680cf1b0 0x7f1a680cd1f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009e60 tx=0x7f1a60009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dc5f044e52c29bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:31.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.189+0000 7f1a66ffd700 1 -- 172.21.15.60:0/16898560 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6000e070 con 0x7f1a680cf1b0 2023-10-06T04:28:31.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.189+0000 7f1a66ffd700 1 -- 172.21.15.60:0/16898560 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6000bab0 con 0x7f1a680cf1b0 2023-10-06T04:28:31.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.189+0000 7f1a66ffd700 1 -- 172.21.15.60:0/16898560 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6000be30 con 0x7f1a680cf1b0 2023-10-06T04:28:31.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.190+0000 7f1a6d59d700 1 -- 172.21.15.60:0/16898560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a680cf1b0 msgr2=0x7f1a680cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:31.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.190+0000 7f1a6d59d700 1 --2- 172.21.15.60:0/16898560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a680cf1b0 0x7f1a680cd1f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009e60 tx=0x7f1a60009780 comp rx=0 tx=0).stop 2023-10-06T04:28:31.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.190+0000 7f1a6d59d700 1 -- 172.21.15.60:0/16898560 shutdown_connections 2023-10-06T04:28:31.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.190+0000 7f1a6d59d700 1 --2- 172.21.15.60:0/16898560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a680cf1b0 0x7f1a680cd1f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:31.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.190+0000 7f1a6d59d700 1 --2- 172.21.15.60:0/16898560 >> v2:172.21.15.135:3300/0 conn(0x7f1a680b2620 0x7f1a680cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:31.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.190+0000 7f1a6d59d700 1 -- 172.21.15.60:0/16898560 >> 172.21.15.60:0/16898560 conn(0x7f1a68099520 msgr2=0x7f1a6806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:31.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.190+0000 7f1a6d59d700 1 -- 172.21.15.60:0/16898560 shutdown_connections 2023-10-06T04:28:31.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.190+0000 7f1a6d59d700 1 -- 172.21.15.60:0/16898560 wait complete. 2023-10-06T04:28:31.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.191+0000 7f1a6d59d700 1 Processor -- start 2023-10-06T04:28:31.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.191+0000 7f1a6d59d700 1 -- start start 2023-10-06T04:28:31.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.192+0000 7f1a6d59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a680b2620 0x7f1a681543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:31.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.192+0000 7f1a6d59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a680b29f0 0x7f1a680c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:31.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.192+0000 7f1a6d59d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a680cf1b0 0x7f1a680c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:31.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.192+0000 7f1a6d59d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a680b43d0 con 0x7f1a680cf1b0 2023-10-06T04:28:31.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.192+0000 7f1a6d59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a680b5860 con 0x7f1a680b29f0 2023-10-06T04:28:31.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.192+0000 7f1a6d59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a680b3d80 con 0x7f1a680b2620 2023-10-06T04:28:31.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.192+0000 7f1a6cd9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a680cf1b0 0x7f1a680c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:31.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.193+0000 7f1a6cd9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a680cf1b0 0x7f1a680c9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52290/0 (socket says 172.21.15.60:52290) 2023-10-06T04:28:31.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.193+0000 7f1a6cd9c700 1 -- 172.21.15.60:0/253031082 learned_addr learned my addr 172.21.15.60:0/253031082 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:31.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.193+0000 7f1a67fff700 1 --2- 172.21.15.60:0/253031082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a680b2620 0x7f1a681543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:31.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.193+0000 7f1a677fe700 1 --2- 172.21.15.60:0/253031082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a680b29f0 0x7f1a680c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:31.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.193+0000 7f1a6cd9c700 1 -- 172.21.15.60:0/253031082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a680b2620 msgr2=0x7f1a681543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:31.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.193+0000 7f1a6cd9c700 1 --2- 172.21.15.60:0/253031082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a680b2620 0x7f1a681543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:31.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.193+0000 7f1a6cd9c700 1 -- 172.21.15.60:0/253031082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a680b29f0 msgr2=0x7f1a680c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:31.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.193+0000 7f1a6cd9c700 1 --2- 172.21.15.60:0/253031082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a680b29f0 0x7f1a680c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:31.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.193+0000 7f1a6cd9c700 1 -- 172.21.15.60:0/253031082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a60009a20 con 0x7f1a680cf1b0 2023-10-06T04:28:31.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.193+0000 7f1a677fe700 1 --2- 172.21.15.60:0/253031082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a680b29f0 0x7f1a680c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:31.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.193+0000 7f1a6cd9c700 1 --2- 172.21.15.60:0/253031082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a680cf1b0 0x7f1a680c9410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1a680cc180 tx=0x7f1a60019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:31.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.194+0000 7f1a4ffff700 1 -- 172.21.15.60:0/253031082 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a60027470 con 0x7f1a680cf1b0 2023-10-06T04:28:31.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.194+0000 7f1a4ffff700 1 -- 172.21.15.60:0/253031082 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a60027610 con 0x7f1a680cf1b0 2023-10-06T04:28:31.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.194+0000 7f1a4ffff700 1 -- 172.21.15.60:0/253031082 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a600279d0 con 0x7f1a680cf1b0 2023-10-06T04:28:31.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.194+0000 7f1a6d59d700 1 -- 172.21.15.60:0/253031082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a680b4060 con 0x7f1a680cf1b0 2023-10-06T04:28:31.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.194+0000 7f1a6d59d700 1 -- 172.21.15.60:0/253031082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a680b3a50 con 0x7f1a680cf1b0 2023-10-06T04:28:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.195+0000 7f1a6d59d700 1 -- 172.21.15.60:0/253031082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a680b4540 con 0x7f1a680cf1b0 2023-10-06T04:28:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.196+0000 7f1a4ffff700 1 -- 172.21.15.60:0/253031082 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a60024070 con 0x7f1a680cf1b0 2023-10-06T04:28:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.197+0000 7f1a4ffff700 1 --2- 172.21.15.60:0/253031082 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1a54066f30 0x7f1a540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.197+0000 7f1a4ffff700 1 -- 172.21.15.60:0/253031082 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1a60087300 con 0x7f1a680cf1b0 2023-10-06T04:28:31.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.197+0000 7f1a67fff700 1 --2- 172.21.15.60:0/253031082 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1a54066f30 0x7f1a540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:31.201 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.197+0000 7f1a67fff700 1 --2- 172.21.15.60:0/253031082 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1a54066f30 0x7f1a540693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009d00 tx=0x7f1a58009120 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:31.203 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.201+0000 7f1a4ffff700 1 -- 172.21.15.60:0/253031082 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a60054120 con 0x7f1a680cf1b0 2023-10-06T04:28:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.406+0000 7f1a6d59d700 1 -- 172.21.15.60:0/253031082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1a6805f230 con 0x7f1a680cf1b0 2023-10-06T04:28:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.407+0000 7f1a4ffff700 1 -- 172.21.15.60:0/253031082 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1a60057740 con 0x7f1a680cf1b0 2023-10-06T04:28:31.410 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-06T04:28:31.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.409+0000 7f1a6d59d700 1 -- 172.21.15.60:0/253031082 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1a54066f30 msgr2=0x7f1a540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:31.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.409+0000 7f1a6d59d700 1 --2- 172.21.15.60:0/253031082 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1a54066f30 0x7f1a540693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009d00 tx=0x7f1a58009120 comp rx=0 tx=0).stop 2023-10-06T04:28:31.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.409+0000 7f1a6d59d700 1 -- 172.21.15.60:0/253031082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a680cf1b0 msgr2=0x7f1a680c9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:31.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.409+0000 7f1a6d59d700 1 --2- 172.21.15.60:0/253031082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a680cf1b0 0x7f1a680c9410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1a680cc180 tx=0x7f1a60019000 comp rx=0 tx=0).stop 2023-10-06T04:28:31.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.409+0000 7f1a6d59d700 1 -- 172.21.15.60:0/253031082 shutdown_connections 2023-10-06T04:28:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.409+0000 7f1a6d59d700 1 --2- 172.21.15.60:0/253031082 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1a54066f30 0x7f1a540693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.409+0000 7f1a6d59d700 1 --2- 172.21.15.60:0/253031082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a680cf1b0 0x7f1a680c9410 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.409+0000 7f1a6d59d700 1 --2- 172.21.15.60:0/253031082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a680b2620 0x7f1a681543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.409+0000 7f1a6d59d700 1 --2- 172.21.15.60:0/253031082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a680b29f0 0x7f1a680c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.409+0000 7f1a6d59d700 1 -- 172.21.15.60:0/253031082 >> 172.21.15.60:0/253031082 conn(0x7f1a68099520 msgr2=0x7f1a680cc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:31.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.410+0000 7f1a6d59d700 1 -- 172.21.15.60:0/253031082 shutdown_connections 2023-10-06T04:28:31.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.410+0000 7f1a6d59d700 1 -- 172.21.15.60:0/253031082 wait complete. 2023-10-06T04:28:31.438 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:28:31.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.627+0000 7fef00d9d700 1 Processor -- start 2023-10-06T04:28:31.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.627+0000 7fef00d9d700 1 -- start start 2023-10-06T04:28:31.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.628+0000 7fef00d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7feefc0b2620 0x7feefc0cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:31.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.628+0000 7fef00d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feefc0b29f0 0x7feefc0cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:31.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.628+0000 7fef00d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feefc0ceaa0 0x7feefc0cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:31.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.628+0000 7fef00d9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feefc0cc970 con 0x7feefc0b29f0 2023-10-06T04:28:31.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.628+0000 7fef00d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feefc0cf480 con 0x7feefc0b2620 2023-10-06T04:28:31.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.628+0000 7fef00d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feefc0cbd60 con 0x7feefc0ceaa0 2023-10-06T04:28:31.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.629+0000 7feefaffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feefc0b29f0 0x7feefc0cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:31.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.629+0000 7feefaffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feefc0b29f0 0x7feefc0cd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52298/0 (socket says 172.21.15.60:52298) 2023-10-06T04:28:31.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.629+0000 7feefaffd700 1 -- 172.21.15.60:0/3173215104 learned_addr learned my addr 172.21.15.60:0/3173215104 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:31.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.629+0000 7feefb7fe700 1 --2- 172.21.15.60:0/3173215104 >> v2:172.21.15.135:3300/0 conn(0x7feefc0b2620 0x7feefc0cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:31.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.629+0000 7feefbfff700 1 --2- 172.21.15.60:0/3173215104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feefc0ceaa0 0x7feefc0cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:31.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.629+0000 7feefaffd700 1 -- 172.21.15.60:0/3173215104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feefc0ceaa0 msgr2=0x7feefc0cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:31.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.629+0000 7feefaffd700 1 --2- 172.21.15.60:0/3173215104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feefc0ceaa0 0x7feefc0cef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:31.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.629+0000 7feefaffd700 1 -- 172.21.15.60:0/3173215104 >> v2:172.21.15.135:3300/0 conn(0x7feefc0b2620 msgr2=0x7feefc0cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:31.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.629+0000 7feefaffd700 1 --2- 172.21.15.60:0/3173215104 >> v2:172.21.15.135:3300/0 conn(0x7feefc0b2620 0x7feefc0cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:31.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.629+0000 7feefaffd700 1 -- 172.21.15.60:0/3173215104 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc0cc040 con 0x7feefc0b29f0 2023-10-06T04:28:31.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.629+0000 7feefaffd700 1 --2- 172.21.15.60:0/3173215104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feefc0b29f0 0x7feefc0cd1f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feefc0894c0 tx=0x7feef0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa7fab7c9de2260 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:31.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.630+0000 7feefa7fc700 1 -- 172.21.15.60:0/3173215104 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef000b860 con 0x7feefc0b29f0 2023-10-06T04:28:31.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.630+0000 7feefa7fc700 1 -- 172.21.15.60:0/3173215104 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef000b9c0 con 0x7feefc0b29f0 2023-10-06T04:28:31.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.630+0000 7feefa7fc700 1 -- 172.21.15.60:0/3173215104 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef000bd60 con 0x7feefc0b29f0 2023-10-06T04:28:31.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.630+0000 7fef00d9d700 1 -- 172.21.15.60:0/3173215104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feefc0b29f0 msgr2=0x7feefc0cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:31.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.630+0000 7fef00d9d700 1 --2- 172.21.15.60:0/3173215104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feefc0b29f0 0x7feefc0cd1f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feefc0894c0 tx=0x7feef0009250 comp rx=0 tx=0).stop 2023-10-06T04:28:31.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.630+0000 7fef00d9d700 1 -- 172.21.15.60:0/3173215104 shutdown_connections 2023-10-06T04:28:31.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.630+0000 7fef00d9d700 1 --2- 172.21.15.60:0/3173215104 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feefc0ceaa0 0x7feefc0cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:31.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.630+0000 7fef00d9d700 1 --2- 172.21.15.60:0/3173215104 >> v2:172.21.15.135:3300/0 conn(0x7feefc0b2620 0x7feefc0cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:31.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.630+0000 7fef00d9d700 1 --2- 172.21.15.60:0/3173215104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feefc0b29f0 0x7feefc0cd1f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:31.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.630+0000 7fef00d9d700 1 -- 172.21.15.60:0/3173215104 >> 172.21.15.60:0/3173215104 conn(0x7feefc099520 msgr2=0x7feefc06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:31.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.630+0000 7fef00d9d700 1 -- 172.21.15.60:0/3173215104 shutdown_connections 2023-10-06T04:28:31.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.630+0000 7fef00d9d700 1 -- 172.21.15.60:0/3173215104 wait complete. 2023-10-06T04:28:31.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.632+0000 7fef00d9d700 1 Processor -- start 2023-10-06T04:28:31.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.632+0000 7fef00d9d700 1 -- start start 2023-10-06T04:28:31.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.633+0000 7fef00d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feefc0b2620 0x7feefc158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:31.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.633+0000 7fef00d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feefc0b29f0 0x7feefc09c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:31.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.633+0000 7fef00d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feefc0ceaa0 0x7feefc09b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:31.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.633+0000 7fef00d9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc09ac40 con 0x7feefc0b2620 2023-10-06T04:28:31.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.633+0000 7fef00d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc15cb10 con 0x7feefc0b29f0 2023-10-06T04:28:31.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.633+0000 7fef00d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feefc09a030 con 0x7feefc0ceaa0 2023-10-06T04:28:31.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.633+0000 7feefb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feefc0b2620 0x7feefc158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:31.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.633+0000 7feefb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feefc0b2620 0x7feefc158e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52308/0 (socket says 172.21.15.60:52308) 2023-10-06T04:28:31.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.633+0000 7feefb7fe700 1 -- 172.21.15.60:0/1541863281 learned_addr learned my addr 172.21.15.60:0/1541863281 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:31.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.633+0000 7feefaffd700 1 --2- 172.21.15.60:0/1541863281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feefc0b29f0 0x7feefc09c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:31.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.633+0000 7feefbfff700 1 --2- 172.21.15.60:0/1541863281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feefc0ceaa0 0x7feefc09b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:31.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.633+0000 7feefb7fe700 1 -- 172.21.15.60:0/1541863281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feefc0ceaa0 msgr2=0x7feefc09b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:31.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.633+0000 7feefb7fe700 1 --2- 172.21.15.60:0/1541863281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feefc0ceaa0 0x7feefc09b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:31.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.633+0000 7feefb7fe700 1 -- 172.21.15.60:0/1541863281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feefc0b29f0 msgr2=0x7feefc09c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:31.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.633+0000 7feefb7fe700 1 --2- 172.21.15.60:0/1541863281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feefc0b29f0 0x7feefc09c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:31.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.633+0000 7feefb7fe700 1 -- 172.21.15.60:0/1541863281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef00094f0 con 0x7feefc0b2620 2023-10-06T04:28:31.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.633+0000 7feefbfff700 1 --2- 172.21.15.60:0/1541863281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feefc0ceaa0 0x7feefc09b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:31.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.634+0000 7feefb7fe700 1 --2- 172.21.15.60:0/1541863281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feefc0b2620 0x7feefc158e10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7feeec00d840 tx=0x7feeec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:31.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.634+0000 7feee37fe700 1 -- 172.21.15.60:0/1541863281 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec014620 con 0x7feefc0b2620 2023-10-06T04:28:31.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.634+0000 7feee37fe700 1 -- 172.21.15.60:0/1541863281 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeec014780 con 0x7feefc0b2620 2023-10-06T04:28:31.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.634+0000 7feee37fe700 1 -- 172.21.15.60:0/1541863281 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec014b40 con 0x7feefc0b2620 2023-10-06T04:28:31.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.634+0000 7fef00d9d700 1 -- 172.21.15.60:0/1541863281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feefc09a310 con 0x7feefc0b2620 2023-10-06T04:28:31.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.634+0000 7fef00d9d700 1 -- 172.21.15.60:0/1541863281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feefc09a8d0 con 0x7feefc0b2620 2023-10-06T04:28:31.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.635+0000 7fef00d9d700 1 -- 172.21.15.60:0/1541863281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feefc05f230 con 0x7feefc0b2620 2023-10-06T04:28:31.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.636+0000 7feee37fe700 1 -- 172.21.15.60:0/1541863281 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feeec01d400 con 0x7feefc0b2620 2023-10-06T04:28:31.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.637+0000 7feee37fe700 1 --2- 172.21.15.60:0/1541863281 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7feee8066f30 0x7feee80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:31.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.637+0000 7feee37fe700 1 -- 172.21.15.60:0/1541863281 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7feeec085210 con 0x7feefc0b2620 2023-10-06T04:28:31.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.637+0000 7feefaffd700 1 --2- 172.21.15.60:0/1541863281 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7feee8066f30 0x7feee80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:31.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.638+0000 7feefaffd700 1 --2- 172.21.15.60:0/1541863281 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7feee8066f30 0x7feee80693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feefc0894c0 tx=0x7feef0017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:31.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.641+0000 7feee37fe700 1 -- 172.21.15.60:0/1541863281 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feeec051f90 con 0x7feefc0b2620 2023-10-06T04:28:31.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.843+0000 7fef00d9d700 1 -- 172.21.15.60:0/1541863281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feefc09af20 con 0x7feefc0b2620 2023-10-06T04:28:31.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.843+0000 7feee37fe700 1 -- 172.21.15.60:0/1541863281 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7feeec0555b0 con 0x7feefc0b2620 2023-10-06T04:28:31.849 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-06T04:28:31.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.845+0000 7fef00d9d700 1 -- 172.21.15.60:0/1541863281 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7feee8066f30 msgr2=0x7feee80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:31.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.845+0000 7fef00d9d700 1 --2- 172.21.15.60:0/1541863281 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7feee8066f30 0x7feee80693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feefc0894c0 tx=0x7feef0017000 comp rx=0 tx=0).stop 2023-10-06T04:28:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.845+0000 7fef00d9d700 1 -- 172.21.15.60:0/1541863281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feefc0b2620 msgr2=0x7feefc158e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.845+0000 7fef00d9d700 1 --2- 172.21.15.60:0/1541863281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feefc0b2620 0x7feefc158e10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7feeec00d840 tx=0x7feeec008040 comp rx=0 tx=0).stop 2023-10-06T04:28:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.846+0000 7fef00d9d700 1 -- 172.21.15.60:0/1541863281 shutdown_connections 2023-10-06T04:28:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.846+0000 7fef00d9d700 1 --2- 172.21.15.60:0/1541863281 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7feee8066f30 0x7feee80693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.846+0000 7fef00d9d700 1 --2- 172.21.15.60:0/1541863281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feefc0b2620 0x7feefc158e10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.846+0000 7fef00d9d700 1 --2- 172.21.15.60:0/1541863281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feefc0ceaa0 0x7feefc09b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:31.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.846+0000 7fef00d9d700 1 --2- 172.21.15.60:0/1541863281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feefc0b29f0 0x7feefc09c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:31.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.846+0000 7fef00d9d700 1 -- 172.21.15.60:0/1541863281 >> 172.21.15.60:0/1541863281 conn(0x7feefc099520 msgr2=0x7feefc0b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:31.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.846+0000 7fef00d9d700 1 -- 172.21.15.60:0/1541863281 shutdown_connections 2023-10-06T04:28:31.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:31.846+0000 7fef00d9d700 1 -- 172.21.15.60:0/1541863281 wait complete. 2023-10-06T04:28:31.866 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:28:32.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.055+0000 7fced7fff700 1 Processor -- start 2023-10-06T04:28:32.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.055+0000 7fced7fff700 1 -- start start 2023-10-06T04:28:32.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.056+0000 7fced7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced80cb770 0x7fced8156f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:32.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.056+0000 7fced7fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fced806e9f0 0x7fced806ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:32.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.056+0000 7fced7fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced80ad7f0 con 0x7fced8155db0 2023-10-06T04:28:32.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.056+0000 7fced7fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced8150320 con 0x7fced806e9f0 2023-10-06T04:28:32.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.056+0000 7fced7fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced806f3d0 con 0x7fced80cb770 2023-10-06T04:28:32.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.057+0000 7fced67fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fced806e9f0 0x7fced806ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:32.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.057+0000 7fced67fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fced806e9f0 0x7fced806ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52318/0 (socket says 172.21.15.60:52318) 2023-10-06T04:28:32.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.057+0000 7fced67fc700 1 -- 172.21.15.60:0/2536336227 learned_addr learned my addr 172.21.15.60:0/2536336227 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:32.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.057+0000 7fced77fe700 1 --1- 172.21.15.60:0/2536336227 >> v1:172.21.15.60:6789/0 conn(0x7fced8155db0 0x7fced81561f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57060/0 (socket says 172.21.15.60:57060) 2023-10-06T04:28:32.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.057+0000 7fced6ffd700 1 --2- 172.21.15.60:0/2536336227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced80cb770 0x7fced8156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:32.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.057+0000 7fced67fc700 1 -- 172.21.15.60:0/2536336227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced80cb770 msgr2=0x7fced8156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:32.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.057+0000 7fced67fc700 1 --2- 172.21.15.60:0/2536336227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced80cb770 0x7fced8156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.057+0000 7fced67fc700 1 -- 172.21.15.60:0/2536336227 >> v1:172.21.15.60:6789/0 conn(0x7fced8155db0 legacy=0x7fced81561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:32.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.057+0000 7fced67fc700 1 -- 172.21.15.60:0/2536336227 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced8156900 con 0x7fced806e9f0 2023-10-06T04:28:32.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.057+0000 7fced67fc700 1 --2- 172.21.15.60:0/2536336227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fced806e9f0 0x7fced806ee90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0099b0 tx=0x7fcecc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41b14cacb7a578e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:32.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.058+0000 7fced5ffb700 1 -- 172.21.15.60:0/2536336227 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc009ea0 con 0x7fced806e9f0 2023-10-06T04:28:32.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.058+0000 7fced5ffb700 1 -- 172.21.15.60:0/2536336227 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc00b860 con 0x7fced806e9f0 2023-10-06T04:28:32.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.058+0000 7fced5ffb700 1 -- 172.21.15.60:0/2536336227 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00bc00 con 0x7fced806e9f0 2023-10-06T04:28:32.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.058+0000 7fced7fff700 1 -- 172.21.15.60:0/2536336227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fced806e9f0 msgr2=0x7fced806ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:32.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.058+0000 7fced7fff700 1 --2- 172.21.15.60:0/2536336227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fced806e9f0 0x7fced806ee90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0099b0 tx=0x7fcecc009250 comp rx=0 tx=0).stop 2023-10-06T04:28:32.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.058+0000 7fced7fff700 1 -- 172.21.15.60:0/2536336227 shutdown_connections 2023-10-06T04:28:32.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.058+0000 7fced7fff700 1 --2- 172.21.15.60:0/2536336227 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced80cb770 0x7fced8156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.058+0000 7fced7fff700 1 --2- 172.21.15.60:0/2536336227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fced806e9f0 0x7fced806ee90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.058+0000 7fced7fff700 1 -- 172.21.15.60:0/2536336227 >> 172.21.15.60:0/2536336227 conn(0x7fced80cbed0 msgr2=0x7fced80cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:32.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.058+0000 7fced7fff700 1 -- 172.21.15.60:0/2536336227 shutdown_connections 2023-10-06T04:28:32.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.058+0000 7fced7fff700 1 -- 172.21.15.60:0/2536336227 wait complete. 2023-10-06T04:28:32.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.060+0000 7fced7fff700 1 Processor -- start 2023-10-06T04:28:32.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.060+0000 7fced7fff700 1 -- start start 2023-10-06T04:28:32.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.061+0000 7fced7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced806e9f0 0x7fced8155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:32.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.061+0000 7fced7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced80cb770 0x7fced8152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:32.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.061+0000 7fced7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fced8155db0 0x7fced8147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:32.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.061+0000 7fced7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced8153180 con 0x7fced8155db0 2023-10-06T04:28:32.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.061+0000 7fced7fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced8151450 con 0x7fced806e9f0 2023-10-06T04:28:32.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.061+0000 7fced7fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced8141200 con 0x7fced80cb770 2023-10-06T04:28:32.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.061+0000 7fced77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fced8155db0 0x7fced8147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:32.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.061+0000 7fced77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fced8155db0 0x7fced8147260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52334/0 (socket says 172.21.15.60:52334) 2023-10-06T04:28:32.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.061+0000 7fced77fe700 1 -- 172.21.15.60:0/899356324 learned_addr learned my addr 172.21.15.60:0/899356324 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:32.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.061+0000 7fced67fc700 1 --2- 172.21.15.60:0/899356324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced80cb770 0x7fced8152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:32.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.061+0000 7fced6ffd700 1 --2- 172.21.15.60:0/899356324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced806e9f0 0x7fced8155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:32.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.062+0000 7fced77fe700 1 -- 172.21.15.60:0/899356324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced80cb770 msgr2=0x7fced8152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:32.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.062+0000 7fced77fe700 1 --2- 172.21.15.60:0/899356324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced80cb770 0x7fced8152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.062+0000 7fced77fe700 1 -- 172.21.15.60:0/899356324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced806e9f0 msgr2=0x7fced8155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:32.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.062+0000 7fced77fe700 1 --2- 172.21.15.60:0/899356324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced806e9f0 0x7fced8155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.062+0000 7fced77fe700 1 -- 172.21.15.60:0/899356324 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc0094f0 con 0x7fced8155db0 2023-10-06T04:28:32.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.062+0000 7fced6ffd700 1 --2- 172.21.15.60:0/899356324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced806e9f0 0x7fced8155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:32.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.062+0000 7fced67fc700 1 --2- 172.21.15.60:0/899356324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced80cb770 0x7fced8152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:32.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.062+0000 7fced77fe700 1 --2- 172.21.15.60:0/899356324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fced8155db0 0x7fced8147260 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fced000cc70 tx=0x7fced0001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:32.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.062+0000 7fcebeffd700 1 -- 172.21.15.60:0/899356324 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced0004bb0 con 0x7fced8155db0 2023-10-06T04:28:32.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.062+0000 7fcebeffd700 1 -- 172.21.15.60:0/899356324 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced0004d10 con 0x7fced8155db0 2023-10-06T04:28:32.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.062+0000 7fcebeffd700 1 -- 172.21.15.60:0/899356324 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced000ab90 con 0x7fced8155db0 2023-10-06T04:28:32.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.062+0000 7fced7fff700 1 -- 172.21.15.60:0/899356324 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced81414e0 con 0x7fced8155db0 2023-10-06T04:28:32.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.062+0000 7fced7fff700 1 -- 172.21.15.60:0/899356324 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced8151070 con 0x7fced8155db0 2023-10-06T04:28:32.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.063+0000 7fced7fff700 1 -- 172.21.15.60:0/899356324 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced8141030 con 0x7fced8155db0 2023-10-06T04:28:32.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.064+0000 7fcebeffd700 1 -- 172.21.15.60:0/899356324 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fced00070f0 con 0x7fced8155db0 2023-10-06T04:28:32.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.065+0000 7fcebeffd700 1 --2- 172.21.15.60:0/899356324 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fcec4066f30 0x7fcec40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:32.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.065+0000 7fcebeffd700 1 -- 172.21.15.60:0/899356324 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fced00844f0 con 0x7fced8155db0 2023-10-06T04:28:32.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.065+0000 7fced6ffd700 1 --2- 172.21.15.60:0/899356324 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fcec4066f30 0x7fcec40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:32.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.066+0000 7fced6ffd700 1 --2- 172.21.15.60:0/899356324 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fcec4066f30 0x7fcec40693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009d80 tx=0x7fcec8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:32.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.069+0000 7fcebeffd700 1 -- 172.21.15.60:0/899356324 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fced00512f0 con 0x7fced8155db0 2023-10-06T04:28:32.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.271+0000 7fced7fff700 1 -- 172.21.15.60:0/899356324 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fced805f230 con 0x7fced8155db0 2023-10-06T04:28:32.274 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.271+0000 7fcebeffd700 1 -- 172.21.15.60:0/899356324 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fced0054910 con 0x7fced8155db0 2023-10-06T04:28:32.274 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-06T04:28:32.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.273+0000 7fced7fff700 1 -- 172.21.15.60:0/899356324 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fcec4066f30 msgr2=0x7fcec40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:32.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.273+0000 7fced7fff700 1 --2- 172.21.15.60:0/899356324 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fcec4066f30 0x7fcec40693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009d80 tx=0x7fcec8008040 comp rx=0 tx=0).stop 2023-10-06T04:28:32.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.273+0000 7fced7fff700 1 -- 172.21.15.60:0/899356324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fced8155db0 msgr2=0x7fced8147260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:32.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.273+0000 7fced7fff700 1 --2- 172.21.15.60:0/899356324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fced8155db0 0x7fced8147260 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fced000cc70 tx=0x7fced0001a70 comp rx=0 tx=0).stop 2023-10-06T04:28:32.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.274+0000 7fced7fff700 1 -- 172.21.15.60:0/899356324 shutdown_connections 2023-10-06T04:28:32.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.274+0000 7fced7fff700 1 --2- 172.21.15.60:0/899356324 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fcec4066f30 0x7fcec40693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.274+0000 7fced7fff700 1 --2- 172.21.15.60:0/899356324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fced8155db0 0x7fced8147260 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.274+0000 7fced7fff700 1 --2- 172.21.15.60:0/899356324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced806e9f0 0x7fced8155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.274+0000 7fced7fff700 1 --2- 172.21.15.60:0/899356324 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fced80cb770 0x7fced8152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.274+0000 7fced7fff700 1 -- 172.21.15.60:0/899356324 >> 172.21.15.60:0/899356324 conn(0x7fced80cbed0 msgr2=0x7fced806a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:32.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.274+0000 7fced7fff700 1 -- 172.21.15.60:0/899356324 shutdown_connections 2023-10-06T04:28:32.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.274+0000 7fced7fff700 1 -- 172.21.15.60:0/899356324 wait complete. 2023-10-06T04:28:32.294 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:28:32.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.480+0000 7fcb9279d700 1 Processor -- start 2023-10-06T04:28:32.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.480+0000 7fcb9279d700 1 -- start start 2023-10-06T04:28:32.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.481+0000 7fcb9279d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcb8c140770 0x7fcb8c06d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:32.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.481+0000 7fcb9279d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb8c140b40 0x7fcb8c0aec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:32.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.481+0000 7fcb9279d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcb8c0af1c0 0x7fcb8c15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:32.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.481+0000 7fcb9279d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8c0c6500 con 0x7fcb8c140770 2023-10-06T04:28:32.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.481+0000 7fcb9279d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8c0c67e0 con 0x7fcb8c0af1c0 2023-10-06T04:28:32.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.481+0000 7fcb9279d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0c6ac0 con 0x7fcb8c140b40 2023-10-06T04:28:32.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.481+0000 7fcb9179b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcb8c140770 0x7fcb8c06d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:32.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.481+0000 7fcb9179b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcb8c140770 0x7fcb8c06d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52348/0 (socket says 172.21.15.60:52348) 2023-10-06T04:28:32.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.481+0000 7fcb9179b700 1 -- 172.21.15.60:0/2561269512 learned_addr learned my addr 172.21.15.60:0/2561269512 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:32.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.482+0000 7fcb91f9c700 1 --2- 172.21.15.60:0/2561269512 >> v2:172.21.15.135:3300/0 conn(0x7fcb8c0af1c0 0x7fcb8c15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.482+0000 7fcb90f9a700 1 --2- 172.21.15.60:0/2561269512 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb8c140b40 0x7fcb8c0aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.482+0000 7fcb9179b700 1 -- 172.21.15.60:0/2561269512 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb8c140b40 msgr2=0x7fcb8c0aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.482+0000 7fcb9179b700 1 --2- 172.21.15.60:0/2561269512 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb8c140b40 0x7fcb8c0aec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.482+0000 7fcb9179b700 1 -- 172.21.15.60:0/2561269512 >> v2:172.21.15.135:3300/0 conn(0x7fcb8c0af1c0 msgr2=0x7fcb8c15adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.482+0000 7fcb9179b700 1 --2- 172.21.15.60:0/2561269512 >> v2:172.21.15.135:3300/0 conn(0x7fcb8c0af1c0 0x7fcb8c15adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.482+0000 7fcb9179b700 1 -- 172.21.15.60:0/2561269512 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c0c6da0 con 0x7fcb8c140770 2023-10-06T04:28:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.482+0000 7fcb90f9a700 1 --2- 172.21.15.60:0/2561269512 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb8c140b40 0x7fcb8c0aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.482+0000 7fcb9179b700 1 --2- 172.21.15.60:0/2561269512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c140770 0x7fcb8c06d210 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0c88e0 tx=0x7fcb88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7632552dec24eac8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.482+0000 7fcb83fff700 1 -- 172.21.15.60:0/2561269512 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8800b860 con 0x7fcb8c140770 2023-10-06T04:28:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.482+0000 7fcb83fff700 1 -- 172.21.15.60:0/2561269512 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8800b9c0 con 0x7fcb8c140770 2023-10-06T04:28:32.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.482+0000 7fcb83fff700 1 -- 172.21.15.60:0/2561269512 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8800bd60 con 0x7fcb8c140770 2023-10-06T04:28:32.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.483+0000 7fcb9279d700 1 -- 172.21.15.60:0/2561269512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c140770 msgr2=0x7fcb8c06d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:32.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.483+0000 7fcb9279d700 1 --2- 172.21.15.60:0/2561269512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c140770 0x7fcb8c06d210 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0c88e0 tx=0x7fcb88009250 comp rx=0 tx=0).stop 2023-10-06T04:28:32.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.483+0000 7fcb9279d700 1 -- 172.21.15.60:0/2561269512 shutdown_connections 2023-10-06T04:28:32.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.483+0000 7fcb9279d700 1 --2- 172.21.15.60:0/2561269512 >> v2:172.21.15.135:3300/0 conn(0x7fcb8c0af1c0 0x7fcb8c15adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.483+0000 7fcb9279d700 1 --2- 172.21.15.60:0/2561269512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c140770 0x7fcb8c06d210 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.483+0000 7fcb9279d700 1 --2- 172.21.15.60:0/2561269512 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb8c140b40 0x7fcb8c0aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.483+0000 7fcb9279d700 1 -- 172.21.15.60:0/2561269512 >> 172.21.15.60:0/2561269512 conn(0x7fcb8c068080 msgr2=0x7fcb8c0cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:32.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.483+0000 7fcb9279d700 1 -- 172.21.15.60:0/2561269512 shutdown_connections 2023-10-06T04:28:32.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.483+0000 7fcb9279d700 1 -- 172.21.15.60:0/2561269512 wait complete. 2023-10-06T04:28:32.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.484+0000 7fcb9279d700 1 Processor -- start 2023-10-06T04:28:32.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.485+0000 7fcb9279d700 1 -- start start 2023-10-06T04:28:32.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.485+0000 7fcb9279d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c0af1c0 0x7fcb8c16da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:32.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.485+0000 7fcb9279d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb8c140770 0x7fcb8c1577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:32.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.485+0000 7fcb9279d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb8c0c7920 0x7fcb8c0c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:32.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.485+0000 7fcb9279d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0c8300 con 0x7fcb8c0af1c0 2023-10-06T04:28:32.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.485+0000 7fcb9279d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0c4f00 con 0x7fcb8c140770 2023-10-06T04:28:32.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.485+0000 7fcb9279d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c15a570 con 0x7fcb8c0c7920 2023-10-06T04:28:32.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.486+0000 7fcb9179b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c0af1c0 0x7fcb8c16da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:32.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.486+0000 7fcb9179b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c0af1c0 0x7fcb8c16da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52358/0 (socket says 172.21.15.60:52358) 2023-10-06T04:28:32.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.486+0000 7fcb9179b700 1 -- 172.21.15.60:0/1189358624 learned_addr learned my addr 172.21.15.60:0/1189358624 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:32.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.486+0000 7fcb9179b700 1 -- 172.21.15.60:0/1189358624 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb8c0c7920 msgr2=0x7fcb8c0c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.486+0000 7fcb9179b700 1 --2- 172.21.15.60:0/1189358624 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb8c0c7920 0x7fcb8c0c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.486+0000 7fcb9179b700 1 -- 172.21.15.60:0/1189358624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb8c140770 msgr2=0x7fcb8c1577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.486+0000 7fcb9179b700 1 --2- 172.21.15.60:0/1189358624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb8c140770 0x7fcb8c1577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.486+0000 7fcb9179b700 1 -- 172.21.15.60:0/1189358624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb880094f0 con 0x7fcb8c0af1c0 2023-10-06T04:28:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.486+0000 7fcb9179b700 1 --2- 172.21.15.60:0/1189358624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c0af1c0 0x7fcb8c16da00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c06c730 tx=0x7fcb88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.487+0000 7fcb817fa700 1 -- 172.21.15.60:0/1189358624 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb88024440 con 0x7fcb8c0af1c0 2023-10-06T04:28:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.487+0000 7fcb817fa700 1 -- 172.21.15.60:0/1189358624 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb880245a0 con 0x7fcb8c0af1c0 2023-10-06T04:28:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.487+0000 7fcb817fa700 1 -- 172.21.15.60:0/1189358624 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb88024960 con 0x7fcb8c0af1c0 2023-10-06T04:28:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.487+0000 7fcb9279d700 1 -- 172.21.15.60:0/1189358624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8c0c48b0 con 0x7fcb8c0af1c0 2023-10-06T04:28:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.487+0000 7fcb9279d700 1 -- 172.21.15.60:0/1189358624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8c0c4510 con 0x7fcb8c0af1c0 2023-10-06T04:28:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.488+0000 7fcb9279d700 1 -- 172.21.15.60:0/1189358624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8c05f230 con 0x7fcb8c0af1c0 2023-10-06T04:28:32.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.489+0000 7fcb817fa700 1 -- 172.21.15.60:0/1189358624 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb8801a420 con 0x7fcb8c0af1c0 2023-10-06T04:28:32.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.490+0000 7fcb817fa700 1 --2- 172.21.15.60:0/1189358624 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fcb70066f30 0x7fcb700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:32.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.490+0000 7fcb817fa700 1 -- 172.21.15.60:0/1189358624 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fcb88086840 con 0x7fcb8c0af1c0 2023-10-06T04:28:32.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.490+0000 7fcb90f9a700 1 --2- 172.21.15.60:0/1189358624 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fcb70066f30 0x7fcb700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:32.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.491+0000 7fcb90f9a700 1 --2- 172.21.15.60:0/1189358624 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fcb70066f30 0x7fcb700693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c006fd0 tx=0x7fcb7c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:32.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.494+0000 7fcb817fa700 1 -- 172.21.15.60:0/1189358624 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb880535c0 con 0x7fcb8c0af1c0 2023-10-06T04:28:32.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.741+0000 7fcb9279d700 1 -- 172.21.15.60:0/1189358624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb8c0c7080 con 0x7fcb8c0af1c0 2023-10-06T04:28:32.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.742+0000 7fcb817fa700 1 -- 172.21.15.60:0/1189358624 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7fcb88056be0 con 0x7fcb8c0af1c0 2023-10-06T04:28:32.745 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:32.745 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3950892589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3950892589},{"type":"v1","addr":"172.21.15.60:6837","nonce":3950892589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1381681252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1381681252},{"type":"v1","addr":"172.21.15.135:6834","nonce":1381681252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1306947344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1306947344},{"type":"v1","addr":"172.21.15.135:6835","nonce":1306947344}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:28:06.242656+0000","modified":"2023-10-06T04:28:23.340411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/1424722915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1424722915},{"type":"v1","addr":"172.21.15.60:6836","nonce":1424722915}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:28:32.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.744+0000 7fcb9279d700 1 -- 172.21.15.60:0/1189358624 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fcb70066f30 msgr2=0x7fcb700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:32.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.744+0000 7fcb9279d700 1 --2- 172.21.15.60:0/1189358624 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fcb70066f30 0x7fcb700693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c006fd0 tx=0x7fcb7c008040 comp rx=0 tx=0).stop 2023-10-06T04:28:32.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.744+0000 7fcb9279d700 1 -- 172.21.15.60:0/1189358624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c0af1c0 msgr2=0x7fcb8c16da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:32.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.744+0000 7fcb9279d700 1 --2- 172.21.15.60:0/1189358624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c0af1c0 0x7fcb8c16da00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c06c730 tx=0x7fcb88017000 comp rx=0 tx=0).stop 2023-10-06T04:28:32.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.744+0000 7fcb9279d700 1 -- 172.21.15.60:0/1189358624 shutdown_connections 2023-10-06T04:28:32.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.744+0000 7fcb9279d700 1 --2- 172.21.15.60:0/1189358624 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fcb70066f30 0x7fcb700693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.744+0000 7fcb9279d700 1 --2- 172.21.15.60:0/1189358624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c0af1c0 0x7fcb8c16da00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.744+0000 7fcb9279d700 1 --2- 172.21.15.60:0/1189358624 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb8c0c7920 0x7fcb8c0c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.744+0000 7fcb9279d700 1 --2- 172.21.15.60:0/1189358624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb8c140770 0x7fcb8c1577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.744+0000 7fcb9279d700 1 -- 172.21.15.60:0/1189358624 >> 172.21.15.60:0/1189358624 conn(0x7fcb8c068080 msgr2=0x7fcb8c13d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:32.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.744+0000 7fcb9279d700 1 -- 172.21.15.60:0/1189358624 shutdown_connections 2023-10-06T04:28:32.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.744+0000 7fcb9279d700 1 -- 172.21.15.60:0/1189358624 wait complete. 2023-10-06T04:28:32.749 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 9 2023-10-06T04:28:32.765 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:28:32.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.951+0000 7f6879d9d700 1 Processor -- start 2023-10-06T04:28:32.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.951+0000 7f6879d9d700 1 -- start start 2023-10-06T04:28:32.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.953+0000 7f6879d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6874153e00 0x7f687406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:32.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.953+0000 7f6879d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f687406a960 0x7f687406e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:32.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.953+0000 7f6879d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68740c9cc0 con 0x7f687406a590 2023-10-06T04:28:32.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.953+0000 7f6879d9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f687406f560 con 0x7f687406a960 2023-10-06T04:28:32.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.953+0000 7f6879d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68740c6710 con 0x7f6874153e00 2023-10-06T04:28:32.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.953+0000 7f687959c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f687406a960 0x7f687406e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:32.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.953+0000 7f687959c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f687406a960 0x7f687406e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38322/0 (socket says 172.21.15.60:38322) 2023-10-06T04:28:32.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.953+0000 7f687959c700 1 -- 172.21.15.60:0/2882609293 learned_addr learned my addr 172.21.15.60:0/2882609293 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:32.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.953+0000 7f6878d9b700 1 --1- 172.21.15.60:0/2882609293 >> v1:172.21.15.135:6789/0 conn(0x7f687406a590 0x7f68741536f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.60:59290/0 (socket says 172.21.15.60:59290) 2023-10-06T04:28:32.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.953+0000 7f6873fff700 1 --2- 172.21.15.60:0/2882609293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6874153e00 0x7f687406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:32.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.953+0000 7f68737fe700 1 -- 172.21.15.60:0/2882609293 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220137893 0 0) 0x7f68740c9cc0 con 0x7f687406a590 2023-10-06T04:28:32.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.953+0000 7f68737fe700 1 -- 172.21.15.60:0/2882609293 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6864003570 con 0x7f687406a590 2023-10-06T04:28:32.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.953+0000 7f687959c700 1 -- 172.21.15.60:0/2882609293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6874153e00 msgr2=0x7f687406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:32.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.954+0000 7f687959c700 1 --2- 172.21.15.60:0/2882609293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6874153e00 0x7f687406df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.954+0000 7f687959c700 1 -- 172.21.15.60:0/2882609293 >> v1:172.21.15.135:6789/0 conn(0x7f687406a590 legacy=0x7f68741536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:32.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.954+0000 7f687959c700 1 -- 172.21.15.60:0/2882609293 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687406ecc0 con 0x7f687406a960 2023-10-06T04:28:32.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.954+0000 7f687959c700 1 --2- 172.21.15.60:0/2882609293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f687406a960 0x7f687406e490 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f686c00d1d0 tx=0x7f686c00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729d9fd04a59a195 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:32.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.954+0000 7f68737fe700 1 -- 172.21.15.60:0/2882609293 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c010070 con 0x7f687406a960 2023-10-06T04:28:32.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.954+0000 7f68737fe700 1 -- 172.21.15.60:0/2882609293 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686c00dd50 con 0x7f687406a960 2023-10-06T04:28:32.958 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.954+0000 7f68737fe700 1 -- 172.21.15.60:0/2882609293 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c00b2e0 con 0x7f687406a960 2023-10-06T04:28:32.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.955+0000 7f6879d9d700 1 -- 172.21.15.60:0/2882609293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f687406a960 msgr2=0x7f687406e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:32.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.955+0000 7f6879d9d700 1 --2- 172.21.15.60:0/2882609293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f687406a960 0x7f687406e490 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f686c00d1d0 tx=0x7f686c00ba50 comp rx=0 tx=0).stop 2023-10-06T04:28:32.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.955+0000 7f6879d9d700 1 -- 172.21.15.60:0/2882609293 shutdown_connections 2023-10-06T04:28:32.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.955+0000 7f6879d9d700 1 --2- 172.21.15.60:0/2882609293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f687406a960 0x7f687406e490 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.955+0000 7f6879d9d700 1 --2- 172.21.15.60:0/2882609293 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6874153e00 0x7f687406df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.955+0000 7f6879d9d700 1 -- 172.21.15.60:0/2882609293 >> 172.21.15.60:0/2882609293 conn(0x7f6874068080 msgr2=0x7f68740cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:32.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.955+0000 7f6879d9d700 1 -- 172.21.15.60:0/2882609293 shutdown_connections 2023-10-06T04:28:32.959 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.955+0000 7f6879d9d700 1 -- 172.21.15.60:0/2882609293 wait complete. 2023-10-06T04:28:32.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.956+0000 7f6879d9d700 1 Processor -- start 2023-10-06T04:28:32.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.956+0000 7f6879d9d700 1 -- start start 2023-10-06T04:28:32.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.957+0000 7f6879d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f687406a590 0x7f6874169570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:32.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.957+0000 7f6879d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f687406a960 0x7f68740cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:32.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.957+0000 7f6879d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6874153e00 0x7f68740b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:32.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.957+0000 7f6879d9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68740cc030 con 0x7f6874153e00 2023-10-06T04:28:32.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.957+0000 7f6879d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687416cd00 con 0x7f687406a590 2023-10-06T04:28:32.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.957+0000 7f6879d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6874169c00 con 0x7f687406a960 2023-10-06T04:28:32.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.958+0000 7f687959c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6874153e00 0x7f68740b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:32.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.958+0000 7f687959c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6874153e00 0x7f68740b1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38328/0 (socket says 172.21.15.60:38328) 2023-10-06T04:28:32.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.958+0000 7f687959c700 1 -- 172.21.15.60:0/45499670 learned_addr learned my addr 172.21.15.60:0/45499670 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:32.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.958+0000 7f6878d9b700 1 --2- 172.21.15.60:0/45499670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f687406a590 0x7f6874169570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:32.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.958+0000 7f6873fff700 1 --2- 172.21.15.60:0/45499670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f687406a960 0x7f68740cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:32.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.958+0000 7f687959c700 1 -- 172.21.15.60:0/45499670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f687406a960 msgr2=0x7f68740cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:32.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.958+0000 7f687959c700 1 --2- 172.21.15.60:0/45499670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f687406a960 0x7f68740cbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.958+0000 7f687959c700 1 -- 172.21.15.60:0/45499670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f687406a590 msgr2=0x7f6874169570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:32.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.958+0000 7f687959c700 1 --2- 172.21.15.60:0/45499670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f687406a590 0x7f6874169570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:32.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.958+0000 7f687959c700 1 -- 172.21.15.60:0/45499670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c00bcf0 con 0x7f6874153e00 2023-10-06T04:28:32.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.958+0000 7f6873fff700 1 --2- 172.21.15.60:0/45499670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f687406a960 0x7f68740cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:32.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.958+0000 7f687959c700 1 --2- 172.21.15.60:0/45499670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6874153e00 0x7f68740b1330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f686c00ba90 tx=0x7f686c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:32.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.959+0000 7f6870ff9700 1 -- 172.21.15.60:0/45499670 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c00aa60 con 0x7f6874153e00 2023-10-06T04:28:32.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.959+0000 7f6870ff9700 1 -- 172.21.15.60:0/45499670 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686c00ac00 con 0x7f6874153e00 2023-10-06T04:28:32.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.959+0000 7f6879d9d700 1 -- 172.21.15.60:0/45499670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6874169ee0 con 0x7f6874153e00 2023-10-06T04:28:32.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.959+0000 7f6870ff9700 1 -- 172.21.15.60:0/45499670 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c01e440 con 0x7f6874153e00 2023-10-06T04:28:32.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.959+0000 7f6879d9d700 1 -- 172.21.15.60:0/45499670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687416a4a0 con 0x7f6874153e00 2023-10-06T04:28:32.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.960+0000 7f6879d9d700 1 -- 172.21.15.60:0/45499670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f687416ce90 con 0x7f6874153e00 2023-10-06T04:28:32.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.961+0000 7f6870ff9700 1 -- 172.21.15.60:0/45499670 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f686c003040 con 0x7f6874153e00 2023-10-06T04:28:32.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.961+0000 7f6870ff9700 1 --2- 172.21.15.60:0/45499670 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6858066fb0 0x7f6858069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:32.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.962+0000 7f6870ff9700 1 -- 172.21.15.60:0/45499670 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f686c0865b0 con 0x7f6874153e00 2023-10-06T04:28:32.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.962+0000 7f6878d9b700 1 --2- 172.21.15.60:0/45499670 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6858066fb0 0x7f6858069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:32.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.962+0000 7f6878d9b700 1 --2- 172.21.15.60:0/45499670 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6858066fb0 0x7f6858069460 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6868004fb0 tx=0x7f6868000bc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:32.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:32.966+0000 7f6870ff9700 1 -- 172.21.15.60:0/45499670 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f686c053330 con 0x7f6874153e00 2023-10-06T04:28:33.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.171+0000 7f6879d9d700 1 -- 172.21.15.60:0/45499670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f687405f230 con 0x7f6874153e00 2023-10-06T04:28:33.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.172+0000 7f6870ff9700 1 -- 172.21.15.60:0/45499670 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f686c056950 con 0x7f6874153e00 2023-10-06T04:28:33.175 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:33.175 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:28:11.290557+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:28:04.355358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:28:05.208550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:28:08.791979+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:28:33.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.175+0000 7f6879d9d700 1 -- 172.21.15.60:0/45499670 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6858066fb0 msgr2=0x7f6858069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:33.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.175+0000 7f6879d9d700 1 --2- 172.21.15.60:0/45499670 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6858066fb0 0x7f6858069460 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6868004fb0 tx=0x7f6868000bc0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.175+0000 7f6879d9d700 1 -- 172.21.15.60:0/45499670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6874153e00 msgr2=0x7f68740b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:33.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.175+0000 7f6879d9d700 1 --2- 172.21.15.60:0/45499670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6874153e00 0x7f68740b1330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f686c00ba90 tx=0x7f686c01a000 comp rx=0 tx=0).stop 2023-10-06T04:28:33.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.175+0000 7f6879d9d700 1 -- 172.21.15.60:0/45499670 shutdown_connections 2023-10-06T04:28:33.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.175+0000 7f6879d9d700 1 --2- 172.21.15.60:0/45499670 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6858066fb0 0x7f6858069460 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.175+0000 7f6879d9d700 1 --2- 172.21.15.60:0/45499670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6874153e00 0x7f68740b1330 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.175+0000 7f6879d9d700 1 --2- 172.21.15.60:0/45499670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f687406a590 0x7f6874169570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.175+0000 7f6879d9d700 1 --2- 172.21.15.60:0/45499670 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f687406a960 0x7f68740cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.175+0000 7f6879d9d700 1 -- 172.21.15.60:0/45499670 >> 172.21.15.60:0/45499670 conn(0x7f6874068080 msgr2=0x7f6874155b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:33.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.175+0000 7f6879d9d700 1 -- 172.21.15.60:0/45499670 shutdown_connections 2023-10-06T04:28:33.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.175+0000 7f6879d9d700 1 -- 172.21.15.60:0/45499670 wait complete. 2023-10-06T04:28:33.196 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:27:58.899938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:27:59.373527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:28:04.355358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:28:05.208550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:28:08.791979+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:28:33.196 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:28:33.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.385+0000 7ff06f39d700 1 Processor -- start 2023-10-06T04:28:33.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.385+0000 7ff06f39d700 1 -- start start 2023-10-06T04:28:33.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.387+0000 7ff06f39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0680b2620 0x7ff0680cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:33.390 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.387+0000 7ff06f39d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff0680b29f0 0x7ff0680cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:33.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.387+0000 7ff06f39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff0680ceaa0 0x7ff0680cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:33.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.387+0000 7ff06f39d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0680cc970 con 0x7ff0680b29f0 2023-10-06T04:28:33.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.387+0000 7ff06f39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0680cf480 con 0x7ff0680ceaa0 2023-10-06T04:28:33.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.387+0000 7ff06f39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0680cbd60 con 0x7ff0680b2620 2023-10-06T04:28:33.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.387+0000 7ff06db9a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff0680b29f0 0x7ff0680cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:33.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.387+0000 7ff06db9a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff0680b29f0 0x7ff0680cd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38332/0 (socket says 172.21.15.60:38332) 2023-10-06T04:28:33.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.387+0000 7ff06db9a700 1 -- 172.21.15.60:0/1905186426 learned_addr learned my addr 172.21.15.60:0/1905186426 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:33.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.387+0000 7ff06eb9c700 1 --2- 172.21.15.60:0/1905186426 >> v2:172.21.15.135:3300/0 conn(0x7ff0680ceaa0 0x7ff0680cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:33.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.387+0000 7ff06e39b700 1 --2- 172.21.15.60:0/1905186426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0680b2620 0x7ff0680cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:33.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.387+0000 7ff06db9a700 1 -- 172.21.15.60:0/1905186426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0680b2620 msgr2=0x7ff0680cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:33.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.387+0000 7ff06db9a700 1 --2- 172.21.15.60:0/1905186426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0680b2620 0x7ff0680cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.387+0000 7ff06db9a700 1 -- 172.21.15.60:0/1905186426 >> v2:172.21.15.135:3300/0 conn(0x7ff0680ceaa0 msgr2=0x7ff0680cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:33.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.387+0000 7ff06db9a700 1 --2- 172.21.15.60:0/1905186426 >> v2:172.21.15.135:3300/0 conn(0x7ff0680ceaa0 0x7ff0680cef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.387+0000 7ff06db9a700 1 -- 172.21.15.60:0/1905186426 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0680cc040 con 0x7ff0680b29f0 2023-10-06T04:28:33.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.387+0000 7ff06eb9c700 1 --2- 172.21.15.60:0/1905186426 >> v2:172.21.15.135:3300/0 conn(0x7ff0680ceaa0 0x7ff0680cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:33.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.387+0000 7ff06e39b700 1 --2- 172.21.15.60:0/1905186426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0680b2620 0x7ff0680cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:33.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.388+0000 7ff06db9a700 1 --2- 172.21.15.60:0/1905186426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0680b29f0 0x7ff0680cd1f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff068089650 tx=0x7ff058009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4942c8f1da22fc0d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:33.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.388+0000 7ff06d399700 1 -- 172.21.15.60:0/1905186426 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05800b860 con 0x7ff0680b29f0 2023-10-06T04:28:33.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.388+0000 7ff06d399700 1 -- 172.21.15.60:0/1905186426 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05800b9c0 con 0x7ff0680b29f0 2023-10-06T04:28:33.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.388+0000 7ff06d399700 1 -- 172.21.15.60:0/1905186426 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05800bd60 con 0x7ff0680b29f0 2023-10-06T04:28:33.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.388+0000 7ff06f39d700 1 -- 172.21.15.60:0/1905186426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0680b29f0 msgr2=0x7ff0680cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:33.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.388+0000 7ff06f39d700 1 --2- 172.21.15.60:0/1905186426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0680b29f0 0x7ff0680cd1f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff068089650 tx=0x7ff058009250 comp rx=0 tx=0).stop 2023-10-06T04:28:33.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.389+0000 7ff06f39d700 1 -- 172.21.15.60:0/1905186426 shutdown_connections 2023-10-06T04:28:33.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.389+0000 7ff06f39d700 1 --2- 172.21.15.60:0/1905186426 >> v2:172.21.15.135:3300/0 conn(0x7ff0680ceaa0 0x7ff0680cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.389+0000 7ff06f39d700 1 --2- 172.21.15.60:0/1905186426 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0680b2620 0x7ff0680cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.389+0000 7ff06f39d700 1 --2- 172.21.15.60:0/1905186426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0680b29f0 0x7ff0680cd1f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.389+0000 7ff06f39d700 1 -- 172.21.15.60:0/1905186426 >> 172.21.15.60:0/1905186426 conn(0x7ff068099520 msgr2=0x7ff06806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:33.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.389+0000 7ff06f39d700 1 -- 172.21.15.60:0/1905186426 shutdown_connections 2023-10-06T04:28:33.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.389+0000 7ff06f39d700 1 -- 172.21.15.60:0/1905186426 wait complete. 2023-10-06T04:28:33.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.390+0000 7ff06f39d700 1 Processor -- start 2023-10-06T04:28:33.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.390+0000 7ff06f39d700 1 -- start start 2023-10-06T04:28:33.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.391+0000 7ff06f39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0680b2620 0x7ff0680ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:33.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.391+0000 7ff06f39d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0680b29f0 0x7ff0680b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:33.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.391+0000 7ff06f39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0680ceaa0 0x7ff06814ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:33.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.391+0000 7ff06f39d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0680b54a0 con 0x7ff0680b29f0 2023-10-06T04:28:33.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.391+0000 7ff06f39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0680b5930 con 0x7ff0680b2620 2023-10-06T04:28:33.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.391+0000 7ff06f39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0680b4890 con 0x7ff0680ceaa0 2023-10-06T04:28:33.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.391+0000 7ff06db9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0680b29f0 0x7ff0680b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:33.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.391+0000 7ff06db9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0680b29f0 0x7ff0680b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38346/0 (socket says 172.21.15.60:38346) 2023-10-06T04:28:33.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.392+0000 7ff06db9a700 1 -- 172.21.15.60:0/4174011584 learned_addr learned my addr 172.21.15.60:0/4174011584 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:33.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.392+0000 7ff06e39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0680b2620 0x7ff0680ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:33.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.392+0000 7ff06eb9c700 1 --2- 172.21.15.60:0/4174011584 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0680ceaa0 0x7ff06814ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:33.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.392+0000 7ff06db9a700 1 -- 172.21.15.60:0/4174011584 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0680ceaa0 msgr2=0x7ff06814ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:33.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.392+0000 7ff06db9a700 1 --2- 172.21.15.60:0/4174011584 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0680ceaa0 0x7ff06814ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.392+0000 7ff06db9a700 1 -- 172.21.15.60:0/4174011584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0680b2620 msgr2=0x7ff0680ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:33.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.392+0000 7ff06db9a700 1 --2- 172.21.15.60:0/4174011584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0680b2620 0x7ff0680ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.392+0000 7ff06db9a700 1 -- 172.21.15.60:0/4174011584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0580094f0 con 0x7ff0680b29f0 2023-10-06T04:28:33.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.392+0000 7ff06db9a700 1 --2- 172.21.15.60:0/4174011584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0680b29f0 0x7ff0680b4060 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff06806fcc0 tx=0x7ff058017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:33.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.393+0000 7ff05e7fc700 1 -- 172.21.15.60:0/4174011584 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058011dc0 con 0x7ff0680b29f0 2023-10-06T04:28:33.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.393+0000 7ff05e7fc700 1 -- 172.21.15.60:0/4174011584 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff058024440 con 0x7ff0680b29f0 2023-10-06T04:28:33.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.393+0000 7ff06f39d700 1 -- 172.21.15.60:0/4174011584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0680b4b70 con 0x7ff0680b29f0 2023-10-06T04:28:33.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.393+0000 7ff05e7fc700 1 -- 172.21.15.60:0/4174011584 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058024800 con 0x7ff0680b29f0 2023-10-06T04:28:33.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.393+0000 7ff06f39d700 1 -- 172.21.15.60:0/4174011584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0680b5130 con 0x7ff0680b29f0 2023-10-06T04:28:33.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.394+0000 7ff06f39d700 1 -- 172.21.15.60:0/4174011584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0680b5610 con 0x7ff0680b29f0 2023-10-06T04:28:33.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.395+0000 7ff05e7fc700 1 -- 172.21.15.60:0/4174011584 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff05801a420 con 0x7ff0680b29f0 2023-10-06T04:28:33.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.395+0000 7ff05e7fc700 1 --2- 172.21.15.60:0/4174011584 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff04c066f30 0x7ff04c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:33.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.396+0000 7ff05e7fc700 1 -- 172.21.15.60:0/4174011584 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff0580868d0 con 0x7ff0680b29f0 2023-10-06T04:28:33.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.396+0000 7ff06e39b700 1 --2- 172.21.15.60:0/4174011584 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff04c066f30 0x7ff04c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:33.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.396+0000 7ff06e39b700 1 --2- 172.21.15.60:0/4174011584 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff04c066f30 0x7ff04c0693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff06400aca0 tx=0x7ff064008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:33.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.400+0000 7ff05e7fc700 1 -- 172.21.15.60:0/4174011584 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff058053650 con 0x7ff0680b29f0 2023-10-06T04:28:33.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.602+0000 7ff06f39d700 1 -- 172.21.15.60:0/4174011584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff06805f230 con 0x7ff0680b29f0 2023-10-06T04:28:33.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.602+0000 7ff05e7fc700 1 -- 172.21.15.60:0/4174011584 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff058056c70 con 0x7ff0680b29f0 2023-10-06T04:28:33.605 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-10-06T04:28:33.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.604+0000 7ff06f39d700 1 -- 172.21.15.60:0/4174011584 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff04c066f30 msgr2=0x7ff04c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:33.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.604+0000 7ff06f39d700 1 --2- 172.21.15.60:0/4174011584 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff04c066f30 0x7ff04c0693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff06400aca0 tx=0x7ff064008040 comp rx=0 tx=0).stop 2023-10-06T04:28:33.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.604+0000 7ff06f39d700 1 -- 172.21.15.60:0/4174011584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0680b29f0 msgr2=0x7ff0680b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:33.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.604+0000 7ff06f39d700 1 --2- 172.21.15.60:0/4174011584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0680b29f0 0x7ff0680b4060 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff06806fcc0 tx=0x7ff058017000 comp rx=0 tx=0).stop 2023-10-06T04:28:33.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.605+0000 7ff06f39d700 1 -- 172.21.15.60:0/4174011584 shutdown_connections 2023-10-06T04:28:33.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.605+0000 7ff06f39d700 1 --2- 172.21.15.60:0/4174011584 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff04c066f30 0x7ff04c0693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.605+0000 7ff06f39d700 1 --2- 172.21.15.60:0/4174011584 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0680ceaa0 0x7ff06814ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.605+0000 7ff06f39d700 1 --2- 172.21.15.60:0/4174011584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0680b2620 0x7ff0680ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.605+0000 7ff06f39d700 1 --2- 172.21.15.60:0/4174011584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0680b29f0 0x7ff0680b4060 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.605+0000 7ff06f39d700 1 -- 172.21.15.60:0/4174011584 >> 172.21.15.60:0/4174011584 conn(0x7ff068099520 msgr2=0x7ff0680c5350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:33.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.605+0000 7ff06f39d700 1 -- 172.21.15.60:0/4174011584 shutdown_connections 2023-10-06T04:28:33.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.605+0000 7ff06f39d700 1 -- 172.21.15.60:0/4174011584 wait complete. 2023-10-06T04:28:33.625 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:28:33.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.814+0000 7fba8dd9d700 1 Processor -- start 2023-10-06T04:28:33.816 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.814+0000 7fba8dd9d700 1 -- start start 2023-10-06T04:28:33.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.815+0000 7fba8dd9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fba8813c430 0x7fba880ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:33.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.815+0000 7fba8dd9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fba8815a250 0x7fba880c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:33.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.815+0000 7fba8dd9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba880ca5b0 con 0x7fba880cae90 2023-10-06T04:28:33.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.815+0000 7fba8dd9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba880cb330 con 0x7fba8815a250 2023-10-06T04:28:33.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.815+0000 7fba8dd9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8815a8e0 con 0x7fba8813c430 2023-10-06T04:28:33.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.815+0000 7fba87fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fba880cae90 0x7fba88159b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44026/0 (socket says 172.21.15.60:44026) 2023-10-06T04:28:33.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.815+0000 7fba87fff700 1 -- 172.21.15.60:0/695330322 learned_addr learned my addr 172.21.15.60:0/695330322 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:33.818 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.815+0000 7fba8d59c700 1 --2- 172.21.15.60:0/695330322 >> v2:172.21.15.60:3300/0 conn(0x7fba8815a250 0x7fba880c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:33.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.816+0000 7fba8cd9b700 1 --2- 172.21.15.60:0/695330322 >> v2:172.21.15.135:3300/0 conn(0x7fba8813c430 0x7fba880ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:33.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.816+0000 7fba877fe700 1 -- 172.21.15.60:0/695330322 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390048238 0 0) 0x7fba880ca5b0 con 0x7fba880cae90 2023-10-06T04:28:33.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.816+0000 7fba877fe700 1 -- 172.21.15.60:0/695330322 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba78003570 con 0x7fba880cae90 2023-10-06T04:28:33.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.816+0000 7fba8d59c700 1 -- 172.21.15.60:0/695330322 >> v2:172.21.15.135:3300/0 conn(0x7fba8813c430 msgr2=0x7fba880ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:33.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.816+0000 7fba8d59c700 1 --2- 172.21.15.60:0/695330322 >> v2:172.21.15.135:3300/0 conn(0x7fba8813c430 0x7fba880ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.816+0000 7fba8d59c700 1 -- 172.21.15.60:0/695330322 >> v1:172.21.15.60:6789/0 conn(0x7fba880cae90 legacy=0x7fba88159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:33.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.816+0000 7fba8d59c700 1 -- 172.21.15.60:0/695330322 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8806d500 con 0x7fba8815a250 2023-10-06T04:28:33.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.816+0000 7fba8d59c700 1 --2- 172.21.15.60:0/695330322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba8815a250 0x7fba880c86f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fba80009e60 tx=0x7fba80009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed999845475518cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:33.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.816+0000 7fba877fe700 1 -- 172.21.15.60:0/695330322 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8000e070 con 0x7fba8815a250 2023-10-06T04:28:33.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.816+0000 7fba877fe700 1 -- 172.21.15.60:0/695330322 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8000bb20 con 0x7fba8815a250 2023-10-06T04:28:33.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.816+0000 7fba877fe700 1 -- 172.21.15.60:0/695330322 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80012430 con 0x7fba8815a250 2023-10-06T04:28:33.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.817+0000 7fba8dd9d700 1 -- 172.21.15.60:0/695330322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba8815a250 msgr2=0x7fba880c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:33.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.817+0000 7fba8dd9d700 1 --2- 172.21.15.60:0/695330322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba8815a250 0x7fba880c86f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fba80009e60 tx=0x7fba80009780 comp rx=0 tx=0).stop 2023-10-06T04:28:33.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.817+0000 7fba8dd9d700 1 -- 172.21.15.60:0/695330322 shutdown_connections 2023-10-06T04:28:33.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.817+0000 7fba8dd9d700 1 --2- 172.21.15.60:0/695330322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba8815a250 0x7fba880c86f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.817+0000 7fba8dd9d700 1 --2- 172.21.15.60:0/695330322 >> v2:172.21.15.135:3300/0 conn(0x7fba8813c430 0x7fba880ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.817+0000 7fba8dd9d700 1 -- 172.21.15.60:0/695330322 >> 172.21.15.60:0/695330322 conn(0x7fba8806b330 msgr2=0x7fba8806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:33.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.817+0000 7fba8dd9d700 1 -- 172.21.15.60:0/695330322 shutdown_connections 2023-10-06T04:28:33.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.817+0000 7fba8dd9d700 1 -- 172.21.15.60:0/695330322 wait complete. 2023-10-06T04:28:33.823 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.819+0000 7fba8dd9d700 1 Processor -- start 2023-10-06T04:28:33.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.819+0000 7fba8dd9d700 1 -- start start 2023-10-06T04:28:33.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.820+0000 7fba8dd9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba880cae90 0x7fba8815da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:33.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.820+0000 7fba8dd9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba8813c430 0x7fba8815b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:33.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.820+0000 7fba8dd9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba8815a250 0x7fba88154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:33.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.820+0000 7fba8dd9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8815c890 con 0x7fba8815a250 2023-10-06T04:28:33.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.820+0000 7fba8dd9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba88169010 con 0x7fba8813c430 2023-10-06T04:28:33.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.820+0000 7fba8dd9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8815ba70 con 0x7fba880cae90 2023-10-06T04:28:33.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.820+0000 7fba8d59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba8815a250 0x7fba88154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:33.824 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.820+0000 7fba8d59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba8815a250 0x7fba88154560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38368/0 (socket says 172.21.15.60:38368) 2023-10-06T04:28:33.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.820+0000 7fba8d59c700 1 -- 172.21.15.60:0/2595791456 learned_addr learned my addr 172.21.15.60:0/2595791456 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:33.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.820+0000 7fba8cd9b700 1 --2- 172.21.15.60:0/2595791456 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba880cae90 0x7fba8815da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:33.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.820+0000 7fba8d59c700 1 -- 172.21.15.60:0/2595791456 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba880cae90 msgr2=0x7fba8815da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:33.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.820+0000 7fba87fff700 1 --2- 172.21.15.60:0/2595791456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba8813c430 0x7fba8815b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:33.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.820+0000 7fba8d59c700 1 --2- 172.21.15.60:0/2595791456 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba880cae90 0x7fba8815da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.820+0000 7fba8d59c700 1 -- 172.21.15.60:0/2595791456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba8813c430 msgr2=0x7fba8815b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:33.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.820+0000 7fba8d59c700 1 --2- 172.21.15.60:0/2595791456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba8813c430 0x7fba8815b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:33.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.820+0000 7fba8d59c700 1 -- 172.21.15.60:0/2595791456 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba80009a20 con 0x7fba8815a250 2023-10-06T04:28:33.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.820+0000 7fba8cd9b700 1 --2- 172.21.15.60:0/2595791456 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba880cae90 0x7fba8815da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:33.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.820+0000 7fba87fff700 1 --2- 172.21.15.60:0/2595791456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba8813c430 0x7fba8815b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:33.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.820+0000 7fba8d59c700 1 --2- 172.21.15.60:0/2595791456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba8815a250 0x7fba88154560 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fba880712e0 tx=0x7fba80019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:33.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.821+0000 7fba84ff9700 1 -- 172.21.15.60:0/2595791456 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80012e40 con 0x7fba8815a250 2023-10-06T04:28:33.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.821+0000 7fba84ff9700 1 -- 172.21.15.60:0/2595791456 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8001d630 con 0x7fba8815a250 2023-10-06T04:28:33.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.821+0000 7fba8dd9d700 1 -- 172.21.15.60:0/2595791456 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8815bd10 con 0x7fba8815a250 2023-10-06T04:28:33.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.821+0000 7fba84ff9700 1 -- 172.21.15.60:0/2595791456 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8001d9f0 con 0x7fba8815a250 2023-10-06T04:28:33.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.821+0000 7fba8dd9d700 1 -- 172.21.15.60:0/2595791456 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8815c2d0 con 0x7fba8815a250 2023-10-06T04:28:33.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.822+0000 7fba8dd9d700 1 -- 172.21.15.60:0/2595791456 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8805f230 con 0x7fba8815a250 2023-10-06T04:28:33.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.823+0000 7fba84ff9700 1 -- 172.21.15.60:0/2595791456 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba80024070 con 0x7fba8815a250 2023-10-06T04:28:33.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.824+0000 7fba84ff9700 1 --2- 172.21.15.60:0/2595791456 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fba6c066f30 0x7fba6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:33.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.824+0000 7fba84ff9700 1 -- 172.21.15.60:0/2595791456 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fba80087170 con 0x7fba8815a250 2023-10-06T04:28:33.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.824+0000 7fba8cd9b700 1 --2- 172.21.15.60:0/2595791456 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fba6c066f30 0x7fba6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:33.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.825+0000 7fba8cd9b700 1 --2- 172.21.15.60:0/2595791456 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fba6c066f30 0x7fba6c0693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fba7c006fd0 tx=0x7fba7c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:33.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:33.828+0000 7fba84ff9700 1 -- 172.21.15.60:0/2595791456 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba80053ef0 con 0x7fba8815a250 2023-10-06T04:28:34.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.030+0000 7fba8dd9d700 1 -- 172.21.15.60:0/2595791456 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fba880cd340 con 0x7fba8815a250 2023-10-06T04:28:34.033 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.031+0000 7fba84ff9700 1 -- 172.21.15.60:0/2595791456 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fba80057510 con 0x7fba8815a250 2023-10-06T04:28:34.033 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-06T04:28:34.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.033+0000 7fba8dd9d700 1 -- 172.21.15.60:0/2595791456 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fba6c066f30 msgr2=0x7fba6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:34.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.033+0000 7fba8dd9d700 1 --2- 172.21.15.60:0/2595791456 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fba6c066f30 0x7fba6c0693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fba7c006fd0 tx=0x7fba7c008040 comp rx=0 tx=0).stop 2023-10-06T04:28:34.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.033+0000 7fba8dd9d700 1 -- 172.21.15.60:0/2595791456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba8815a250 msgr2=0x7fba88154560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:34.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.033+0000 7fba8dd9d700 1 --2- 172.21.15.60:0/2595791456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba8815a250 0x7fba88154560 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fba880712e0 tx=0x7fba80019000 comp rx=0 tx=0).stop 2023-10-06T04:28:34.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.033+0000 7fba8dd9d700 1 -- 172.21.15.60:0/2595791456 shutdown_connections 2023-10-06T04:28:34.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.033+0000 7fba8dd9d700 1 --2- 172.21.15.60:0/2595791456 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fba6c066f30 0x7fba6c0693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.033+0000 7fba8dd9d700 1 --2- 172.21.15.60:0/2595791456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba8815a250 0x7fba88154560 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.033+0000 7fba8dd9d700 1 --2- 172.21.15.60:0/2595791456 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba880cae90 0x7fba8815da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.033+0000 7fba8dd9d700 1 --2- 172.21.15.60:0/2595791456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba8813c430 0x7fba8815b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.033+0000 7fba8dd9d700 1 -- 172.21.15.60:0/2595791456 >> 172.21.15.60:0/2595791456 conn(0x7fba8806b330 msgr2=0x7fba8806d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:34.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.033+0000 7fba8dd9d700 1 -- 172.21.15.60:0/2595791456 shutdown_connections 2023-10-06T04:28:34.036 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.033+0000 7fba8dd9d700 1 -- 172.21.15.60:0/2595791456 wait complete. 2023-10-06T04:28:34.053 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:28:34.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.240+0000 7fc396d9d700 1 Processor -- start 2023-10-06T04:28:34.242 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.240+0000 7fc396d9d700 1 -- start start 2023-10-06T04:28:34.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.241+0000 7fc396d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc39013c430 0x7fc3900ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:34.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.241+0000 7fc396d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3900cae90 0x7fc390159b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:34.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.241+0000 7fc396d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc39015a080 0x7fc39015cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:34.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.241+0000 7fc396d9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3900cb330 con 0x7fc39013c430 2023-10-06T04:28:34.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.241+0000 7fc396d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3900ca5b0 con 0x7fc39015a080 2023-10-06T04:28:34.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.241+0000 7fc396d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39015a8e0 con 0x7fc3900cae90 2023-10-06T04:28:34.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.242+0000 7fc395d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc39013c430 0x7fc3900ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:34.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.242+0000 7fc395d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc39013c430 0x7fc3900ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38380/0 (socket says 172.21.15.60:38380) 2023-10-06T04:28:34.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.242+0000 7fc395d9b700 1 -- 172.21.15.60:0/1170184140 learned_addr learned my addr 172.21.15.60:0/1170184140 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:34.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.242+0000 7fc39559a700 1 --2- 172.21.15.60:0/1170184140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3900cae90 0x7fc390159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:34.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.242+0000 7fc39659c700 1 --2- 172.21.15.60:0/1170184140 >> v2:172.21.15.135:3300/0 conn(0x7fc39015a080 0x7fc39015cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:34.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.242+0000 7fc395d9b700 1 -- 172.21.15.60:0/1170184140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3900cae90 msgr2=0x7fc390159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:34.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.242+0000 7fc395d9b700 1 --2- 172.21.15.60:0/1170184140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3900cae90 0x7fc390159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.242+0000 7fc395d9b700 1 -- 172.21.15.60:0/1170184140 >> v2:172.21.15.135:3300/0 conn(0x7fc39015a080 msgr2=0x7fc39015cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:34.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.242+0000 7fc395d9b700 1 --2- 172.21.15.60:0/1170184140 >> v2:172.21.15.135:3300/0 conn(0x7fc39015a080 0x7fc39015cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.242+0000 7fc395d9b700 1 -- 172.21.15.60:0/1170184140 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39006d500 con 0x7fc39013c430 2023-10-06T04:28:34.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.242+0000 7fc395d9b700 1 --2- 172.21.15.60:0/1170184140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc39013c430 0x7fc3900ca950 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc3900b0bd0 tx=0x7fc38c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706ebdaa2b128cb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:34.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.243+0000 7fc394d99700 1 -- 172.21.15.60:0/1170184140 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c00b640 con 0x7fc39013c430 2023-10-06T04:28:34.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.243+0000 7fc394d99700 1 -- 172.21.15.60:0/1170184140 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c00b7a0 con 0x7fc39013c430 2023-10-06T04:28:34.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.243+0000 7fc394d99700 1 -- 172.21.15.60:0/1170184140 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c00bb60 con 0x7fc39013c430 2023-10-06T04:28:34.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.243+0000 7fc396d9d700 1 -- 172.21.15.60:0/1170184140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc39013c430 msgr2=0x7fc3900ca950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:34.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.243+0000 7fc396d9d700 1 --2- 172.21.15.60:0/1170184140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc39013c430 0x7fc3900ca950 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc3900b0bd0 tx=0x7fc38c009250 comp rx=0 tx=0).stop 2023-10-06T04:28:34.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.243+0000 7fc396d9d700 1 -- 172.21.15.60:0/1170184140 shutdown_connections 2023-10-06T04:28:34.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.243+0000 7fc396d9d700 1 --2- 172.21.15.60:0/1170184140 >> v2:172.21.15.135:3300/0 conn(0x7fc39015a080 0x7fc39015cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.243+0000 7fc396d9d700 1 --2- 172.21.15.60:0/1170184140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc39013c430 0x7fc3900ca950 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.243+0000 7fc396d9d700 1 --2- 172.21.15.60:0/1170184140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3900cae90 0x7fc390159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.243+0000 7fc396d9d700 1 -- 172.21.15.60:0/1170184140 >> 172.21.15.60:0/1170184140 conn(0x7fc39006b330 msgr2=0x7fc39006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:34.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.244+0000 7fc396d9d700 1 -- 172.21.15.60:0/1170184140 shutdown_connections 2023-10-06T04:28:34.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.244+0000 7fc396d9d700 1 -- 172.21.15.60:0/1170184140 wait complete. 2023-10-06T04:28:34.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.245+0000 7fc396d9d700 1 Processor -- start 2023-10-06T04:28:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.245+0000 7fc396d9d700 1 -- start start 2023-10-06T04:28:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.246+0000 7fc396d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3900cae90 0x7fc390154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.246+0000 7fc396d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc39013c430 0x7fc3900c5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.246+0000 7fc396d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc39015a080 0x7fc3900c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.246+0000 7fc396d9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3900c7200 con 0x7fc39013c430 2023-10-06T04:28:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.246+0000 7fc396d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc390154dc0 con 0x7fc3900cae90 2023-10-06T04:28:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.246+0000 7fc396d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3900b2cc0 con 0x7fc39015a080 2023-10-06T04:28:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.246+0000 7fc39559a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc39013c430 0x7fc3900c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.246+0000 7fc395d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3900cae90 0x7fc390154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.246+0000 7fc39559a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc39013c430 0x7fc3900c5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38388/0 (socket says 172.21.15.60:38388) 2023-10-06T04:28:34.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.246+0000 7fc39559a700 1 -- 172.21.15.60:0/1189154810 learned_addr learned my addr 172.21.15.60:0/1189154810 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:34.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.246+0000 7fc39659c700 1 --2- 172.21.15.60:0/1189154810 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc39015a080 0x7fc3900c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:34.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.247+0000 7fc39559a700 1 -- 172.21.15.60:0/1189154810 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc39015a080 msgr2=0x7fc3900c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:34.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.247+0000 7fc39559a700 1 --2- 172.21.15.60:0/1189154810 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc39015a080 0x7fc3900c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.247+0000 7fc39559a700 1 -- 172.21.15.60:0/1189154810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3900cae90 msgr2=0x7fc390154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:34.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.247+0000 7fc39559a700 1 --2- 172.21.15.60:0/1189154810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3900cae90 0x7fc390154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.247+0000 7fc39559a700 1 -- 172.21.15.60:0/1189154810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38c0094f0 con 0x7fc39013c430 2023-10-06T04:28:34.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.247+0000 7fc39559a700 1 --2- 172.21.15.60:0/1189154810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc39013c430 0x7fc3900c5160 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc38000ec80 tx=0x7fc3800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:34.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.247+0000 7fc385ffb700 1 -- 172.21.15.60:0/1189154810 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38000c850 con 0x7fc39013c430 2023-10-06T04:28:34.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.247+0000 7fc385ffb700 1 -- 172.21.15.60:0/1189154810 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38000c9b0 con 0x7fc39013c430 2023-10-06T04:28:34.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.247+0000 7fc385ffb700 1 -- 172.21.15.60:0/1189154810 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38000cd50 con 0x7fc39013c430 2023-10-06T04:28:34.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.247+0000 7fc396d9d700 1 -- 172.21.15.60:0/1189154810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3900b2fa0 con 0x7fc39013c430 2023-10-06T04:28:34.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.248+0000 7fc396d9d700 1 -- 172.21.15.60:0/1189154810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3900b3560 con 0x7fc39013c430 2023-10-06T04:28:34.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.248+0000 7fc396d9d700 1 -- 172.21.15.60:0/1189154810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3900c7400 con 0x7fc39013c430 2023-10-06T04:28:34.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.249+0000 7fc385ffb700 1 -- 172.21.15.60:0/1189154810 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc380013680 con 0x7fc39013c430 2023-10-06T04:28:34.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.250+0000 7fc385ffb700 1 --2- 172.21.15.60:0/1189154810 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc374066f30 0x7fc3740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:34.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.250+0000 7fc385ffb700 1 -- 172.21.15.60:0/1189154810 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc380084c50 con 0x7fc39013c430 2023-10-06T04:28:34.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.250+0000 7fc395d9b700 1 --2- 172.21.15.60:0/1189154810 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc374066f30 0x7fc3740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:34.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.251+0000 7fc395d9b700 1 --2- 172.21.15.60:0/1189154810 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc374066f30 0x7fc3740693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc3900b0bd0 tx=0x7fc38c017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:34.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.254+0000 7fc385ffb700 1 -- 172.21.15.60:0/1189154810 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3900c7400 con 0x7fc39013c430 2023-10-06T04:28:34.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.459+0000 7fc396d9d700 1 -- 172.21.15.60:0/1189154810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc39005f230 con 0x7fc39013c430 2023-10-06T04:28:34.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.459+0000 7fc385ffb700 1 -- 172.21.15.60:0/1189154810 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc3800519d0 con 0x7fc39013c430 2023-10-06T04:28:34.462 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-06T04:28:34.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.461+0000 7fc396d9d700 1 -- 172.21.15.60:0/1189154810 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc374066f30 msgr2=0x7fc3740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:34.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.461+0000 7fc396d9d700 1 --2- 172.21.15.60:0/1189154810 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc374066f30 0x7fc3740693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc3900b0bd0 tx=0x7fc38c017000 comp rx=0 tx=0).stop 2023-10-06T04:28:34.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.461+0000 7fc396d9d700 1 -- 172.21.15.60:0/1189154810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc39013c430 msgr2=0x7fc3900c5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:34.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.461+0000 7fc396d9d700 1 --2- 172.21.15.60:0/1189154810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc39013c430 0x7fc3900c5160 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc38000ec80 tx=0x7fc3800091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.461+0000 7fc396d9d700 1 -- 172.21.15.60:0/1189154810 shutdown_connections 2023-10-06T04:28:34.464 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.461+0000 7fc396d9d700 1 --2- 172.21.15.60:0/1189154810 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc374066f30 0x7fc3740693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.461+0000 7fc396d9d700 1 --2- 172.21.15.60:0/1189154810 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc39015a080 0x7fc3900c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.461+0000 7fc396d9d700 1 --2- 172.21.15.60:0/1189154810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3900cae90 0x7fc390154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.461+0000 7fc396d9d700 1 --2- 172.21.15.60:0/1189154810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc39013c430 0x7fc3900c5160 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.461+0000 7fc396d9d700 1 -- 172.21.15.60:0/1189154810 >> 172.21.15.60:0/1189154810 conn(0x7fc39006b330 msgr2=0x7fc390068b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:34.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.462+0000 7fc396d9d700 1 -- 172.21.15.60:0/1189154810 shutdown_connections 2023-10-06T04:28:34.465 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.462+0000 7fc396d9d700 1 -- 172.21.15.60:0/1189154810 wait complete. 2023-10-06T04:28:34.481 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:28:34.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.668+0000 7fe2acf9d700 1 Processor -- start 2023-10-06T04:28:34.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.668+0000 7fe2acf9d700 1 -- start start 2023-10-06T04:28:34.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.670+0000 7fe2acf9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe2a8154a90 0x7fe2a80b1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:34.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.670+0000 7fe2acf9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a8154e60 0x7fe2a80adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:34.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.670+0000 7fe2acf9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a80ae440 con 0x7fe2a80adfe0 2023-10-06T04:28:34.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.670+0000 7fe2acf9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a806ef10 con 0x7fe2a8154a90 2023-10-06T04:28:34.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.670+0000 7fe2acf9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a806e300 con 0x7fe2a8154e60 2023-10-06T04:28:34.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.670+0000 7fe2a77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe2a8154a90 0x7fe2a80b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:34.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.670+0000 7fe2a77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe2a8154a90 0x7fe2a80b1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38398/0 (socket says 172.21.15.60:38398) 2023-10-06T04:28:34.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.670+0000 7fe2a77fe700 1 -- 172.21.15.60:0/3888747046 learned_addr learned my addr 172.21.15.60:0/3888747046 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:34.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.670+0000 7fe2a6ffd700 1 --2- 172.21.15.60:0/3888747046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a8154e60 0x7fe2a80adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:34.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.671+0000 7fe2a77fe700 1 -- 172.21.15.60:0/3888747046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a8154e60 msgr2=0x7fe2a80adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:34.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.671+0000 7fe2a77fe700 1 --2- 172.21.15.60:0/3888747046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a8154e60 0x7fe2a80adaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.671+0000 7fe2a77fe700 1 -- 172.21.15.60:0/3888747046 >> v1:172.21.15.60:6789/0 conn(0x7fe2a80adfe0 legacy=0x7fe2a815ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:34.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.671+0000 7fe2a77fe700 1 -- 172.21.15.60:0/3888747046 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a806e5e0 con 0x7fe2a8154a90 2023-10-06T04:28:34.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.671+0000 7fe2a67fc700 1 -- 172.21.15.60:0/3888747046 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198151207 0 0) 0x7fe2a0001490 con 0x7fe2a80adfe0 2023-10-06T04:28:34.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.671+0000 7fe2a77fe700 1 --2- 172.21.15.60:0/3888747046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2a8154a90 0x7fe2a80b1590 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe2980099b0 tx=0x7fe298009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ccd6811efd7015 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:34.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.671+0000 7fe2a67fc700 1 -- 172.21.15.60:0/3888747046 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe298009ea0 con 0x7fe2a8154a90 2023-10-06T04:28:34.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.671+0000 7fe2a67fc700 1 -- 172.21.15.60:0/3888747046 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29800b860 con 0x7fe2a8154a90 2023-10-06T04:28:34.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.671+0000 7fe2a67fc700 1 -- 172.21.15.60:0/3888747046 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29800bc00 con 0x7fe2a8154a90 2023-10-06T04:28:34.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.672+0000 7fe2acf9d700 1 -- 172.21.15.60:0/3888747046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2a8154a90 msgr2=0x7fe2a80b1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:34.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.672+0000 7fe2acf9d700 1 --2- 172.21.15.60:0/3888747046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2a8154a90 0x7fe2a80b1590 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe2980099b0 tx=0x7fe298009250 comp rx=0 tx=0).stop 2023-10-06T04:28:34.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.672+0000 7fe2acf9d700 1 -- 172.21.15.60:0/3888747046 shutdown_connections 2023-10-06T04:28:34.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.672+0000 7fe2acf9d700 1 --2- 172.21.15.60:0/3888747046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2a8154a90 0x7fe2a80b1590 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.672+0000 7fe2acf9d700 1 --2- 172.21.15.60:0/3888747046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a8154e60 0x7fe2a80adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.672+0000 7fe2acf9d700 1 -- 172.21.15.60:0/3888747046 >> 172.21.15.60:0/3888747046 conn(0x7fe2a80cbed0 msgr2=0x7fe2a80cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:34.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.672+0000 7fe2acf9d700 1 -- 172.21.15.60:0/3888747046 shutdown_connections 2023-10-06T04:28:34.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.672+0000 7fe2acf9d700 1 -- 172.21.15.60:0/3888747046 wait complete. 2023-10-06T04:28:34.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.673+0000 7fe2acf9d700 1 Processor -- start 2023-10-06T04:28:34.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.673+0000 7fe2acf9d700 1 -- start start 2023-10-06T04:28:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.674+0000 7fe2acf9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a80adfe0 0x7fe2a814a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.674+0000 7fe2acf9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2a8154a90 0x7fe2a81683c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.674+0000 7fe2acf9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2a8154e60 0x7fe2a81484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.674+0000 7fe2acf9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a8168900 con 0x7fe2a8154e60 2023-10-06T04:28:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.674+0000 7fe2acf9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a816b290 con 0x7fe2a8154a90 2023-10-06T04:28:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.674+0000 7fe2acf9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a816b570 con 0x7fe2a80adfe0 2023-10-06T04:28:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.675+0000 7fe2a7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2a8154e60 0x7fe2a81484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.675+0000 7fe2a77fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a80adfe0 0x7fe2a814a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.675+0000 7fe2a7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2a8154e60 0x7fe2a81484d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38414/0 (socket says 172.21.15.60:38414) 2023-10-06T04:28:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.675+0000 7fe2a7fff700 1 -- 172.21.15.60:0/1251920957 learned_addr learned my addr 172.21.15.60:0/1251920957 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.675+0000 7fe2a6ffd700 1 --2- 172.21.15.60:0/1251920957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2a8154a90 0x7fe2a81683c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:34.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.675+0000 7fe2a77fe700 1 -- 172.21.15.60:0/1251920957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2a8154a90 msgr2=0x7fe2a81683c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:34.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.675+0000 7fe2a77fe700 1 --2- 172.21.15.60:0/1251920957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2a8154a90 0x7fe2a81683c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.675+0000 7fe2a77fe700 1 -- 172.21.15.60:0/1251920957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2a8154e60 msgr2=0x7fe2a81484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:34.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.675+0000 7fe2a77fe700 1 --2- 172.21.15.60:0/1251920957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2a8154e60 0x7fe2a81484d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.675+0000 7fe2a77fe700 1 -- 172.21.15.60:0/1251920957 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2980094f0 con 0x7fe2a80adfe0 2023-10-06T04:28:34.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.675+0000 7fe2a7fff700 1 --2- 172.21.15.60:0/1251920957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2a8154e60 0x7fe2a81484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:34.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.675+0000 7fe2a77fe700 1 --2- 172.21.15.60:0/1251920957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a80adfe0 0x7fe2a814a580 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80ad040 tx=0x7fe298017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:34.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.676+0000 7fe28f7fe700 1 -- 172.21.15.60:0/1251920957 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe298000d10 con 0x7fe2a80adfe0 2023-10-06T04:28:34.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.676+0000 7fe28f7fe700 1 -- 172.21.15.60:0/1251920957 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29800bbe0 con 0x7fe2a80adfe0 2023-10-06T04:28:34.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.676+0000 7fe2acf9d700 1 -- 172.21.15.60:0/1251920957 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a816b850 con 0x7fe2a80adfe0 2023-10-06T04:28:34.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.676+0000 7fe28f7fe700 1 -- 172.21.15.60:0/1251920957 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe298011630 con 0x7fe2a80adfe0 2023-10-06T04:28:34.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.676+0000 7fe2acf9d700 1 -- 172.21.15.60:0/1251920957 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a816af40 con 0x7fe2a80adfe0 2023-10-06T04:28:34.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.677+0000 7fe2acf9d700 1 -- 172.21.15.60:0/1251920957 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a8157520 con 0x7fe2a80adfe0 2023-10-06T04:28:34.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.678+0000 7fe28f7fe700 1 -- 172.21.15.60:0/1251920957 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe298011a60 con 0x7fe2a80adfe0 2023-10-06T04:28:34.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.679+0000 7fe28f7fe700 1 --2- 172.21.15.60:0/1251920957 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe294067000 0x7fe2940694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:34.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.679+0000 7fe28f7fe700 1 -- 172.21.15.60:0/1251920957 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe298086200 con 0x7fe2a80adfe0 2023-10-06T04:28:34.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.679+0000 7fe2a6ffd700 1 --2- 172.21.15.60:0/1251920957 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe294067000 0x7fe2940694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:34.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.680+0000 7fe2a6ffd700 1 --2- 172.21.15.60:0/1251920957 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe294067000 0x7fe2940694b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80acbe0 tx=0x7fe29c0091a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:34.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.683+0000 7fe28f7fe700 1 -- 172.21.15.60:0/1251920957 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe298053080 con 0x7fe2a80adfe0 2023-10-06T04:28:34.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.891+0000 7fe2acf9d700 1 -- 172.21.15.60:0/1251920957 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe2a805f230 con 0x7fe2a80adfe0 2023-10-06T04:28:34.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.892+0000 7fe28f7fe700 1 -- 172.21.15.60:0/1251920957 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe2980566a0 con 0x7fe2a80adfe0 2023-10-06T04:28:34.895 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-06T04:28:34.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.895+0000 7fe2acf9d700 1 -- 172.21.15.60:0/1251920957 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe294067000 msgr2=0x7fe2940694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:34.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.895+0000 7fe2acf9d700 1 --2- 172.21.15.60:0/1251920957 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe294067000 0x7fe2940694b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80acbe0 tx=0x7fe29c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.895+0000 7fe2acf9d700 1 -- 172.21.15.60:0/1251920957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a80adfe0 msgr2=0x7fe2a814a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:34.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.895+0000 7fe2acf9d700 1 --2- 172.21.15.60:0/1251920957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a80adfe0 0x7fe2a814a580 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80ad040 tx=0x7fe298017000 comp rx=0 tx=0).stop 2023-10-06T04:28:34.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.895+0000 7fe2acf9d700 1 -- 172.21.15.60:0/1251920957 shutdown_connections 2023-10-06T04:28:34.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.895+0000 7fe2acf9d700 1 --2- 172.21.15.60:0/1251920957 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe294067000 0x7fe2940694b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.895+0000 7fe2acf9d700 1 --2- 172.21.15.60:0/1251920957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2a8154e60 0x7fe2a81484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.895+0000 7fe2acf9d700 1 --2- 172.21.15.60:0/1251920957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe2a80adfe0 0x7fe2a814a580 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.895+0000 7fe2acf9d700 1 --2- 172.21.15.60:0/1251920957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2a8154a90 0x7fe2a81683c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:34.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.895+0000 7fe2acf9d700 1 -- 172.21.15.60:0/1251920957 >> 172.21.15.60:0/1251920957 conn(0x7fe2a80cbed0 msgr2=0x7fe2a8150250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:34.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.895+0000 7fe2acf9d700 1 -- 172.21.15.60:0/1251920957 shutdown_connections 2023-10-06T04:28:34.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:34.895+0000 7fe2acf9d700 1 -- 172.21.15.60:0/1251920957 wait complete. 2023-10-06T04:28:34.915 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:28:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.101+0000 7f140219d700 1 Processor -- start 2023-10-06T04:28:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.101+0000 7f140219d700 1 -- start start 2023-10-06T04:28:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.102+0000 7f140219d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f13fc0b2620 0x7f13fc0cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.102+0000 7f140219d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13fc0b29f0 0x7f13fc0cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.102+0000 7f140219d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f13fc0ceaa0 0x7f13fc0cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.102+0000 7f140219d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13fc0cc970 con 0x7f13fc0ceaa0 2023-10-06T04:28:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.102+0000 7f140219d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13fc0cf480 con 0x7f13fc0b2620 2023-10-06T04:28:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.102+0000 7f140219d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc0cbd60 con 0x7f13fc0b29f0 2023-10-06T04:28:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.103+0000 7f140199c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f13fc0ceaa0 0x7f13fc0cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.103+0000 7f140199c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f13fc0ceaa0 0x7f13fc0cef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38426/0 (socket says 172.21.15.60:38426) 2023-10-06T04:28:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.103+0000 7f140199c700 1 -- 172.21.15.60:0/3252996113 learned_addr learned my addr 172.21.15.60:0/3252996113 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.103+0000 7f140119b700 1 --2- 172.21.15.60:0/3252996113 >> v2:172.21.15.135:3300/0 conn(0x7f13fc0b2620 0x7f13fc0cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.103+0000 7f140099a700 1 --2- 172.21.15.60:0/3252996113 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13fc0b29f0 0x7f13fc0cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.103+0000 7f140199c700 1 -- 172.21.15.60:0/3252996113 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13fc0b29f0 msgr2=0x7f13fc0cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.103+0000 7f140199c700 1 --2- 172.21.15.60:0/3252996113 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13fc0b29f0 0x7f13fc0cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.103+0000 7f140199c700 1 -- 172.21.15.60:0/3252996113 >> v2:172.21.15.135:3300/0 conn(0x7f13fc0b2620 msgr2=0x7f13fc0cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.103+0000 7f140199c700 1 --2- 172.21.15.60:0/3252996113 >> v2:172.21.15.135:3300/0 conn(0x7f13fc0b2620 0x7f13fc0cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.103+0000 7f140199c700 1 -- 172.21.15.60:0/3252996113 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13fc0cc040 con 0x7f13fc0ceaa0 2023-10-06T04:28:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.103+0000 7f140199c700 1 --2- 172.21.15.60:0/3252996113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13fc0ceaa0 0x7f13fc0cef40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0894c0 tx=0x7f13f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c2a92f34d8a9e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.104+0000 7f13f3fff700 1 -- 172.21.15.60:0/3252996113 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f400e070 con 0x7f13fc0ceaa0 2023-10-06T04:28:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.104+0000 7f13f3fff700 1 -- 172.21.15.60:0/3252996113 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f400ba50 con 0x7f13fc0ceaa0 2023-10-06T04:28:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.104+0000 7f13f3fff700 1 -- 172.21.15.60:0/3252996113 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f40092e0 con 0x7f13fc0ceaa0 2023-10-06T04:28:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.104+0000 7f140219d700 1 -- 172.21.15.60:0/3252996113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13fc0ceaa0 msgr2=0x7f13fc0cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.104+0000 7f140219d700 1 --2- 172.21.15.60:0/3252996113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13fc0ceaa0 0x7f13fc0cef40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0894c0 tx=0x7f13f4009840 comp rx=0 tx=0).stop 2023-10-06T04:28:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.104+0000 7f140219d700 1 -- 172.21.15.60:0/3252996113 shutdown_connections 2023-10-06T04:28:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.104+0000 7f140219d700 1 --2- 172.21.15.60:0/3252996113 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13fc0ceaa0 0x7f13fc0cef40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.104+0000 7f140219d700 1 --2- 172.21.15.60:0/3252996113 >> v2:172.21.15.135:3300/0 conn(0x7f13fc0b2620 0x7f13fc0cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.104+0000 7f140219d700 1 --2- 172.21.15.60:0/3252996113 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13fc0b29f0 0x7f13fc0cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.104+0000 7f140219d700 1 -- 172.21.15.60:0/3252996113 >> 172.21.15.60:0/3252996113 conn(0x7f13fc099520 msgr2=0x7f13fc06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.104+0000 7f140219d700 1 -- 172.21.15.60:0/3252996113 shutdown_connections 2023-10-06T04:28:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.104+0000 7f140219d700 1 -- 172.21.15.60:0/3252996113 wait complete. 2023-10-06T04:28:35.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.106+0000 7f140219d700 1 Processor -- start 2023-10-06T04:28:35.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.106+0000 7f140219d700 1 -- start start 2023-10-06T04:28:35.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.107+0000 7f140219d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13fc0b2620 0x7f13fc155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:35.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.107+0000 7f140219d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13fc0b29f0 0x7f13fc0b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:35.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.107+0000 7f140219d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13fc0ceaa0 0x7f13fc0b5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:35.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.107+0000 7f140219d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc0c8400 con 0x7f13fc0b2620 2023-10-06T04:28:35.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.107+0000 7f140219d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc09c5b0 con 0x7f13fc0ceaa0 2023-10-06T04:28:35.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.107+0000 7f140219d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc0c7f70 con 0x7f13fc0b29f0 2023-10-06T04:28:35.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.107+0000 7f140119b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13fc0b2620 0x7f13fc155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:35.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.107+0000 7f140119b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13fc0b2620 0x7f13fc155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38430/0 (socket says 172.21.15.60:38430) 2023-10-06T04:28:35.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.107+0000 7f140119b700 1 -- 172.21.15.60:0/2238381926 learned_addr learned my addr 172.21.15.60:0/2238381926 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.107+0000 7f140099a700 1 --2- 172.21.15.60:0/2238381926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13fc0b29f0 0x7f13fc0b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.107+0000 7f140199c700 1 --2- 172.21.15.60:0/2238381926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13fc0ceaa0 0x7f13fc0b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.108+0000 7f140119b700 1 -- 172.21.15.60:0/2238381926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13fc0b29f0 msgr2=0x7f13fc0b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.108+0000 7f140119b700 1 --2- 172.21.15.60:0/2238381926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13fc0b29f0 0x7f13fc0b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.108+0000 7f140119b700 1 -- 172.21.15.60:0/2238381926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13fc0ceaa0 msgr2=0x7f13fc0b5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.108+0000 7f140119b700 1 --2- 172.21.15.60:0/2238381926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13fc0ceaa0 0x7f13fc0b5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.108+0000 7f140119b700 1 -- 172.21.15.60:0/2238381926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f4009ae0 con 0x7f13fc0b2620 2023-10-06T04:28:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.108+0000 7f140119b700 1 --2- 172.21.15.60:0/2238381926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13fc0b2620 0x7f13fc155270 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f13f800d840 tx=0x7f13f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.108+0000 7f13f17fa700 1 -- 172.21.15.60:0/2238381926 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f8014620 con 0x7f13fc0b2620 2023-10-06T04:28:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.108+0000 7f13f17fa700 1 -- 172.21.15.60:0/2238381926 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f8014780 con 0x7f13fc0b2620 2023-10-06T04:28:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.108+0000 7f13f17fa700 1 -- 172.21.15.60:0/2238381926 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f8014b40 con 0x7f13fc0b2620 2023-10-06T04:28:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.108+0000 7f140219d700 1 -- 172.21.15.60:0/2238381926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13fc0c7380 con 0x7f13fc0b2620 2023-10-06T04:28:35.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.108+0000 7f140219d700 1 -- 172.21.15.60:0/2238381926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13fc0c76f0 con 0x7f13fc0b2620 2023-10-06T04:28:35.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.109+0000 7f140219d700 1 -- 172.21.15.60:0/2238381926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13fc05f230 con 0x7f13fc0b2620 2023-10-06T04:28:35.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.110+0000 7f13f17fa700 1 -- 172.21.15.60:0/2238381926 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13f801d400 con 0x7f13fc0b2620 2023-10-06T04:28:35.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.111+0000 7f13f17fa700 1 --2- 172.21.15.60:0/2238381926 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f13e0066f30 0x7f13e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.111+0000 7f13f17fa700 1 -- 172.21.15.60:0/2238381926 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f13f8084ed0 con 0x7f13fc0b2620 2023-10-06T04:28:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.111+0000 7f140099a700 1 --2- 172.21.15.60:0/2238381926 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f13e0066f30 0x7f13e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.112+0000 7f140099a700 1 --2- 172.21.15.60:0/2238381926 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f13e0066f30 0x7f13e00693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f13ec006fd0 tx=0x7f13ec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.115+0000 7f13f17fa700 1 -- 172.21.15.60:0/2238381926 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13f8051c50 con 0x7f13fc0b2620 2023-10-06T04:28:35.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.316+0000 7f140219d700 1 -- 172.21.15.60:0/2238381926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f13fc0c7cc0 con 0x7f13fc0b2620 2023-10-06T04:28:35.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.316+0000 7f13f17fa700 1 -- 172.21.15.60:0/2238381926 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f13f8055270 con 0x7f13fc0b2620 2023-10-06T04:28:35.319 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-06T04:28:35.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.319+0000 7f140219d700 1 -- 172.21.15.60:0/2238381926 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f13e0066f30 msgr2=0x7f13e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:35.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.319+0000 7f140219d700 1 --2- 172.21.15.60:0/2238381926 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f13e0066f30 0x7f13e00693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f13ec006fd0 tx=0x7f13ec008040 comp rx=0 tx=0).stop 2023-10-06T04:28:35.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.319+0000 7f140219d700 1 -- 172.21.15.60:0/2238381926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13fc0b2620 msgr2=0x7f13fc155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:35.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.319+0000 7f140219d700 1 --2- 172.21.15.60:0/2238381926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13fc0b2620 0x7f13fc155270 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f13f800d840 tx=0x7f13f8008040 comp rx=0 tx=0).stop 2023-10-06T04:28:35.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.319+0000 7f140219d700 1 -- 172.21.15.60:0/2238381926 shutdown_connections 2023-10-06T04:28:35.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.319+0000 7f140219d700 1 --2- 172.21.15.60:0/2238381926 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f13e0066f30 0x7f13e00693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.319+0000 7f140219d700 1 --2- 172.21.15.60:0/2238381926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13fc0b2620 0x7f13fc155270 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.319+0000 7f140219d700 1 --2- 172.21.15.60:0/2238381926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13fc0ceaa0 0x7f13fc0b5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.319+0000 7f140219d700 1 --2- 172.21.15.60:0/2238381926 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f13fc0b29f0 0x7f13fc0b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.319+0000 7f140219d700 1 -- 172.21.15.60:0/2238381926 >> 172.21.15.60:0/2238381926 conn(0x7f13fc099520 msgr2=0x7f13fc155ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:35.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.319+0000 7f140219d700 1 -- 172.21.15.60:0/2238381926 shutdown_connections 2023-10-06T04:28:35.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.319+0000 7f140219d700 1 -- 172.21.15.60:0/2238381926 wait complete. 2023-10-06T04:28:35.339 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:28:35.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.525+0000 7f611179d700 1 Processor -- start 2023-10-06T04:28:35.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.526+0000 7f611179d700 1 -- start start 2023-10-06T04:28:35.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.527+0000 7f611179d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f610c159600 0x7f610c0abc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:35.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.527+0000 7f611179d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f610c0ac1b0 0x7f610c0675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:35.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.527+0000 7f611179d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610c06a4e0 con 0x7f610c159230 2023-10-06T04:28:35.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.527+0000 7f611179d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f610c0ac6a0 con 0x7f610c159600 2023-10-06T04:28:35.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.527+0000 7f611179d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c06b9b0 con 0x7f610c0ac1b0 2023-10-06T04:28:35.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.527+0000 7f610b7fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f610c159600 0x7f610c0abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:35.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.527+0000 7f6110f9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f610c0ac1b0 0x7f610c0675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:35.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.527+0000 7f610b7fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f610c159600 0x7f610c0abc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:51354/0 (socket says 172.21.15.60:51354) 2023-10-06T04:28:35.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.527+0000 7f610b7fe700 1 -- 172.21.15.60:0/1504967403 learned_addr learned my addr 172.21.15.60:0/1504967403 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:35.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.527+0000 7f610bfff700 1 --1- 172.21.15.60:0/1504967403 >> v1:172.21.15.135:6789/0 conn(0x7f610c159230 0x7f610c06b2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.60:59296/0 (socket says 172.21.15.60:59296) 2023-10-06T04:28:35.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.528+0000 7f6110f9c700 1 -- 172.21.15.60:0/1504967403 >> v2:172.21.15.135:3300/0 conn(0x7f610c159600 msgr2=0x7f610c0abc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:35.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.528+0000 7f6110f9c700 1 --2- 172.21.15.60:0/1504967403 >> v2:172.21.15.135:3300/0 conn(0x7f610c159600 0x7f610c0abc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.528+0000 7f6110f9c700 1 -- 172.21.15.60:0/1504967403 >> v1:172.21.15.135:6789/0 conn(0x7f610c159230 legacy=0x7f610c06b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:35.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.528+0000 7f6110f9c700 1 -- 172.21.15.60:0/1504967403 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c06a7c0 con 0x7f610c0ac1b0 2023-10-06T04:28:35.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.528+0000 7f610b7fe700 1 --2- 172.21.15.60:0/1504967403 >> v2:172.21.15.135:3300/0 conn(0x7f610c159600 0x7f610c0abc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:35.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.528+0000 7f6110f9c700 1 --2- 172.21.15.60:0/1504967403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f610c0ac1b0 0x7f610c0675b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6104009e60 tx=0x7f6104009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c7b6fd425e8d244 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:35.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.528+0000 7f610affd700 1 -- 172.21.15.60:0/1504967403 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610400e070 con 0x7f610c0ac1b0 2023-10-06T04:28:35.534 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.529+0000 7f610affd700 1 -- 172.21.15.60:0/1504967403 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610400ba60 con 0x7f610c0ac1b0 2023-10-06T04:28:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.529+0000 7f610affd700 1 -- 172.21.15.60:0/1504967403 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610400be20 con 0x7f610c0ac1b0 2023-10-06T04:28:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.529+0000 7f611179d700 1 -- 172.21.15.60:0/1504967403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f610c0ac1b0 msgr2=0x7f610c0675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.529+0000 7f611179d700 1 --2- 172.21.15.60:0/1504967403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f610c0ac1b0 0x7f610c0675b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6104009e60 tx=0x7f6104009780 comp rx=0 tx=0).stop 2023-10-06T04:28:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.529+0000 7f611179d700 1 -- 172.21.15.60:0/1504967403 shutdown_connections 2023-10-06T04:28:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.529+0000 7f611179d700 1 --2- 172.21.15.60:0/1504967403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f610c0ac1b0 0x7f610c0675b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.529+0000 7f611179d700 1 --2- 172.21.15.60:0/1504967403 >> v2:172.21.15.135:3300/0 conn(0x7f610c159600 0x7f610c0abc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.529+0000 7f611179d700 1 -- 172.21.15.60:0/1504967403 >> 172.21.15.60:0/1504967403 conn(0x7f610c069130 msgr2=0x7f610c0ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:35.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.529+0000 7f611179d700 1 -- 172.21.15.60:0/1504967403 shutdown_connections 2023-10-06T04:28:35.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.529+0000 7f611179d700 1 -- 172.21.15.60:0/1504967403 wait complete. 2023-10-06T04:28:35.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.531+0000 7f611179d700 1 Processor -- start 2023-10-06T04:28:35.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.531+0000 7f611179d700 1 -- start start 2023-10-06T04:28:35.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.532+0000 7f611179d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f610c0ac1b0 0x7f610c1458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:35.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.532+0000 7f611179d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f610c159230 0x7f610c0aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:35.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.532+0000 7f611179d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f610c159600 0x7f610c157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:35.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.532+0000 7f611179d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0ac9d0 con 0x7f610c159230 2023-10-06T04:28:35.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.532+0000 7f611179d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0b23a0 con 0x7f610c0ac1b0 2023-10-06T04:28:35.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.532+0000 7f611179d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0b2680 con 0x7f610c159600 2023-10-06T04:28:35.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.532+0000 7f610b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f610c159230 0x7f610c0aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:35.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.532+0000 7f610b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f610c159230 0x7f610c0aef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38432/0 (socket says 172.21.15.60:38432) 2023-10-06T04:28:35.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.532+0000 7f610b7fe700 1 -- 172.21.15.60:0/3990803955 learned_addr learned my addr 172.21.15.60:0/3990803955 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:35.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.532+0000 7f610bfff700 1 --2- 172.21.15.60:0/3990803955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f610c0ac1b0 0x7f610c1458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:35.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.532+0000 7f6110f9c700 1 --2- 172.21.15.60:0/3990803955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f610c159600 0x7f610c157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:35.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.533+0000 7f610b7fe700 1 -- 172.21.15.60:0/3990803955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f610c159600 msgr2=0x7f610c157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:35.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.533+0000 7f610b7fe700 1 --2- 172.21.15.60:0/3990803955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f610c159600 0x7f610c157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.533+0000 7f610b7fe700 1 -- 172.21.15.60:0/3990803955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f610c0ac1b0 msgr2=0x7f610c1458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:35.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.533+0000 7f610b7fe700 1 --2- 172.21.15.60:0/3990803955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f610c0ac1b0 0x7f610c1458d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.533+0000 7f610b7fe700 1 -- 172.21.15.60:0/3990803955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61000094f0 con 0x7f610c159230 2023-10-06T04:28:35.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.533+0000 7f610bfff700 1 --2- 172.21.15.60:0/3990803955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f610c0ac1b0 0x7f610c1458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:35.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.533+0000 7f610b7fe700 1 --2- 172.21.15.60:0/3990803955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f610c159230 0x7f610c0aef20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f610000ec50 tx=0x7f6100009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:35.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.533+0000 7f60f3fff700 1 -- 172.21.15.60:0/3990803955 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610000c850 con 0x7f610c159230 2023-10-06T04:28:35.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.533+0000 7f60f3fff700 1 -- 172.21.15.60:0/3990803955 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610000c9b0 con 0x7f610c159230 2023-10-06T04:28:35.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.533+0000 7f611179d700 1 -- 172.21.15.60:0/3990803955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6104009a20 con 0x7f610c159230 2023-10-06T04:28:35.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.533+0000 7f60f3fff700 1 -- 172.21.15.60:0/3990803955 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610000cd50 con 0x7f610c159230 2023-10-06T04:28:35.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.533+0000 7f611179d700 1 -- 172.21.15.60:0/3990803955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610c0b2c40 con 0x7f610c159230 2023-10-06T04:28:35.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.534+0000 7f611179d700 1 -- 172.21.15.60:0/3990803955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610c0acb40 con 0x7f610c159230 2023-10-06T04:28:35.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.535+0000 7f60f3fff700 1 -- 172.21.15.60:0/3990803955 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6100013680 con 0x7f610c159230 2023-10-06T04:28:35.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.536+0000 7f60f3fff700 1 --2- 172.21.15.60:0/3990803955 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f60f8066f30 0x7f60f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:35.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.536+0000 7f60f3fff700 1 -- 172.21.15.60:0/3990803955 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6100084aa0 con 0x7f610c159230 2023-10-06T04:28:35.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.536+0000 7f610bfff700 1 --2- 172.21.15.60:0/3990803955 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f60f8066f30 0x7f60f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:35.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.537+0000 7f610bfff700 1 --2- 172.21.15.60:0/3990803955 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f60f8066f30 0x7f60f80693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f60fc007fd0 tx=0x7f60fc007e70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:35.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.540+0000 7f60f3fff700 1 -- 172.21.15.60:0/3990803955 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6100051820 con 0x7f610c159230 2023-10-06T04:28:35.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.784+0000 7f611179d700 1 -- 172.21.15.60:0/3990803955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f610c05f230 con 0x7f610c159230 2023-10-06T04:28:35.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.785+0000 7f60f3fff700 1 -- 172.21.15.60:0/3990803955 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f6100054e40 con 0x7f610c159230 2023-10-06T04:28:35.787 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:35.788 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3950892589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3950892589},{"type":"v1","addr":"172.21.15.60:6837","nonce":3950892589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1381681252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1381681252},{"type":"v1","addr":"172.21.15.135:6834","nonce":1381681252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1306947344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1306947344},{"type":"v1","addr":"172.21.15.135:6835","nonce":1306947344}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:28:06.242656+0000","modified":"2023-10-06T04:28:23.340411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/1424722915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1424722915},{"type":"v1","addr":"172.21.15.60:6836","nonce":1424722915}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:28:35.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.787+0000 7f611179d700 1 -- 172.21.15.60:0/3990803955 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f60f8066f30 msgr2=0x7f60f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:35.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.788+0000 7f611179d700 1 --2- 172.21.15.60:0/3990803955 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f60f8066f30 0x7f60f80693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f60fc007fd0 tx=0x7f60fc007e70 comp rx=0 tx=0).stop 2023-10-06T04:28:35.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.788+0000 7f611179d700 1 -- 172.21.15.60:0/3990803955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f610c159230 msgr2=0x7f610c0aef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:35.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.788+0000 7f611179d700 1 --2- 172.21.15.60:0/3990803955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f610c159230 0x7f610c0aef20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f610000ec50 tx=0x7f6100009250 comp rx=0 tx=0).stop 2023-10-06T04:28:35.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.788+0000 7f611179d700 1 -- 172.21.15.60:0/3990803955 shutdown_connections 2023-10-06T04:28:35.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.788+0000 7f611179d700 1 --2- 172.21.15.60:0/3990803955 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f60f8066f30 0x7f60f80693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.788+0000 7f611179d700 1 --2- 172.21.15.60:0/3990803955 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f610c159600 0x7f610c157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.788+0000 7f611179d700 1 --2- 172.21.15.60:0/3990803955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f610c0ac1b0 0x7f610c1458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.788+0000 7f611179d700 1 --2- 172.21.15.60:0/3990803955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f610c159230 0x7f610c0aef20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.788+0000 7f611179d700 1 -- 172.21.15.60:0/3990803955 >> 172.21.15.60:0/3990803955 conn(0x7f610c069130 msgr2=0x7f610c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:35.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.788+0000 7f611179d700 1 -- 172.21.15.60:0/3990803955 shutdown_connections 2023-10-06T04:28:35.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.788+0000 7f611179d700 1 -- 172.21.15.60:0/3990803955 wait complete. 2023-10-06T04:28:35.791 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 9 2023-10-06T04:28:35.808 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:28:35.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.991+0000 7f8991f9d700 1 Processor -- start 2023-10-06T04:28:35.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.992+0000 7f8991f9d700 1 -- start start 2023-10-06T04:28:35.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.993+0000 7f8991f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f898c0688e0 0x7f898c0cb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:35.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.993+0000 7f8991f9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f898c068cb0 0x7f898c15dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:35.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.993+0000 7f8991f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f898c0c74a0 con 0x7f898c0c6cc0 2023-10-06T04:28:35.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.993+0000 7f8991f9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898c0cacb0 con 0x7f898c068cb0 2023-10-06T04:28:35.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.993+0000 7f8991f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898c15a7b0 con 0x7f898c0688e0 2023-10-06T04:28:35.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.993+0000 7f898bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f898c068cb0 0x7f898c15dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:35.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.993+0000 7f898bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f898c068cb0 0x7f898c15dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38448/0 (socket says 172.21.15.60:38448) 2023-10-06T04:28:35.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.993+0000 7f898bfff700 1 -- 172.21.15.60:0/437896971 learned_addr learned my addr 172.21.15.60:0/437896971 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:35.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.993+0000 7f8990f9b700 1 --2- 172.21.15.60:0/437896971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f898c0688e0 0x7f898c0cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:35.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.994+0000 7f898bfff700 1 -- 172.21.15.60:0/437896971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f898c0688e0 msgr2=0x7f898c0cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:35.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.994+0000 7f898bfff700 1 --2- 172.21.15.60:0/437896971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f898c0688e0 0x7f898c0cb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.994+0000 7f898bfff700 1 -- 172.21.15.60:0/437896971 >> v1:172.21.15.135:6789/0 conn(0x7f898c0c6cc0 legacy=0x7f898c0cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:35.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.994+0000 7f898bfff700 1 -- 172.21.15.60:0/437896971 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c0ca380 con 0x7f898c068cb0 2023-10-06T04:28:35.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.994+0000 7f8990f9b700 1 --2- 172.21.15.60:0/437896971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f898c0688e0 0x7f898c0cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:35.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.994+0000 7f898bfff700 1 --2- 172.21.15.60:0/437896971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f898c068cb0 0x7f898c15dab0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f89780099b0 tx=0x7f8978009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecd265941edf827 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:35.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.994+0000 7f898b7fe700 1 -- 172.21.15.60:0/437896971 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897800b860 con 0x7f898c068cb0 2023-10-06T04:28:35.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.994+0000 7f898b7fe700 1 -- 172.21.15.60:0/437896971 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897800b9c0 con 0x7f898c068cb0 2023-10-06T04:28:35.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.994+0000 7f898b7fe700 1 -- 172.21.15.60:0/437896971 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897800bd60 con 0x7f898c068cb0 2023-10-06T04:28:35.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.995+0000 7f8991f9d700 1 -- 172.21.15.60:0/437896971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f898c068cb0 msgr2=0x7f898c15dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:35.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.995+0000 7f8991f9d700 1 --2- 172.21.15.60:0/437896971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f898c068cb0 0x7f898c15dab0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f89780099b0 tx=0x7f8978009250 comp rx=0 tx=0).stop 2023-10-06T04:28:35.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.995+0000 7f8991f9d700 1 -- 172.21.15.60:0/437896971 shutdown_connections 2023-10-06T04:28:35.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.995+0000 7f8991f9d700 1 --2- 172.21.15.60:0/437896971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f898c0688e0 0x7f898c0cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.995+0000 7f8991f9d700 1 --2- 172.21.15.60:0/437896971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f898c068cb0 0x7f898c15dab0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:35.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.995+0000 7f8991f9d700 1 -- 172.21.15.60:0/437896971 >> 172.21.15.60:0/437896971 conn(0x7f898c0cd1f0 msgr2=0x7f898c0c9190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:35.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.995+0000 7f8991f9d700 1 -- 172.21.15.60:0/437896971 shutdown_connections 2023-10-06T04:28:35.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.995+0000 7f8991f9d700 1 -- 172.21.15.60:0/437896971 wait complete. 2023-10-06T04:28:36.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.996+0000 7f8991f9d700 1 Processor -- start 2023-10-06T04:28:36.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.997+0000 7f8991f9d700 1 -- start start 2023-10-06T04:28:36.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.998+0000 7f8991f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f898c0688e0 0x7f898c15f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:36.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.998+0000 7f8991f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f898c068cb0 0x7f898c150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:36.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.998+0000 7f8991f9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f898c0c6cc0 0x7f898c0a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:36.001 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.998+0000 7f8991f9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c15ed00 con 0x7f898c0c6cc0 2023-10-06T04:28:36.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.998+0000 7f8991f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c15e0f0 con 0x7f898c068cb0 2023-10-06T04:28:36.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.998+0000 7f8991f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898c15e3d0 con 0x7f898c0688e0 2023-10-06T04:28:36.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.998+0000 7f899179c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f898c0c6cc0 0x7f898c0a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:36.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.998+0000 7f899179c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f898c0c6cc0 0x7f898c0a98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38454/0 (socket says 172.21.15.60:38454) 2023-10-06T04:28:36.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.998+0000 7f899179c700 1 -- 172.21.15.60:0/1227172809 learned_addr learned my addr 172.21.15.60:0/1227172809 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:36.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.998+0000 7f8990f9b700 1 --2- 172.21.15.60:0/1227172809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f898c0688e0 0x7f898c15f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:36.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.998+0000 7f898bfff700 1 --2- 172.21.15.60:0/1227172809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f898c068cb0 0x7f898c150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:36.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.998+0000 7f899179c700 1 -- 172.21.15.60:0/1227172809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f898c0688e0 msgr2=0x7f898c15f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:36.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.998+0000 7f899179c700 1 --2- 172.21.15.60:0/1227172809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f898c0688e0 0x7f898c15f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:36.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.998+0000 7f899179c700 1 -- 172.21.15.60:0/1227172809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f898c068cb0 msgr2=0x7f898c150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:36.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.998+0000 7f899179c700 1 --2- 172.21.15.60:0/1227172809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f898c068cb0 0x7f898c150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:36.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.998+0000 7f899179c700 1 -- 172.21.15.60:0/1227172809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89780094f0 con 0x7f898c0c6cc0 2023-10-06T04:28:36.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.999+0000 7f899179c700 1 --2- 172.21.15.60:0/1227172809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f898c0c6cc0 0x7f898c0a98b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f898400c8e0 tx=0x7f8984001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:36.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.999+0000 7f8988ff9700 1 -- 172.21.15.60:0/1227172809 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8984012630 con 0x7f898c0c6cc0 2023-10-06T04:28:36.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.999+0000 7f8988ff9700 1 -- 172.21.15.60:0/1227172809 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8984012790 con 0x7f898c0c6cc0 2023-10-06T04:28:36.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.999+0000 7f8988ff9700 1 -- 172.21.15.60:0/1227172809 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8984012b50 con 0x7f898c0c6cc0 2023-10-06T04:28:36.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.999+0000 7f8991f9d700 1 -- 172.21.15.60:0/1227172809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f898c15e6b0 con 0x7f898c0c6cc0 2023-10-06T04:28:36.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:35.999+0000 7f8991f9d700 1 -- 172.21.15.60:0/1227172809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898c15fdf0 con 0x7f898c0c6cc0 2023-10-06T04:28:36.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.000+0000 7f8991f9d700 1 -- 172.21.15.60:0/1227172809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898c15ee70 con 0x7f898c0c6cc0 2023-10-06T04:28:36.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.001+0000 7f8988ff9700 1 -- 172.21.15.60:0/1227172809 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f898401a3a0 con 0x7f898c0c6cc0 2023-10-06T04:28:36.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.002+0000 7f8988ff9700 1 --2- 172.21.15.60:0/1227172809 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8970066f30 0x7f89700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:36.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.002+0000 7f8988ff9700 1 -- 172.21.15.60:0/1227172809 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8984084b90 con 0x7f898c0c6cc0 2023-10-06T04:28:36.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.002+0000 7f8990f9b700 1 --2- 172.21.15.60:0/1227172809 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8970066f30 0x7f89700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:36.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.003+0000 7f8990f9b700 1 --2- 172.21.15.60:0/1227172809 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8970066f30 0x7f89700693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8980006f00 tx=0x7f8980008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:36.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.006+0000 7f8988ff9700 1 -- 172.21.15.60:0/1227172809 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8984051910 con 0x7f898c0c6cc0 2023-10-06T04:28:36.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.208+0000 7f8991f9d700 1 -- 172.21.15.60:0/1227172809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f898c05f230 con 0x7f898c0c6cc0 2023-10-06T04:28:36.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.209+0000 7f8988ff9700 1 -- 172.21.15.60:0/1227172809 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f8984054f30 con 0x7f898c0c6cc0 2023-10-06T04:28:36.213 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:36.213 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:28:11.290557+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:28:04.355358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:28:05.208550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:28:08.791979+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:28:36.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.212+0000 7f8991f9d700 1 -- 172.21.15.60:0/1227172809 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8970066f30 msgr2=0x7f89700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.212+0000 7f8991f9d700 1 --2- 172.21.15.60:0/1227172809 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8970066f30 0x7f89700693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8980006f00 tx=0x7f8980008040 comp rx=0 tx=0).stop 2023-10-06T04:28:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.212+0000 7f8991f9d700 1 -- 172.21.15.60:0/1227172809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f898c0c6cc0 msgr2=0x7f898c0a98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.212+0000 7f8991f9d700 1 --2- 172.21.15.60:0/1227172809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f898c0c6cc0 0x7f898c0a98b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f898400c8e0 tx=0x7f8984001710 comp rx=0 tx=0).stop 2023-10-06T04:28:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.212+0000 7f8991f9d700 1 -- 172.21.15.60:0/1227172809 shutdown_connections 2023-10-06T04:28:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.212+0000 7f8991f9d700 1 --2- 172.21.15.60:0/1227172809 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8970066f30 0x7f89700693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.212+0000 7f8991f9d700 1 --2- 172.21.15.60:0/1227172809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f898c0c6cc0 0x7f898c0a98b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.212+0000 7f8991f9d700 1 --2- 172.21.15.60:0/1227172809 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f898c0688e0 0x7f898c15f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.212+0000 7f8991f9d700 1 --2- 172.21.15.60:0/1227172809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f898c068cb0 0x7f898c150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.212+0000 7f8991f9d700 1 -- 172.21.15.60:0/1227172809 >> 172.21.15.60:0/1227172809 conn(0x7f898c0cd1f0 msgr2=0x7f898c0aad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.212+0000 7f8991f9d700 1 -- 172.21.15.60:0/1227172809 shutdown_connections 2023-10-06T04:28:36.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.212+0000 7f8991f9d700 1 -- 172.21.15.60:0/1227172809 wait complete. 2023-10-06T04:28:36.232 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:28:36.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.418+0000 7f821ad9d700 1 Processor -- start 2023-10-06T04:28:36.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.418+0000 7f821ad9d700 1 -- start start 2023-10-06T04:28:36.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.420+0000 7f821ad9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82140cbc30 0x7f82140cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:36.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.420+0000 7f821ad9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f82140b2100 0x7f82140b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:36.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.420+0000 7f821ad9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82140cb7a0 con 0x7f8214159440 2023-10-06T04:28:36.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.420+0000 7f821ad9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82140b0860 con 0x7f82140b2100 2023-10-06T04:28:36.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.420+0000 7f821ad9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82140cb150 con 0x7f82140cbc30 2023-10-06T04:28:36.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.420+0000 7f821a59c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f82140b2100 0x7f82140b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:36.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.420+0000 7f821959a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82140cbc30 0x7f82140cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:36.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.420+0000 7f821959a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82140cbc30 0x7f82140cc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:34994/0 (socket says 172.21.15.60:34994) 2023-10-06T04:28:36.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.420+0000 7f8219d9b700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f8214159440 0x7f82140b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.60:59314/0 (socket says 172.21.15.60:59314) 2023-10-06T04:28:36.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.420+0000 7f821959a700 1 -- 172.21.15.60:0/3026761777 learned_addr learned my addr 172.21.15.60:0/3026761777 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:36.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.420+0000 7f821a59c700 1 --2- 172.21.15.60:0/3026761777 >> v2:172.21.15.135:3300/0 conn(0x7f82140b2100 0x7f82140b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:51380/0 (socket says 172.21.15.60:51380) 2023-10-06T04:28:36.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.421+0000 7f8218d99700 1 -- 172.21.15.60:0/3026761777 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905099203 0 0) 0x7f82140cb7a0 con 0x7f8214159440 2023-10-06T04:28:36.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.421+0000 7f8218d99700 1 -- 172.21.15.60:0/3026761777 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8200003570 con 0x7f8214159440 2023-10-06T04:28:36.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.421+0000 7f821959a700 1 -- 172.21.15.60:0/3026761777 >> v2:172.21.15.135:3300/0 conn(0x7f82140b2100 msgr2=0x7f82140b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:36.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.421+0000 7f821959a700 1 --2- 172.21.15.60:0/3026761777 >> v2:172.21.15.135:3300/0 conn(0x7f82140b2100 0x7f82140b2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:36.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.421+0000 7f821959a700 1 -- 172.21.15.60:0/3026761777 >> v1:172.21.15.135:6789/0 conn(0x7f8214159440 legacy=0x7f82140b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:36.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.421+0000 7f821959a700 1 -- 172.21.15.60:0/3026761777 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82140cb430 con 0x7f82140cbc30 2023-10-06T04:28:36.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.421+0000 7f821959a700 1 --2- 172.21.15.60:0/3026761777 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82140cbc30 0x7f82140cc080 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f82040099b0 tx=0x7f8204009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a848ea95f5214b2b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:36.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.421+0000 7f8218d99700 1 -- 172.21.15.60:0/3026761777 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820400b680 con 0x7f82140cbc30 2023-10-06T04:28:36.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.421+0000 7f8218d99700 1 -- 172.21.15.60:0/3026761777 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820400b7e0 con 0x7f82140cbc30 2023-10-06T04:28:36.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.421+0000 7f8218d99700 1 -- 172.21.15.60:0/3026761777 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820400bb80 con 0x7f82140cbc30 2023-10-06T04:28:36.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.422+0000 7f821ad9d700 1 -- 172.21.15.60:0/3026761777 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82140cbc30 msgr2=0x7f82140cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:36.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.422+0000 7f821ad9d700 1 --2- 172.21.15.60:0/3026761777 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82140cbc30 0x7f82140cc080 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f82040099b0 tx=0x7f8204009250 comp rx=0 tx=0).stop 2023-10-06T04:28:36.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.422+0000 7f821ad9d700 1 -- 172.21.15.60:0/3026761777 shutdown_connections 2023-10-06T04:28:36.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.422+0000 7f821ad9d700 1 --2- 172.21.15.60:0/3026761777 >> v2:172.21.15.135:3300/0 conn(0x7f82140b2100 0x7f82140b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:36.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.422+0000 7f821ad9d700 1 --2- 172.21.15.60:0/3026761777 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82140cbc30 0x7f82140cc080 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:36.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.422+0000 7f821ad9d700 1 -- 172.21.15.60:0/3026761777 >> 172.21.15.60:0/3026761777 conn(0x7f821406ece0 msgr2=0x7f821406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:36.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.422+0000 7f821ad9d700 1 -- 172.21.15.60:0/3026761777 shutdown_connections 2023-10-06T04:28:36.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.422+0000 7f821ad9d700 1 -- 172.21.15.60:0/3026761777 wait complete. 2023-10-06T04:28:36.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.423+0000 7f821ad9d700 1 Processor -- start 2023-10-06T04:28:36.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.424+0000 7f821ad9d700 1 -- start start 2023-10-06T04:28:36.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.424+0000 7f821ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82140b2100 0x7f82140d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:36.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.424+0000 7f821ad9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82140cbc30 0x7f82140ce800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:36.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.424+0000 7f821ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8214159440 0x7f8214157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:36.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.424+0000 7f821ad9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82140c84d0 con 0x7f8214159440 2023-10-06T04:28:36.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.424+0000 7f821ad9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82140c78c0 con 0x7f82140b2100 2023-10-06T04:28:36.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.425+0000 7f821ad9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82140c7ba0 con 0x7f82140cbc30 2023-10-06T04:28:36.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.425+0000 7f821a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8214159440 0x7f8214157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:36.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.425+0000 7f821a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8214159440 0x7f8214157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38468/0 (socket says 172.21.15.60:38468) 2023-10-06T04:28:36.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.425+0000 7f821a59c700 1 -- 172.21.15.60:0/298976549 learned_addr learned my addr 172.21.15.60:0/298976549 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:36.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.425+0000 7f821959a700 1 --2- 172.21.15.60:0/298976549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82140cbc30 0x7f82140ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:36.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.425+0000 7f8219d9b700 1 --2- 172.21.15.60:0/298976549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82140b2100 0x7f82140d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:36.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.425+0000 7f821a59c700 1 -- 172.21.15.60:0/298976549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82140cbc30 msgr2=0x7f82140ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:36.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.425+0000 7f821a59c700 1 --2- 172.21.15.60:0/298976549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82140cbc30 0x7f82140ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:36.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.425+0000 7f821a59c700 1 -- 172.21.15.60:0/298976549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82140b2100 msgr2=0x7f82140d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:36.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.425+0000 7f821a59c700 1 --2- 172.21.15.60:0/298976549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82140b2100 0x7f82140d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:36.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.425+0000 7f821a59c700 1 -- 172.21.15.60:0/298976549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82040094f0 con 0x7f8214159440 2023-10-06T04:28:36.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.426+0000 7f821a59c700 1 --2- 172.21.15.60:0/298976549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8214159440 0x7f8214157630 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f820c009e90 tx=0x7f820c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:36.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.426+0000 7f8209ffb700 1 -- 172.21.15.60:0/298976549 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c00cb70 con 0x7f8214159440 2023-10-06T04:28:36.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.426+0000 7f8209ffb700 1 -- 172.21.15.60:0/298976549 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c00f040 con 0x7f8214159440 2023-10-06T04:28:36.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.426+0000 7f8209ffb700 1 -- 172.21.15.60:0/298976549 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c014480 con 0x7f8214159440 2023-10-06T04:28:36.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.426+0000 7f821ad9d700 1 -- 172.21.15.60:0/298976549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82140c7e80 con 0x7f8214159440 2023-10-06T04:28:36.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.426+0000 7f821ad9d700 1 -- 172.21.15.60:0/298976549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82140c8960 con 0x7f8214159440 2023-10-06T04:28:36.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.427+0000 7f821ad9d700 1 -- 172.21.15.60:0/298976549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821405f230 con 0x7f8214159440 2023-10-06T04:28:36.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.428+0000 7f8209ffb700 1 -- 172.21.15.60:0/298976549 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f820c014830 con 0x7f8214159440 2023-10-06T04:28:36.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.429+0000 7f8209ffb700 1 --2- 172.21.15.60:0/298976549 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f81f8066f30 0x7f81f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:36.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.429+0000 7f8209ffb700 1 -- 172.21.15.60:0/298976549 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f820c0853f0 con 0x7f8214159440 2023-10-06T04:28:36.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.429+0000 7f8219d9b700 1 --2- 172.21.15.60:0/298976549 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f81f8066f30 0x7f81f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:36.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.430+0000 7f8219d9b700 1 --2- 172.21.15.60:0/298976549 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f81f8066f30 0x7f81f80693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8210004f70 tx=0x7f8210007d40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:36.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.434+0000 7f8209ffb700 1 -- 172.21.15.60:0/298976549 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f820c052170 con 0x7f8214159440 2023-10-06T04:28:36.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.680+0000 7f821ad9d700 1 -- 172.21.15.60:0/298976549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82140b2ac0 con 0x7f8214159440 2023-10-06T04:28:36.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.680+0000 7f8209ffb700 1 -- 172.21.15.60:0/298976549 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f820c055790 con 0x7f8214159440 2023-10-06T04:28:36.683 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:36.683 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3950892589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3950892589},{"type":"v1","addr":"172.21.15.60:6837","nonce":3950892589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1381681252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1381681252},{"type":"v1","addr":"172.21.15.135:6834","nonce":1381681252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1306947344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1306947344},{"type":"v1","addr":"172.21.15.135:6835","nonce":1306947344}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:28:06.242656+0000","modified":"2023-10-06T04:28:23.340411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/1424722915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1424722915},{"type":"v1","addr":"172.21.15.60:6836","nonce":1424722915}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:28:36.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.683+0000 7f821ad9d700 1 -- 172.21.15.60:0/298976549 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f81f8066f30 msgr2=0x7f81f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:36.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.683+0000 7f821ad9d700 1 --2- 172.21.15.60:0/298976549 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f81f8066f30 0x7f81f80693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8210004f70 tx=0x7f8210007d40 comp rx=0 tx=0).stop 2023-10-06T04:28:36.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.683+0000 7f821ad9d700 1 -- 172.21.15.60:0/298976549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8214159440 msgr2=0x7f8214157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:36.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.683+0000 7f821ad9d700 1 --2- 172.21.15.60:0/298976549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8214159440 0x7f8214157630 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f820c009e90 tx=0x7f820c00b040 comp rx=0 tx=0).stop 2023-10-06T04:28:36.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.683+0000 7f821ad9d700 1 -- 172.21.15.60:0/298976549 shutdown_connections 2023-10-06T04:28:36.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.683+0000 7f821ad9d700 1 --2- 172.21.15.60:0/298976549 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f81f8066f30 0x7f81f80693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:36.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.683+0000 7f821ad9d700 1 --2- 172.21.15.60:0/298976549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8214159440 0x7f8214157630 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:36.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.683+0000 7f821ad9d700 1 --2- 172.21.15.60:0/298976549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82140b2100 0x7f82140d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:36.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.683+0000 7f821ad9d700 1 --2- 172.21.15.60:0/298976549 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f82140cbc30 0x7f82140ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:36.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.683+0000 7f821ad9d700 1 -- 172.21.15.60:0/298976549 >> 172.21.15.60:0/298976549 conn(0x7f821406ece0 msgr2=0x7f8214155c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:36.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.683+0000 7f821ad9d700 1 -- 172.21.15.60:0/298976549 shutdown_connections 2023-10-06T04:28:36.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:36.683+0000 7f821ad9d700 1 -- 172.21.15.60:0/298976549 wait complete. 2023-10-06T04:28:36.687 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 9 2023-10-06T04:28:37.105 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:28:06.242656+0000', 'modified': '2023-10-06T04:28:23.340411+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6836/1424722915', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6834', 'nonce': 1424722915}, {'type': 'v1', 'addr': '172.21.15.60:6836', 'nonce': 1424722915}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:28:37.105 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:28:37.106 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T04:28:37.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.294+0000 7fa0be59d700 1 Processor -- start 2023-10-06T04:28:37.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.294+0000 7fa0be59d700 1 -- start start 2023-10-06T04:28:37.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.295+0000 7fa0be59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0b8159440 0x7fa0b80b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:37.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.295+0000 7fa0be59d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b80cb7a0 con 0x7fa0b80b35d0 2023-10-06T04:28:37.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.295+0000 7fa0be59d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b80b0860 con 0x7fa0b80b2100 2023-10-06T04:28:37.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.295+0000 7fa0be59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b80cb150 con 0x7fa0b8159440 2023-10-06T04:28:37.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.296+0000 7fa0bcd9a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa0b80b35d0 0x7fa0b80cbc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44036/0 (socket says 172.21.15.60:44036) 2023-10-06T04:28:37.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.296+0000 7fa0bcd9a700 1 -- 172.21.15.60:0/2361747096 learned_addr learned my addr 172.21.15.60:0/2361747096 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:37.298 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.296+0000 7fa0bd59b700 1 --2- 172.21.15.60:0/2361747096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0b8159440 0x7fa0b80b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:37.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.296+0000 7fa0affff700 1 -- 172.21.15.60:0/2361747096 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485756747 0 0) 0x7fa0b80cb7a0 con 0x7fa0b80b35d0 2023-10-06T04:28:37.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.296+0000 7fa0affff700 1 -- 172.21.15.60:0/2361747096 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0a4003570 con 0x7fa0b80b35d0 2023-10-06T04:28:37.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.296+0000 7fa0affff700 1 -- 172.21.15.60:0/2361747096 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919193358 0 0) 0x7fa0b80b0860 con 0x7fa0b80b2100 2023-10-06T04:28:37.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.296+0000 7fa0bd59b700 1 -- 172.21.15.60:0/2361747096 >> v1:172.21.15.135:6789/0 conn(0x7fa0b80b2100 legacy=0x7fa0b80b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:37.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.296+0000 7fa0bd59b700 1 -- 172.21.15.60:0/2361747096 >> v1:172.21.15.60:6789/0 conn(0x7fa0b80b35d0 legacy=0x7fa0b80cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:37.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.296+0000 7fa0bd59b700 1 -- 172.21.15.60:0/2361747096 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b80cb430 con 0x7fa0b8159440 2023-10-06T04:28:37.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.297+0000 7fa0bd59b700 1 --2- 172.21.15.60:0/2361747096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0b8159440 0x7fa0b80b3090 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009910 tx=0x7fa0b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3dc0d417868154c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:37.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.297+0000 7fa0affff700 1 -- 172.21.15.60:0/2361747096 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b400b680 con 0x7fa0b8159440 2023-10-06T04:28:37.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.297+0000 7fa0affff700 1 -- 172.21.15.60:0/2361747096 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b400b7e0 con 0x7fa0b8159440 2023-10-06T04:28:37.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.297+0000 7fa0affff700 1 -- 172.21.15.60:0/2361747096 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b400bba0 con 0x7fa0b8159440 2023-10-06T04:28:37.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.297+0000 7fa0be59d700 1 -- 172.21.15.60:0/2361747096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0b8159440 msgr2=0x7fa0b80b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:37.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.297+0000 7fa0be59d700 1 --2- 172.21.15.60:0/2361747096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0b8159440 0x7fa0b80b3090 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009910 tx=0x7fa0b40091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.297+0000 7fa0be59d700 1 -- 172.21.15.60:0/2361747096 shutdown_connections 2023-10-06T04:28:37.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.297+0000 7fa0be59d700 1 --2- 172.21.15.60:0/2361747096 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0b8159440 0x7fa0b80b3090 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.297+0000 7fa0be59d700 1 -- 172.21.15.60:0/2361747096 >> 172.21.15.60:0/2361747096 conn(0x7fa0b806ece0 msgr2=0x7fa0b806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:37.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.298+0000 7fa0be59d700 1 -- 172.21.15.60:0/2361747096 shutdown_connections 2023-10-06T04:28:37.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.298+0000 7fa0be59d700 1 -- 172.21.15.60:0/2361747096 wait complete. 2023-10-06T04:28:37.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.299+0000 7fa0be59d700 1 Processor -- start 2023-10-06T04:28:37.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.299+0000 7fa0be59d700 1 -- start start 2023-10-06T04:28:37.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.300+0000 7fa0be59d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0b80b2100 0x7fa0b80cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:37.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.300+0000 7fa0be59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0b80b35d0 0x7fa0b81549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:37.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.300+0000 7fa0be59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b8159440 0x7fa0b815a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:37.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.300+0000 7fa0be59d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b815a9d0 con 0x7fa0b80b2100 2023-10-06T04:28:37.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.300+0000 7fa0be59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b815aca0 con 0x7fa0b8159440 2023-10-06T04:28:37.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.300+0000 7fa0be59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b815af80 con 0x7fa0b80b35d0 2023-10-06T04:28:37.304 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.300+0000 7fa0bd59b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0b80b2100 0x7fa0b80cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.300+0000 7fa0bd59b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0b80b2100 0x7fa0b80cfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38484/0 (socket says 172.21.15.60:38484) 2023-10-06T04:28:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.300+0000 7fa0bd59b700 1 -- 172.21.15.60:0/2585208471 learned_addr learned my addr 172.21.15.60:0/2585208471 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.300+0000 7fa0bdd9c700 1 --2- 172.21.15.60:0/2585208471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b8159440 0x7fa0b815a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.300+0000 7fa0bcd9a700 1 --2- 172.21.15.60:0/2585208471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0b80b35d0 0x7fa0b81549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.300+0000 7fa0bd59b700 1 -- 172.21.15.60:0/2585208471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0b80b35d0 msgr2=0x7fa0b81549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.301+0000 7fa0bd59b700 1 --2- 172.21.15.60:0/2585208471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0b80b35d0 0x7fa0b81549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.301+0000 7fa0bd59b700 1 -- 172.21.15.60:0/2585208471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b8159440 msgr2=0x7fa0b815a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.301+0000 7fa0bd59b700 1 --2- 172.21.15.60:0/2585208471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b8159440 0x7fa0b815a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.301+0000 7fa0bd59b700 1 -- 172.21.15.60:0/2585208471 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b4009420 con 0x7fa0b80b2100 2023-10-06T04:28:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.301+0000 7fa0bd59b700 1 --2- 172.21.15.60:0/2585208471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0b80b2100 0x7fa0b80cfc20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8069150 tx=0x7fa0b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.301+0000 7fa0ad7fa700 1 -- 172.21.15.60:0/2585208471 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4006ad0 con 0x7fa0b80b2100 2023-10-06T04:28:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.301+0000 7fa0ad7fa700 1 -- 172.21.15.60:0/2585208471 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b400bb60 con 0x7fa0b80b2100 2023-10-06T04:28:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.301+0000 7fa0ad7fa700 1 -- 172.21.15.60:0/2585208471 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40276a0 con 0x7fa0b80b2100 2023-10-06T04:28:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.301+0000 7fa0be59d700 1 -- 172.21.15.60:0/2585208471 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b815b260 con 0x7fa0b80b2100 2023-10-06T04:28:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.301+0000 7fa0be59d700 1 -- 172.21.15.60:0/2585208471 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b81553f0 con 0x7fa0b80b2100 2023-10-06T04:28:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.303+0000 7fa0ad7fa700 1 -- 172.21.15.60:0/2585208471 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa0b4027ad0 con 0x7fa0b80b2100 2023-10-06T04:28:37.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.304+0000 7fa0ad7fa700 1 --2- 172.21.15.60:0/2585208471 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa09c066f30 0x7fa09c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:37.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.304+0000 7fa0ad7fa700 1 -- 172.21.15.60:0/2585208471 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa0b40868f0 con 0x7fa0b80b2100 2023-10-06T04:28:37.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.304+0000 7fa0bcd9a700 1 --2- 172.21.15.60:0/2585208471 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa09c066f30 0x7fa09c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:37.307 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.305+0000 7fa0bcd9a700 1 --2- 172.21.15.60:0/2585208471 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa09c066f30 0x7fa09c0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa0b815cef0 tx=0x7fa0a8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:37.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.306+0000 7fa0cdfc4b80 1 Processor -- start 2023-10-06T04:28:37.308 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.306+0000 7fa0cdfc4b80 1 -- start start 2023-10-06T04:28:37.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.307+0000 7fa0cdfc4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 0x55b22ad53d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:37.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.307+0000 7fa0cdfc4b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad9dbc0 0x55b22ad7c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:37.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.307+0000 7fa0cdfc4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad7ce60 0x55b22ad4f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:37.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.307+0000 7fa0cdfc4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b22acd3c80 con 0x55b22ad53950 2023-10-06T04:28:37.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.307+0000 7fa0cdfc4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b22acaaa70 con 0x55b22ad7ce60 2023-10-06T04:28:37.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.307+0000 7fa0cdfc4b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b22aca8270 con 0x55b22ad9dbc0 2023-10-06T04:28:37.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.307+0000 7fa0bd59b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 0x55b22ad53d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:37.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.307+0000 7fa0bd59b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 0x55b22ad53d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38496/0 (socket says 172.21.15.60:38496) 2023-10-06T04:28:37.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.307+0000 7fa0bd59b700 1 -- 172.21.15.60:0/2113026569 learned_addr learned my addr 172.21.15.60:0/2113026569 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:37.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.307+0000 7fa0bcd9a700 1 --2- 172.21.15.60:0/2113026569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad9dbc0 0x55b22ad7c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:37.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.307+0000 7fa0bdd9c700 1 --2- 172.21.15.60:0/2113026569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad7ce60 0x55b22ad4f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:37.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.308+0000 7fa0bd59b700 1 -- 172.21.15.60:0/2113026569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad9dbc0 msgr2=0x55b22ad7c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:37.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.308+0000 7fa0bd59b700 1 --2- 172.21.15.60:0/2113026569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad9dbc0 0x55b22ad7c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.308+0000 7fa0bd59b700 1 -- 172.21.15.60:0/2113026569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad7ce60 msgr2=0x55b22ad4f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:37.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.308+0000 7fa0bd59b700 1 --2- 172.21.15.60:0/2113026569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad7ce60 0x55b22ad4f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.308+0000 7fa0bd59b700 1 -- 172.21.15.60:0/2113026569 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b22ab3e270 con 0x55b22ad53950 2023-10-06T04:28:37.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.308+0000 7fa0bd59b700 1 --2- 172.21.15.60:0/2113026569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 0x55b22ad53d20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40570b0 tx=0x7fa0b4084880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9835436040e24311 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:37.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.308+0000 7fa0a27fc700 1 -- 172.21.15.60:0/2113026569 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40573b0 con 0x55b22ad53950 2023-10-06T04:28:37.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.308+0000 7fa0a27fc700 1 -- 172.21.15.60:0/2113026569 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b405a600 con 0x55b22ad53950 2023-10-06T04:28:37.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.308+0000 7fa0a27fc700 1 -- 172.21.15.60:0/2113026569 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b405e350 con 0x55b22ad53950 2023-10-06T04:28:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.309+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/2113026569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 msgr2=0x55b22ad53d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.309+0000 7fa0cdfc4b80 1 --2- 172.21.15.60:0/2113026569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 0x55b22ad53d20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40570b0 tx=0x7fa0b4084880 comp rx=0 tx=0).stop 2023-10-06T04:28:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.309+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/2113026569 shutdown_connections 2023-10-06T04:28:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.309+0000 7fa0cdfc4b80 1 --2- 172.21.15.60:0/2113026569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 0x55b22ad53d20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.309+0000 7fa0cdfc4b80 1 --2- 172.21.15.60:0/2113026569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad7ce60 0x55b22ad4f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.309+0000 7fa0cdfc4b80 1 --2- 172.21.15.60:0/2113026569 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad9dbc0 0x55b22ad7c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.309+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/2113026569 >> 172.21.15.60:0/2113026569 conn(0x55b22ad55270 msgr2=0x55b22ad55640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.309+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/2113026569 shutdown_connections 2023-10-06T04:28:37.317 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.309+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/2113026569 wait complete. 2023-10-06T04:28:37.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.310+0000 7fa0cdfc4b80 1 -- start start 2023-10-06T04:28:37.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.310+0000 7fa0cdfc4b80 1 Processor -- start 2023-10-06T04:28:37.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.311+0000 7fa0cdfc4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 0x55b22ad97c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:37.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.311+0000 7fa0cdfc4b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad7ce60 0x55b22ad79340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:37.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.311+0000 7fa0cdfc4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad9dbc0 0x55b22ad7b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:37.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.311+0000 7fa0cdfc4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b22aca4060 con 0x55b22ad53950 2023-10-06T04:28:37.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.311+0000 7fa0cdfc4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b22ac4f890 con 0x55b22ad9dbc0 2023-10-06T04:28:37.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.311+0000 7fa0cdfc4b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b22ac6aea0 con 0x55b22ad7ce60 2023-10-06T04:28:37.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.311+0000 7fa0cdfc4b80 10 client.0 _ll_register_callbacks cb 0x55b22ab40f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:28:37.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.311+0000 7fa0bd59b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 0x55b22ad97c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:37.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.311+0000 7fa0bd59b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 0x55b22ad97c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38500/0 (socket says 172.21.15.60:38500) 2023-10-06T04:28:37.319 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.311+0000 7fa0bd59b700 1 -- 172.21.15.60:0/400877983 learned_addr learned my addr 172.21.15.60:0/400877983 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.311+0000 7fa0bdd9c700 1 --2- 172.21.15.60:0/400877983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad9dbc0 0x55b22ad7b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.311+0000 7fa0bcd9a700 1 --2- 172.21.15.60:0/400877983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad7ce60 0x55b22ad79340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.311+0000 7fa0bd59b700 1 -- 172.21.15.60:0/400877983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad7ce60 msgr2=0x55b22ad79340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.311+0000 7fa0bd59b700 1 --2- 172.21.15.60:0/400877983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad7ce60 0x55b22ad79340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.311+0000 7fa0bd59b700 1 -- 172.21.15.60:0/400877983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad9dbc0 msgr2=0x55b22ad7b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.311+0000 7fa0bd59b700 1 --2- 172.21.15.60:0/400877983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad9dbc0 0x55b22ad7b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.311+0000 7fa0bd59b700 1 -- 172.21.15.60:0/400877983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b81553f0 con 0x55b22ad53950 2023-10-06T04:28:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.311+0000 7fa0bcd9a700 1 --2- 172.21.15.60:0/400877983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad7ce60 0x55b22ad79340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.312+0000 7fa0bd59b700 1 --2- 172.21.15.60:0/400877983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 0x55b22ad97c50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009fb0 tx=0x7fa0b406b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaab9b80a63070e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.312+0000 7fa0977fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-06T04:28:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.312+0000 7fa0977fe700 1 -- 172.21.15.60:0/400877983 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4062070 con 0x55b22ad53950 2023-10-06T04:28:37.320 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.312+0000 7fa0977fe700 1 -- 172.21.15.60:0/400877983 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa0b4000c40 con 0x55b22ad53950 2023-10-06T04:28:37.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.312+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/400877983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b22ad48690 con 0x55b22ad53950 2023-10-06T04:28:37.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.312+0000 7fa0977fe700 1 -- 172.21.15.60:0/400877983 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0b40568a0 con 0x55b22ad53950 2023-10-06T04:28:37.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.312+0000 7fa0cdfc4b80 10 client.4737 fetch_fsmap learned FSMap version 9 2023-10-06T04:28:37.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.312+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/400877983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55b22aae0fe0 con 0x55b22ad53950 2023-10-06T04:28:37.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.312+0000 7fa0977fe700 1 -- 172.21.15.60:0/400877983 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b22ad48690 con 0x55b22ad53950 2023-10-06T04:28:37.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.312+0000 7fa0977fe700 1 -- 172.21.15.60:0/400877983 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fa0b405dec0 con 0x55b22ad53950 2023-10-06T04:28:37.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.312+0000 7fa0cdfc4b80 10 client.4737 fetch_fsmap finished waiting for FSMap version 9 2023-10-06T04:28:37.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.312+0000 7fa0cdfc4b80 10 client.4737 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T04:28:37.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.312+0000 7fa0cdfc4b80 20 client.4737 populate_metadata read hostname 'smithi060' 2023-10-06T04:28:37.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.313+0000 7fa0cdfc4b80 1 --2- 172.21.15.60:0/400877983 >> [v2:172.21.15.60:6834/1424722915,v1:172.21.15.60:6836/1424722915] conn(0x55b22adad600 0x55b22adad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:37.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.313+0000 7fa0cdfc4b80 4 client.4737 mds_command: new command op to 4281 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:28:37.321 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.313+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/400877983 --> [v2:172.21.15.60:6834/1424722915,v1:172.21.15.60:6836/1424722915] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b22ad255c0 con 0x55b22adad600 2023-10-06T04:28:37.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.313+0000 7fa0bcd9a700 1 --2- 172.21.15.60:0/400877983 >> [v2:172.21.15.60:6834/1424722915,v1:172.21.15.60:6836/1424722915] conn(0x55b22adad600 0x55b22adad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:37.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.313+0000 7fa0bcd9a700 1 --2- 172.21.15.60:0/400877983 >> [v2:172.21.15.60:6834/1424722915,v1:172.21.15.60:6836/1424722915] conn(0x55b22adad600 0x55b22adad9d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2f68ade44567285 server_cookie=8c9843d50ebbf654 in_seq=0 out_seq=0 2023-10-06T04:28:37.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.313+0000 7fa0977fe700 10 client.4737 ms_handle_connect on v2:172.21.15.60:6834/1424722915 2023-10-06T04:28:37.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.314+0000 7fa0977fe700 1 -- 172.21.15.60:0/400877983 <== mds.0 v2:172.21.15.60:6834/1424722915 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55b22ad255c0 con 0x55b22adad600 2023-10-06T04:28:37.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.314+0000 7fa0977fe700 10 client.4737 handle_command_reply: tid=0 2023-10-06T04:28:37.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.314+0000 7fa0cdfc4b80 1 client.4737 shutdown 2023-10-06T04:28:37.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.314+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/400877983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 msgr2=0x55b22ad97c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:37.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.314+0000 7fa0cdfc4b80 1 --2- 172.21.15.60:0/400877983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 0x55b22ad97c50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009fb0 tx=0x7fa0b406b000 comp rx=0 tx=0).stop 2023-10-06T04:28:37.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.314+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/400877983 shutdown_connections 2023-10-06T04:28:37.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.314+0000 7fa0cdfc4b80 1 --2- 172.21.15.60:0/400877983 >> [v2:172.21.15.60:6834/1424722915,v1:172.21.15.60:6836/1424722915] conn(0x55b22adad600 0x55b22adad9d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.314+0000 7fa0cdfc4b80 1 --2- 172.21.15.60:0/400877983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 0x55b22ad97c50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.314+0000 7fa0cdfc4b80 1 --2- 172.21.15.60:0/400877983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad9dbc0 0x55b22ad7b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.314+0000 7fa0cdfc4b80 1 --2- 172.21.15.60:0/400877983 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad7ce60 0x55b22ad79340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.314+0000 7fa0977fe700 0 client.4737 ms_handle_reset on v2:172.21.15.60:6834/1424722915 2023-10-06T04:28:37.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.314+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/400877983 >> 172.21.15.60:0/400877983 conn(0x55b22ad55270 msgr2=0x55b22ad994a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:37.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.314+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/400877983 shutdown_connections 2023-10-06T04:28:37.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.315+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/400877983 wait complete. 2023-10-06T04:28:37.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.315+0000 7fa0cdfc4b80 20 client.4737 trim_cache size 0 max 16384 2023-10-06T04:28:37.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.332+0000 7fa0cdfc4b80 1 Processor -- start 2023-10-06T04:28:37.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.332+0000 7fa0cdfc4b80 1 -- start start 2023-10-06T04:28:37.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.333+0000 7fa0cdfc4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad53950 0x55b22ad9d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:37.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.333+0000 7fa0cdfc4b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad7ce60 0x55b22ad549b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:37.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.333+0000 7fa0cdfc4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad9dbc0 0x55b22ad7c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:37.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.333+0000 7fa0cdfc4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b22ad52c40 con 0x55b22ad9dbc0 2023-10-06T04:28:37.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.333+0000 7fa0cdfc4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b22ab26e30 con 0x55b22ad53950 2023-10-06T04:28:37.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.333+0000 7fa0cdfc4b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b22ad990f0 con 0x55b22ad7ce60 2023-10-06T04:28:37.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.333+0000 7fa0bdd9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad9dbc0 0x55b22ad7c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:37.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.334+0000 7fa0bdd9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad9dbc0 0x55b22ad7c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38516/0 (socket says 172.21.15.60:38516) 2023-10-06T04:28:37.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.334+0000 7fa0bdd9c700 1 -- 172.21.15.60:0/1514324194 learned_addr learned my addr 172.21.15.60:0/1514324194 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:37.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.334+0000 7fa0bcd9a700 1 --2- 172.21.15.60:0/1514324194 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad7ce60 0x55b22ad549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.334+0000 7fa0bd59b700 1 --2- 172.21.15.60:0/1514324194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad53950 0x55b22ad9d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.334+0000 7fa0bdd9c700 1 -- 172.21.15.60:0/1514324194 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad7ce60 msgr2=0x55b22ad549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.334+0000 7fa0bdd9c700 1 --2- 172.21.15.60:0/1514324194 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad7ce60 0x55b22ad549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.334+0000 7fa0bdd9c700 1 -- 172.21.15.60:0/1514324194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad53950 msgr2=0x55b22ad9d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.334+0000 7fa0bdd9c700 1 --2- 172.21.15.60:0/1514324194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad53950 0x55b22ad9d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.334+0000 7fa0bdd9c700 1 -- 172.21.15.60:0/1514324194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b22ac72780 con 0x55b22ad9dbc0 2023-10-06T04:28:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.334+0000 7fa0bd59b700 1 --2- 172.21.15.60:0/1514324194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad53950 0x55b22ad9d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.334+0000 7fa0bdd9c700 1 --2- 172.21.15.60:0/1514324194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad9dbc0 0x55b22ad7c2e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0001560 tx=0x7fa0b0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8d2a8ffb96b1b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.334+0000 7fa0a2ffd700 1 -- 172.21.15.60:0/1514324194 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0013710 con 0x55b22ad9dbc0 2023-10-06T04:28:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.334+0000 7fa0a2ffd700 1 -- 172.21.15.60:0/1514324194 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b0013890 con 0x55b22ad9dbc0 2023-10-06T04:28:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.334+0000 7fa0a2ffd700 1 -- 172.21.15.60:0/1514324194 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0013c50 con 0x55b22ad9dbc0 2023-10-06T04:28:37.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.335+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/1514324194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad9dbc0 msgr2=0x55b22ad7c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:37.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.335+0000 7fa0cdfc4b80 1 --2- 172.21.15.60:0/1514324194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad9dbc0 0x55b22ad7c2e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0001560 tx=0x7fa0b0009040 comp rx=0 tx=0).stop 2023-10-06T04:28:37.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.335+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/1514324194 shutdown_connections 2023-10-06T04:28:37.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.335+0000 7fa0cdfc4b80 1 --2- 172.21.15.60:0/1514324194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad9dbc0 0x55b22ad7c2e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.335+0000 7fa0cdfc4b80 1 --2- 172.21.15.60:0/1514324194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad53950 0x55b22ad9d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.335+0000 7fa0cdfc4b80 1 --2- 172.21.15.60:0/1514324194 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad7ce60 0x55b22ad549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.335+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/1514324194 >> 172.21.15.60:0/1514324194 conn(0x55b22ad55270 msgr2=0x55b22ad55640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:37.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.335+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/1514324194 shutdown_connections 2023-10-06T04:28:37.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.335+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/1514324194 wait complete. 2023-10-06T04:28:37.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.336+0000 7fa0cdfc4b80 1 -- start start 2023-10-06T04:28:37.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.336+0000 7fa0cdfc4b80 1 Processor -- start 2023-10-06T04:28:37.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.337+0000 7fa0cdfc4b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 0x55b22adfcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:37.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.337+0000 7fa0cdfc4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad7ce60 0x55b22ad83260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:37.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.337+0000 7fa0cdfc4b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad9dbc0 0x55b22ad837a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:37.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.337+0000 7fa0cdfc4b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b22adb4570 con 0x55b22ad53950 2023-10-06T04:28:37.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.337+0000 7fa0cdfc4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b22ad78660 con 0x55b22ad7ce60 2023-10-06T04:28:37.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.337+0000 7fa0cdfc4b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b22ae00390 con 0x55b22ad9dbc0 2023-10-06T04:28:37.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.337+0000 7fa0cdfc4b80 10 client.0 _ll_register_callbacks cb 0x55b22ab40f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:28:37.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.337+0000 7fa0bd59b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 0x55b22adfcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:37.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.337+0000 7fa0bd59b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 0x55b22adfcaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38532/0 (socket says 172.21.15.60:38532) 2023-10-06T04:28:37.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.337+0000 7fa0bd59b700 1 -- 172.21.15.60:0/8360925 learned_addr learned my addr 172.21.15.60:0/8360925 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:37.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.337+0000 7fa0bdd9c700 1 --2- 172.21.15.60:0/8360925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad9dbc0 0x55b22ad837a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:37.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.337+0000 7fa0bcd9a700 1 --2- 172.21.15.60:0/8360925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad7ce60 0x55b22ad83260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:37.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.338+0000 7fa0bd59b700 1 -- 172.21.15.60:0/8360925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad9dbc0 msgr2=0x55b22ad837a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:37.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.338+0000 7fa0bd59b700 1 --2- 172.21.15.60:0/8360925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad9dbc0 0x55b22ad837a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.338+0000 7fa0bd59b700 1 -- 172.21.15.60:0/8360925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad7ce60 msgr2=0x55b22ad83260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:37.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.338+0000 7fa0bd59b700 1 --2- 172.21.15.60:0/8360925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad7ce60 0x55b22ad83260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.338+0000 7fa0bd59b700 1 -- 172.21.15.60:0/8360925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b000f040 con 0x55b22ad53950 2023-10-06T04:28:37.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.338+0000 7fa0bcd9a700 1 --2- 172.21.15.60:0/8360925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad7ce60 0x55b22ad83260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:37.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.338+0000 7fa0bd59b700 1 --2- 172.21.15.60:0/8360925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 0x55b22adfcaa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa0b405e510 tx=0x7fa0b4080000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0fa024537714d61 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:37.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.338+0000 7fa0977fe700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-06T04:28:37.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.338+0000 7fa0977fe700 1 -- 172.21.15.60:0/8360925 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4062040 con 0x55b22ad53950 2023-10-06T04:28:37.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.338+0000 7fa0977fe700 1 -- 172.21.15.60:0/8360925 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa0b4000c40 con 0x55b22ad53950 2023-10-06T04:28:37.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.338+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/8360925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa0b405a600 con 0x55b22ad53950 2023-10-06T04:28:37.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.338+0000 7fa0977fe700 1 -- 172.21.15.60:0/8360925 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0b405c3b0 con 0x55b22ad53950 2023-10-06T04:28:37.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.338+0000 7fa0cdfc4b80 10 client.4743 fetch_fsmap learned FSMap version 9 2023-10-06T04:28:37.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.338+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/8360925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55b22ac59470 con 0x55b22ad53950 2023-10-06T04:28:37.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.338+0000 7fa0977fe700 1 -- 172.21.15.60:0/8360925 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b405a600 con 0x55b22ad53950 2023-10-06T04:28:37.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.338+0000 7fa0977fe700 1 -- 172.21.15.60:0/8360925 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fa0b405c510 con 0x55b22ad53950 2023-10-06T04:28:37.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.339+0000 7fa0cdfc4b80 10 client.4743 fetch_fsmap finished waiting for FSMap version 9 2023-10-06T04:28:37.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.339+0000 7fa0cdfc4b80 10 client.4743 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T04:28:37.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.339+0000 7fa0cdfc4b80 20 client.4743 populate_metadata read hostname 'smithi060' 2023-10-06T04:28:37.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.339+0000 7fa0cdfc4b80 1 --2- 172.21.15.60:0/8360925 >> [v2:172.21.15.60:6834/1424722915,v1:172.21.15.60:6836/1424722915] conn(0x55b22ad93f60 0x55b22ad94330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:37.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.339+0000 7fa0cdfc4b80 4 client.4743 mds_command: new command op to 4281 tid=0[{"prefix": "status"}] 2023-10-06T04:28:37.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.339+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/8360925 --> [v2:172.21.15.60:6834/1424722915,v1:172.21.15.60:6836/1424722915] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b22ac46e00 con 0x55b22ad93f60 2023-10-06T04:28:37.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.339+0000 7fa0bcd9a700 1 --2- 172.21.15.60:0/8360925 >> [v2:172.21.15.60:6834/1424722915,v1:172.21.15.60:6836/1424722915] conn(0x55b22ad93f60 0x55b22ad94330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:37.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.339+0000 7fa0bcd9a700 1 --2- 172.21.15.60:0/8360925 >> [v2:172.21.15.60:6834/1424722915,v1:172.21.15.60:6836/1424722915] conn(0x55b22ad93f60 0x55b22ad94330 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfdb9d0396d7e545 server_cookie=d4a66aed20d59a1f in_seq=0 out_seq=0 2023-10-06T04:28:37.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.339+0000 7fa0977fe700 10 client.4743 ms_handle_connect on v2:172.21.15.60:6834/1424722915 2023-10-06T04:28:37.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.339+0000 7fa0977fe700 1 -- 172.21.15.60:0/8360925 <== mds.0 v2:172.21.15.60:6834/1424722915 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55b22ac46e00 con 0x55b22ad93f60 2023-10-06T04:28:37.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.339+0000 7fa0977fe700 10 client.4743 handle_command_reply: tid=0 2023-10-06T04:28:37.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.340+0000 7fa0cdfc4b80 1 client.4743 shutdown 2023-10-06T04:28:37.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.340+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/8360925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 msgr2=0x55b22adfcaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:37.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.340+0000 7fa0cdfc4b80 1 --2- 172.21.15.60:0/8360925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 0x55b22adfcaa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa0b405e510 tx=0x7fa0b4080000 comp rx=0 tx=0).stop 2023-10-06T04:28:37.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.340+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/8360925 shutdown_connections 2023-10-06T04:28:37.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.340+0000 7fa0cdfc4b80 1 --2- 172.21.15.60:0/8360925 >> [v2:172.21.15.60:6834/1424722915,v1:172.21.15.60:6836/1424722915] conn(0x55b22ad93f60 0x55b22ad94330 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.340+0000 7fa0cdfc4b80 1 --2- 172.21.15.60:0/8360925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b22ad53950 0x55b22adfcaa0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.340+0000 7fa0cdfc4b80 1 --2- 172.21.15.60:0/8360925 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b22ad9dbc0 0x55b22ad837a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.340+0000 7fa0977fe700 0 client.4743 ms_handle_reset on v2:172.21.15.60:6834/1424722915 2023-10-06T04:28:37.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.340+0000 7fa0cdfc4b80 1 --2- 172.21.15.60:0/8360925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b22ad7ce60 0x55b22ad83260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.340+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/8360925 >> 172.21.15.60:0/8360925 conn(0x55b22ad55270 msgr2=0x55b22ad93320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:37.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.340+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/8360925 shutdown_connections 2023-10-06T04:28:37.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.340+0000 7fa0cdfc4b80 1 -- 172.21.15.60:0/8360925 wait complete. 2023-10-06T04:28:37.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.340+0000 7fa0cdfc4b80 20 client.4743 trim_cache size 0 max 16384 2023-10-06T04:28:37.348 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-06T04:28:37.348 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "caf6a2b8-149e-4228-9a04-404e2d811afd", 2023-10-06T04:28:37.349 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2023-10-06T04:28:37.349 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4281, 2023-10-06T04:28:37.349 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-06T04:28:37.349 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-06T04:28:37.349 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-06T04:28:37.349 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 30.606609448, 2023-10-06T04:28:37.349 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 9, 2023-10-06T04:28:37.349 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 25, 2023-10-06T04:28:37.349 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 25, 2023-10-06T04:28:37.350 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 36.990880785000002 2023-10-06T04:28:37.350 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-06T04:28:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.341+0000 7fa0be59d700 1 -- 172.21.15.60:0/2585208471 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa09c066f30 msgr2=0x7fa09c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.341+0000 7fa0be59d700 1 --2- 172.21.15.60:0/2585208471 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa09c066f30 0x7fa09c0693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa0b815cef0 tx=0x7fa0a8009040 comp rx=0 tx=0).stop 2023-10-06T04:28:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.341+0000 7fa0be59d700 1 -- 172.21.15.60:0/2585208471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0b80b2100 msgr2=0x7fa0b80cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.341+0000 7fa0be59d700 1 --2- 172.21.15.60:0/2585208471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0b80b2100 0x7fa0b80cfc20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8069150 tx=0x7fa0b4017000 comp rx=0 tx=0).stop 2023-10-06T04:28:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.341+0000 7fa0be59d700 1 -- 172.21.15.60:0/2585208471 shutdown_connections 2023-10-06T04:28:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.341+0000 7fa0be59d700 1 --2- 172.21.15.60:0/2585208471 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa09c066f30 0x7fa09c0693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.341+0000 7fa0be59d700 1 --2- 172.21.15.60:0/2585208471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0b80b2100 0x7fa0b80cfc20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.341+0000 7fa0be59d700 1 --2- 172.21.15.60:0/2585208471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b8159440 0x7fa0b815a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.341+0000 7fa0be59d700 1 --2- 172.21.15.60:0/2585208471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0b80b35d0 0x7fa0b81549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.341+0000 7fa0be59d700 1 -- 172.21.15.60:0/2585208471 >> 172.21.15.60:0/2585208471 conn(0x7fa0b806ece0 msgr2=0x7fa0b8156810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:37.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.341+0000 7fa0be59d700 1 -- 172.21.15.60:0/2585208471 shutdown_connections 2023-10-06T04:28:37.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:37.341+0000 7fa0be59d700 1 -- 172.21.15.60:0/2585208471 wait complete. 2023-10-06T04:28:37.360 INFO:teuthology.run_tasks:Running task kclient... 2023-10-06T04:28:37.376 INFO:tasks.kclient:Mounting kernel clients... 2023-10-06T04:28:37.376 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T04:28:37.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:37.377 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-06T04:28:37.415 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-06T04:28:37.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:37.416 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T04:28:37.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:37.518 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2023-10-06T04:28:37.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:37.623 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-06T04:28:37.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:37.663 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2023-10-06T04:28:37.771 INFO:teuthology.orchestra.run.smithi060.stderr:Cannot find device "ceph-brx" 2023-10-06T04:28:37.774 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:28:37.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:37.774 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-10-06T04:28:37.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:37.815 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2023-10-06T04:28:37.923 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2023-10-06T04:28:37.926 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:28:37.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:37.927 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-10-06T04:28:37.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:37.964 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2023-10-06T04:28:38.066 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2023-10-06T04:28:38.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:28:38.069 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-10-06T04:28:38.069 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:28:38.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.256+0000 7f8cfc1ff700 1 Processor -- start 2023-10-06T04:28:38.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.256+0000 7f8cfc1ff700 1 -- start start 2023-10-06T04:28:38.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.257+0000 7f8cfc1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cf406e650 0x7f8cf406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:38.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.257+0000 7f8cfc1ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8cf40ad1b0 0x7f8cf40ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:38.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.257+0000 7f8cfc1ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf406f000 con 0x7f8cf4156500 2023-10-06T04:28:38.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.257+0000 7f8cfc1ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf406f430 con 0x7f8cf40ad1b0 2023-10-06T04:28:38.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.257+0000 7f8cfc1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf40acd20 con 0x7f8cf406e650 2023-10-06T04:28:38.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.258+0000 7f8cf979a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cf406e650 0x7f8cf406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:38.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.258+0000 7f8cfa79c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8cf40ad1b0 0x7f8cf40ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:38.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.258+0000 7f8cf979a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cf406e650 0x7f8cf406eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:35084/0 (socket says 172.21.15.60:35084) 2023-10-06T04:28:38.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.258+0000 7f8cfa79c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8cf40ad1b0 0x7f8cf40ad630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:51450/0 (socket says 172.21.15.60:51450) 2023-10-06T04:28:38.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.258+0000 7f8cf979a700 1 -- 172.21.15.60:0/1411199232 learned_addr learned my addr 172.21.15.60:0/1411199232 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:38.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.258+0000 7f8cf8f99700 1 -- 172.21.15.60:0/1411199232 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066655542 0 0) 0x7f8cf406f000 con 0x7f8cf4156500 2023-10-06T04:28:38.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.258+0000 7f8cf8f99700 1 -- 172.21.15.60:0/1411199232 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ce0003570 con 0x7f8cf4156500 2023-10-06T04:28:38.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.258+0000 7f8cfa79c700 1 -- 172.21.15.60:0/1411199232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cf406e650 msgr2=0x7f8cf406eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:38.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.258+0000 7f8cfa79c700 1 --2- 172.21.15.60:0/1411199232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cf406e650 0x7f8cf406eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:38.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.258+0000 7f8cfa79c700 1 -- 172.21.15.60:0/1411199232 >> v1:172.21.15.135:6789/0 conn(0x7f8cf4156500 legacy=0x7f8cf40c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:38.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.258+0000 7f8cfa79c700 1 -- 172.21.15.60:0/1411199232 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf41568d0 con 0x7f8cf40ad1b0 2023-10-06T04:28:38.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.258+0000 7f8cf979a700 1 --2- 172.21.15.60:0/1411199232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cf406e650 0x7f8cf406eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:38.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.258+0000 7f8cfa79c700 1 --2- 172.21.15.60:0/1411199232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cf40ad1b0 0x7f8cf40ad630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8cec00d0d0 tx=0x7f8cec00b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95f920eed5e03777 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:38.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.259+0000 7f8cf8f99700 1 -- 172.21.15.60:0/1411199232 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec010070 con 0x7f8cf40ad1b0 2023-10-06T04:28:38.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.259+0000 7f8cf8f99700 1 -- 172.21.15.60:0/1411199232 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec00b2e0 con 0x7f8cf40ad1b0 2023-10-06T04:28:38.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.259+0000 7f8cf8f99700 1 -- 172.21.15.60:0/1411199232 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec00dcd0 con 0x7f8cf40ad1b0 2023-10-06T04:28:38.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.259+0000 7f8cfc1ff700 1 -- 172.21.15.60:0/1411199232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cf40ad1b0 msgr2=0x7f8cf40ad630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:38.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.259+0000 7f8cfc1ff700 1 --2- 172.21.15.60:0/1411199232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cf40ad1b0 0x7f8cf40ad630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8cec00d0d0 tx=0x7f8cec00b990 comp rx=0 tx=0).stop 2023-10-06T04:28:38.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.259+0000 7f8cfc1ff700 1 -- 172.21.15.60:0/1411199232 shutdown_connections 2023-10-06T04:28:38.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.259+0000 7f8cfc1ff700 1 --2- 172.21.15.60:0/1411199232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cf40ad1b0 0x7f8cf40ad630 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:38.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.259+0000 7f8cfc1ff700 1 --2- 172.21.15.60:0/1411199232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cf406e650 0x7f8cf406eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:38.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.259+0000 7f8cfc1ff700 1 -- 172.21.15.60:0/1411199232 >> 172.21.15.60:0/1411199232 conn(0x7f8cf4068080 msgr2=0x7f8cf40cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:38.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.259+0000 7f8cfc1ff700 1 -- 172.21.15.60:0/1411199232 shutdown_connections 2023-10-06T04:28:38.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.259+0000 7f8cfc1ff700 1 -- 172.21.15.60:0/1411199232 wait complete. 2023-10-06T04:28:38.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.261+0000 7f8cfc1ff700 1 Processor -- start 2023-10-06T04:28:38.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.261+0000 7f8cfc1ff700 1 -- start start 2023-10-06T04:28:38.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.262+0000 7f8cfc1ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cf406e650 0x7f8cf415b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:38.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.262+0000 7f8cfc1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cf40ad1b0 0x7f8cf40c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:38.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.262+0000 7f8cfc1ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cf4156500 0x7f8cf40c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:38.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.262+0000 7f8cfc1ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf40c6a00 con 0x7f8cf406e650 2023-10-06T04:28:38.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.262+0000 7f8cfc1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf415b9f0 con 0x7f8cf40ad1b0 2023-10-06T04:28:38.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.262+0000 7f8cfc1ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf4154050 con 0x7f8cf4156500 2023-10-06T04:28:38.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.262+0000 7f8cf9f9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cf406e650 0x7f8cf415b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:38.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.262+0000 7f8cf979a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cf40ad1b0 0x7f8cf40c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:38.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.262+0000 7f8cfa79c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cf4156500 0x7f8cf40c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:38.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.262+0000 7f8cf979a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cf40ad1b0 0x7f8cf40c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:51454/0 (socket says 172.21.15.60:51454) 2023-10-06T04:28:38.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.262+0000 7f8cf9f9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cf406e650 0x7f8cf415b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38544/0 (socket says 172.21.15.60:38544) 2023-10-06T04:28:38.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.262+0000 7f8cf979a700 1 -- 172.21.15.60:0/1714269494 learned_addr learned my addr 172.21.15.60:0/1714269494 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:38.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.262+0000 7f8cf979a700 1 -- 172.21.15.60:0/1714269494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cf4156500 msgr2=0x7f8cf40c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:38.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.262+0000 7f8cf979a700 1 --2- 172.21.15.60:0/1714269494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cf4156500 0x7f8cf40c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:38.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.262+0000 7f8cf979a700 1 -- 172.21.15.60:0/1714269494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cf406e650 msgr2=0x7f8cf415b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:38.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.262+0000 7f8cf979a700 1 --2- 172.21.15.60:0/1714269494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cf406e650 0x7f8cf415b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:38.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.263+0000 7f8cf979a700 1 -- 172.21.15.60:0/1714269494 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce40094f0 con 0x7f8cf40ad1b0 2023-10-06T04:28:38.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.263+0000 7f8cfa79c700 1 --2- 172.21.15.60:0/1714269494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cf4156500 0x7f8cf40c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:38.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.263+0000 7f8cf9f9b700 1 --2- 172.21.15.60:0/1714269494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cf406e650 0x7f8cf415b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:38.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.263+0000 7f8cf979a700 1 --2- 172.21.15.60:0/1714269494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cf40ad1b0 0x7f8cf40c9c10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400ec50 tx=0x7f8ce4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:38.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.263+0000 7f8ce9ffb700 1 -- 172.21.15.60:0/1714269494 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce400c850 con 0x7f8cf40ad1b0 2023-10-06T04:28:38.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.263+0000 7f8ce9ffb700 1 -- 172.21.15.60:0/1714269494 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce400c9b0 con 0x7f8cf40ad1b0 2023-10-06T04:28:38.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.263+0000 7f8ce9ffb700 1 -- 172.21.15.60:0/1714269494 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce400cd30 con 0x7f8cf40ad1b0 2023-10-06T04:28:38.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.263+0000 7f8cfc1ff700 1 -- 172.21.15.60:0/1714269494 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cec00bc30 con 0x7f8cf40ad1b0 2023-10-06T04:28:38.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.263+0000 7f8cfc1ff700 1 -- 172.21.15.60:0/1714269494 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf4153d00 con 0x7f8cf40ad1b0 2023-10-06T04:28:38.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.264+0000 7f8cfc1ff700 1 -- 172.21.15.60:0/1714269494 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf4064a90 con 0x7f8cf40ad1b0 2023-10-06T04:28:38.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.265+0000 7f8ce9ffb700 1 -- 172.21.15.60:0/1714269494 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ce4013680 con 0x7f8cf40ad1b0 2023-10-06T04:28:38.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.266+0000 7f8ce9ffb700 1 --2- 172.21.15.60:0/1714269494 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8cd8066f30 0x7f8cd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:38.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.266+0000 7f8ce9ffb700 1 -- 172.21.15.60:0/1714269494 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8ce4084ff0 con 0x7f8cf40ad1b0 2023-10-06T04:28:38.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.266+0000 7f8cf9f9b700 1 --2- 172.21.15.60:0/1714269494 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8cd8066f30 0x7f8cd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:38.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.267+0000 7f8cf9f9b700 1 --2- 172.21.15.60:0/1714269494 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8cd8066f30 0x7f8cd80693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0007fd0 tx=0x7f8cf0007d50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:38.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.271+0000 7f8ce9ffb700 1 -- 172.21.15.60:0/1714269494 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ce4051db0 con 0x7f8cf40ad1b0 2023-10-06T04:28:38.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.522+0000 7f8cfc1ff700 1 -- 172.21.15.60:0/1714269494 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8cf40c7b30 con 0x7f8cf40ad1b0 2023-10-06T04:28:38.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.522+0000 7f8ce9ffb700 1 -- 172.21.15.60:0/1714269494 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8ce4021070 con 0x7f8cf40ad1b0 2023-10-06T04:28:38.525 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T04:28:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.524+0000 7f8cfc1ff700 1 -- 172.21.15.60:0/1714269494 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8cd8066f30 msgr2=0x7f8cd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.524+0000 7f8cfc1ff700 1 --2- 172.21.15.60:0/1714269494 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8cd8066f30 0x7f8cd80693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0007fd0 tx=0x7f8cf0007d50 comp rx=0 tx=0).stop 2023-10-06T04:28:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.524+0000 7f8cfc1ff700 1 -- 172.21.15.60:0/1714269494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cf40ad1b0 msgr2=0x7f8cf40c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.524+0000 7f8cfc1ff700 1 --2- 172.21.15.60:0/1714269494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cf40ad1b0 0x7f8cf40c9c10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400ec50 tx=0x7f8ce4009250 comp rx=0 tx=0).stop 2023-10-06T04:28:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.525+0000 7f8cfc1ff700 1 -- 172.21.15.60:0/1714269494 shutdown_connections 2023-10-06T04:28:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.525+0000 7f8cfc1ff700 1 --2- 172.21.15.60:0/1714269494 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8cd8066f30 0x7f8cd80693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.525+0000 7f8cfc1ff700 1 --2- 172.21.15.60:0/1714269494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cf406e650 0x7f8cf415b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.525+0000 7f8cfc1ff700 1 --2- 172.21.15.60:0/1714269494 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8cf4156500 0x7f8cf40c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.525+0000 7f8cfc1ff700 1 --2- 172.21.15.60:0/1714269494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cf40ad1b0 0x7f8cf40c9c10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.525+0000 7f8cfc1ff700 1 -- 172.21.15.60:0/1714269494 >> 172.21.15.60:0/1714269494 conn(0x7f8cf4068080 msgr2=0x7f8cf4069520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.525+0000 7f8cfc1ff700 1 -- 172.21.15.60:0/1714269494 shutdown_connections 2023-10-06T04:28:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:38.525+0000 7f8cfc1ff700 1 -- 172.21.15.60:0/1714269494 wait complete. 2023-10-06T04:28:38.544 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:28:38.544 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:28:38.545 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-10-06T04:28:38.545 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T04:28:38.545 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T04:28:38.545 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:28:38.545 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:28:38.545 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:28:38.545 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:28:38.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:38.546 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-10-06T04:28:38.583 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:28:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:28:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:28:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-06T04:28:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:38.584 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:28:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2023-10-06T04:28:38.584 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:28:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2023-10-06T04:28:38.584 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:28:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2023-10-06T04:28:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T04:28:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42255sec preferred_lft 42255sec 2023-10-06T04:28:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-10-06T04:28:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:38.585 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:28:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2023-10-06T04:28:38.585 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T04:28:38.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:38.585 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-06T04:28:38.585 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-06T04:28:38.585 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add name ceph-brx type bridge 2023-10-06T04:28:38.586 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr flush dev ceph-brx 2023-10-06T04:28:38.586 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set ceph-brx up 2023-10-06T04:28:38.586 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T04:28:38.586 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-06T04:28:38.709 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:28:38.714 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:28:38.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:38.814 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:28:38.876 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-10-06T04:28:38.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:38.879 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-10-06T04:28:38.959 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-10-06T04:28:38.959 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:28:38.959 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T04:28:38.959 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T04:28:38.959 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:28:38.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:38.960 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-06T04:28:38.960 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-06T04:28:38.960 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:28:38.960 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:28:38.960 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:28:38.960 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-06T04:28:39.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:39.158 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-06T04:28:39.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:39.195 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list-id 2023-10-06T04:28:39.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:39.272 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-06T04:28:39.272 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-06T04:28:39.272 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:28:39.273 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T04:28:39.273 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-06T04:28:39.441 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T04:28:39.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:39.442 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-06T04:28:39.442 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-06T04:28:39.442 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T04:28:39.442 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T04:28:39.442 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T04:28:39.442 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T04:28:39.442 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T04:28:39.442 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-06T04:28:39.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:39.686 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-06T04:28:39.686 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-06T04:28:39.686 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2023-10-06T04:28:39.686 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T04:28:39.686 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-06T04:28:39.843 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:28:39.844 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T04:28:39.881 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:28:39.881 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:28:39.881 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:28:39.956 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:28:39.957 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:28:39.957 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:28:40.090 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:28:40.090 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:28:40.090 INFO:teuthology.orchestra.run.smithi060.stdout:invalid new device string format 2023-10-06T04:28:40.572 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:28:40.572 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:28:40.573 INFO:teuthology.orchestra.run.smithi060.stdout:invalid new device string format 2023-10-06T04:28:40.573 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-06T04:28:40.573 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:28:40.596 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:28:40.597 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:28:40.597 INFO:teuthology.orchestra.run.smithi060.stdout:invalid new device string format 2023-10-06T04:28:40.597 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-06T04:28:40.597 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:28:40.597 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.135:6789,172.21.15.135:6790" 2023-10-06T04:28:40.597 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2023-10-06T04:28:40.597 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=caf6a2b8-149e-4228-9a04-404e2d811afd" will pass to kernel 2023-10-06T04:28:40.601 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:28:40.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:40.602 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:28:40.664 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-10-06T04:28:40.664 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:28:40.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.849+0000 7fbff539d700 1 Processor -- start 2023-10-06T04:28:40.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.849+0000 7fbff539d700 1 -- start start 2023-10-06T04:28:40.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.850+0000 7fbff539d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbff0159390 0x7fbff00ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:40.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.850+0000 7fbff539d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbff0159760 0x7fbff00aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:40.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.850+0000 7fbff539d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff00686c0 con 0x7fbff00ab240 2023-10-06T04:28:40.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.850+0000 7fbff539d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff0068c80 con 0x7fbff0159390 2023-10-06T04:28:40.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.850+0000 7fbff539d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff00ab660 con 0x7fbff0159760 2023-10-06T04:28:40.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.851+0000 7fbfeffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbff0159390 0x7fbff00ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:40.853 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.851+0000 7fbfeffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbff0159390 0x7fbff00ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38560/0 (socket says 172.21.15.60:38560) 2023-10-06T04:28:40.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.851+0000 7fbfeffff700 1 -- 172.21.15.60:0/1831581987 learned_addr learned my addr 172.21.15.60:0/1831581987 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:40.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.851+0000 7fbfef7fe700 1 --2- 172.21.15.60:0/1831581987 >> v2:172.21.15.135:3300/0 conn(0x7fbff0159760 0x7fbff00aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:40.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.851+0000 7fbfeffff700 1 -- 172.21.15.60:0/1831581987 >> v2:172.21.15.135:3300/0 conn(0x7fbff0159760 msgr2=0x7fbff00aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:40.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.851+0000 7fbfeffff700 1 --2- 172.21.15.60:0/1831581987 >> v2:172.21.15.135:3300/0 conn(0x7fbff0159760 0x7fbff00aad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:40.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.851+0000 7fbfeffff700 1 -- 172.21.15.60:0/1831581987 >> v1:172.21.15.135:6789/0 conn(0x7fbff00ab240 legacy=0x7fbff0069110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:40.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.851+0000 7fbfeffff700 1 -- 172.21.15.60:0/1831581987 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff00ace20 con 0x7fbff0159390 2023-10-06T04:28:40.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.851+0000 7fbfeffff700 1 --2- 172.21.15.60:0/1831581987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff0159390 0x7fbff00ac8e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbff006ee70 tx=0x7fbfe0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601e9716f029dad7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:40.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.852+0000 7fbfeeffd700 1 -- 172.21.15.60:0/1831581987 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe000b860 con 0x7fbff0159390 2023-10-06T04:28:40.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.852+0000 7fbfeeffd700 1 -- 172.21.15.60:0/1831581987 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe000b9c0 con 0x7fbff0159390 2023-10-06T04:28:40.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.852+0000 7fbfeeffd700 1 -- 172.21.15.60:0/1831581987 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe000bd60 con 0x7fbff0159390 2023-10-06T04:28:40.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.852+0000 7fbff539d700 1 -- 172.21.15.60:0/1831581987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff0159390 msgr2=0x7fbff00ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:40.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.852+0000 7fbff539d700 1 --2- 172.21.15.60:0/1831581987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff0159390 0x7fbff00ac8e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbff006ee70 tx=0x7fbfe0009250 comp rx=0 tx=0).stop 2023-10-06T04:28:40.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.852+0000 7fbff539d700 1 -- 172.21.15.60:0/1831581987 shutdown_connections 2023-10-06T04:28:40.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.852+0000 7fbff539d700 1 --2- 172.21.15.60:0/1831581987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff0159390 0x7fbff00ac8e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:40.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.852+0000 7fbff539d700 1 --2- 172.21.15.60:0/1831581987 >> v2:172.21.15.135:3300/0 conn(0x7fbff0159760 0x7fbff00aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:40.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.852+0000 7fbff539d700 1 -- 172.21.15.60:0/1831581987 >> 172.21.15.60:0/1831581987 conn(0x7fbff0097410 msgr2=0x7fbff0067d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:40.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.852+0000 7fbff539d700 1 -- 172.21.15.60:0/1831581987 shutdown_connections 2023-10-06T04:28:40.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.852+0000 7fbff539d700 1 -- 172.21.15.60:0/1831581987 wait complete. 2023-10-06T04:28:40.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.854+0000 7fbff539d700 1 Processor -- start 2023-10-06T04:28:40.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.854+0000 7fbff539d700 1 -- start start 2023-10-06T04:28:40.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.855+0000 7fbff539d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff00ab240 0x7fbff009afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:40.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.855+0000 7fbff539d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbff0159390 0x7fbff0169ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:40.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.855+0000 7fbff539d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbff0159760 0x7fbff015be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:40.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.855+0000 7fbff539d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff01547e0 con 0x7fbff00ab240 2023-10-06T04:28:40.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.855+0000 7fbff539d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff016a3e0 con 0x7fbff0159390 2023-10-06T04:28:40.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.855+0000 7fbff539d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff0099f30 con 0x7fbff0159760 2023-10-06T04:28:40.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.855+0000 7fbfeffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff00ab240 0x7fbff009afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:40.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.855+0000 7fbfeffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff00ab240 0x7fbff009afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38566/0 (socket says 172.21.15.60:38566) 2023-10-06T04:28:40.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.855+0000 7fbfeffff700 1 -- 172.21.15.60:0/1938197442 learned_addr learned my addr 172.21.15.60:0/1938197442 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:40.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.855+0000 7fbfeffff700 1 -- 172.21.15.60:0/1938197442 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbff0159760 msgr2=0x7fbff015be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:40.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.855+0000 7fbfeffff700 1 --2- 172.21.15.60:0/1938197442 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbff0159760 0x7fbff015be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:40.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.855+0000 7fbfeffff700 1 -- 172.21.15.60:0/1938197442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbff0159390 msgr2=0x7fbff0169ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:40.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.855+0000 7fbfeffff700 1 --2- 172.21.15.60:0/1938197442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbff0159390 0x7fbff0169ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:40.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.855+0000 7fbfeffff700 1 -- 172.21.15.60:0/1938197442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe00094f0 con 0x7fbff00ab240 2023-10-06T04:28:40.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.856+0000 7fbfeffff700 1 --2- 172.21.15.60:0/1938197442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff00ab240 0x7fbff009afd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0006fd0 tx=0x7fbfe0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:40.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.856+0000 7fbfd7fff700 1 -- 172.21.15.60:0/1938197442 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0011e20 con 0x7fbff00ab240 2023-10-06T04:28:40.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.856+0000 7fbfd7fff700 1 -- 172.21.15.60:0/1938197442 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe001a630 con 0x7fbff00ab240 2023-10-06T04:28:40.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.856+0000 7fbfd7fff700 1 -- 172.21.15.60:0/1938197442 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe001a9f0 con 0x7fbff00ab240 2023-10-06T04:28:40.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.856+0000 7fbff539d700 1 -- 172.21.15.60:0/1938197442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff009a210 con 0x7fbff00ab240 2023-10-06T04:28:40.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.856+0000 7fbff539d700 1 -- 172.21.15.60:0/1938197442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff009a7d0 con 0x7fbff00ab240 2023-10-06T04:28:40.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.857+0000 7fbff539d700 1 -- 172.21.15.60:0/1938197442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff006d390 con 0x7fbff00ab240 2023-10-06T04:28:40.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.858+0000 7fbfd7fff700 1 -- 172.21.15.60:0/1938197442 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbfe002d440 con 0x7fbff00ab240 2023-10-06T04:28:40.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.859+0000 7fbfd7fff700 1 --2- 172.21.15.60:0/1938197442 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbfdc066f30 0x7fbfdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:40.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.859+0000 7fbfd7fff700 1 -- 172.21.15.60:0/1938197442 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fbfe0086580 con 0x7fbff00ab240 2023-10-06T04:28:40.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.859+0000 7fbfef7fe700 1 --2- 172.21.15.60:0/1938197442 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbfdc066f30 0x7fbfdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:40.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.860+0000 7fbfef7fe700 1 --2- 172.21.15.60:0/1938197442 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbfdc066f30 0x7fbfdc0693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009a60 tx=0x7fbfe4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:40.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:40.863+0000 7fbfd7fff700 1 -- 172.21.15.60:0/1938197442 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbfe0053300 con 0x7fbff00ab240 2023-10-06T04:28:41.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:41.110+0000 7fbff539d700 1 -- 172.21.15.60:0/1938197442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbff005f230 con 0x7fbff00ab240 2023-10-06T04:28:41.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:41.111+0000 7fbfd7fff700 1 -- 172.21.15.60:0/1938197442 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fbfe0056920 con 0x7fbff00ab240 2023-10-06T04:28:41.113 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T04:28:41.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:41.113+0000 7fbff539d700 1 -- 172.21.15.60:0/1938197442 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbfdc066f30 msgr2=0x7fbfdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:41.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:41.113+0000 7fbff539d700 1 --2- 172.21.15.60:0/1938197442 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbfdc066f30 0x7fbfdc0693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009a60 tx=0x7fbfe4008040 comp rx=0 tx=0).stop 2023-10-06T04:28:41.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:41.113+0000 7fbff539d700 1 -- 172.21.15.60:0/1938197442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff00ab240 msgr2=0x7fbff009afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:41.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:41.113+0000 7fbff539d700 1 --2- 172.21.15.60:0/1938197442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff00ab240 0x7fbff009afd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0006fd0 tx=0x7fbfe0017000 comp rx=0 tx=0).stop 2023-10-06T04:28:41.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:41.113+0000 7fbff539d700 1 -- 172.21.15.60:0/1938197442 shutdown_connections 2023-10-06T04:28:41.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:41.113+0000 7fbff539d700 1 --2- 172.21.15.60:0/1938197442 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbfdc066f30 0x7fbfdc0693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:41.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:41.113+0000 7fbff539d700 1 --2- 172.21.15.60:0/1938197442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbff00ab240 0x7fbff009afd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:41.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:41.113+0000 7fbff539d700 1 --2- 172.21.15.60:0/1938197442 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbff0159760 0x7fbff015be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:41.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:41.113+0000 7fbff539d700 1 --2- 172.21.15.60:0/1938197442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbff0159390 0x7fbff0169ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:41.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:41.113+0000 7fbff539d700 1 -- 172.21.15.60:0/1938197442 >> 172.21.15.60:0/1938197442 conn(0x7fbff0097410 msgr2=0x7fbff01569b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:41.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:41.113+0000 7fbff539d700 1 -- 172.21.15.60:0/1938197442 shutdown_connections 2023-10-06T04:28:41.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:41.113+0000 7fbff539d700 1 -- 172.21.15.60:0/1938197442 wait complete. 2023-10-06T04:28:41.133 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:28:41.133 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:28:41.133 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-10-06T04:28:41.133 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T04:28:41.133 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T04:28:41.133 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:28:41.133 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:28:41.134 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:28:41.134 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T04:28:41.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:41.134 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-10-06T04:28:41.172 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:28:41.172 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:28:41.172 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:28:41.172 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:41.172 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-06T04:28:41.172 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:41.172 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:28:41.172 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:41.173 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2023-10-06T04:28:41.173 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:28:41.173 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:41.173 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2023-10-06T04:28:41.173 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:28:41.173 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:41.173 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2023-10-06T04:28:41.173 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T04:28:41.173 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42252sec preferred_lft 42252sec 2023-10-06T04:28:41.173 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-10-06T04:28:41.173 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:41.174 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:28:41.174 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:41.174 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2023-10-06T04:28:41.174 INFO:teuthology.orchestra.run.smithi060.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:28:41.174 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether b6:01:cd:7d:bd:12 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:41.174 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:28:41.174 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:41.174 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::60b8:e1ff:feff:b13f/64 scope link 2023-10-06T04:28:41.174 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:41.175 INFO:teuthology.orchestra.run.smithi060.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:28:41.175 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether b6:01:cd:7d:bd:12 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:28:41.175 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::b401:cdff:fe7d:bd12/64 scope link tentative 2023-10-06T04:28:41.175 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:41.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:41.175 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:28:41.272 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-10-06T04:28:41.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:41.275 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-10-06T04:28:41.314 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-10-06T04:28:41.314 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:28:41.314 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T04:28:41.315 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T04:28:41.315 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:28:41.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:41.315 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-06T04:28:41.315 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-06T04:28:41.315 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:28:41.315 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:28:41.315 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:28:41.315 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-06T04:28:41.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:41.514 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-06T04:28:41.551 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:28:41.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:41.551 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list-id 2023-10-06T04:28:41.627 INFO:teuthology.orchestra.run.smithi060.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T04:28:41.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:41.628 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-06T04:28:41.628 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-06T04:28:41.628 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:28:41.628 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T04:28:41.629 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-06T04:28:41.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:41.805 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T04:28:41.870 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:28:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:28:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:28:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-06T04:28:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:41.871 INFO:teuthology.orchestra.run.smithi060.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:28:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1e:07:68:53:8b:05 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:28:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:28:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::1c07:68ff:fe53:8b05/64 scope link 2023-10-06T04:28:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:41.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:41.872 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T04:28:41.934 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:28:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:28:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:28:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-06T04:28:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:41.935 INFO:teuthology.orchestra.run.smithi060.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:28:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1e:07:68:53:8b:05 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:28:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:28:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::1c07:68ff:fe53:8b05/64 scope link 2023-10-06T04:28:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:41.937 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T04:28:41.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:41.937 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-06T04:28:41.937 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-06T04:28:41.937 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T04:28:41.937 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T04:28:41.937 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T04:28:41.938 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T04:28:41.938 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T04:28:41.938 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-06T04:28:42.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:42.180 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-06T04:28:42.180 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-06T04:28:42.180 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.1 up 2023-10-06T04:28:42.180 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T04:28:42.180 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-06T04:28:42.340 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:28:42.340 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T04:28:42.377 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T04:28:42.377 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:28:42.377 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T04:28:42.453 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:28:42.453 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:28:42.453 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T04:28:42.586 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T04:28:42.586 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T04:28:42.586 INFO:teuthology.orchestra.run.smithi060.stdout:invalid new device string format 2023-10-06T04:28:42.602 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T04:28:42.602 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T04:28:42.602 INFO:teuthology.orchestra.run.smithi060.stdout:invalid new device string format 2023-10-06T04:28:42.602 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-06T04:28:42.602 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:28:42.624 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T04:28:42.624 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T04:28:42.624 INFO:teuthology.orchestra.run.smithi060.stdout:invalid new device string format 2023-10-06T04:28:42.624 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-06T04:28:42.624 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:28:42.625 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.135:6789,172.21.15.135:6790" 2023-10-06T04:28:42.625 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2023-10-06T04:28:42.625 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=caf6a2b8-149e-4228-9a04-404e2d811afd" will pass to kernel 2023-10-06T04:28:42.628 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:28:42.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:42.629 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T04:28:42.691 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-10-06T04:28:42.691 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:28:42.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.880+0000 7f0c41d9d700 1 Processor -- start 2023-10-06T04:28:42.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.881+0000 7f0c41d9d700 1 -- start start 2023-10-06T04:28:42.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.882+0000 7f0c41d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0c3c159390 0x7f0c3c0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:42.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.882+0000 7f0c41d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c3c159760 0x7f0c3c0aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:42.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.882+0000 7f0c41d9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3c0686c0 con 0x7f0c3c0ab240 2023-10-06T04:28:42.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.882+0000 7f0c41d9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3c068c80 con 0x7f0c3c159760 2023-10-06T04:28:42.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.882+0000 7f0c41d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3c0ab660 con 0x7f0c3c159390 2023-10-06T04:28:42.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.882+0000 7f0c3bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c3c159760 0x7f0c3c0aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:42.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.882+0000 7f0c4159c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0c3c0ab240 0x7f0c3c069110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44048/0 (socket says 172.21.15.60:44048) 2023-10-06T04:28:42.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.882+0000 7f0c4159c700 1 -- 172.21.15.60:0/901329314 learned_addr learned my addr 172.21.15.60:0/901329314 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:42.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.882+0000 7f0c40d9b700 1 --2- 172.21.15.60:0/901329314 >> v2:172.21.15.135:3300/0 conn(0x7f0c3c159390 0x7f0c3c0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:42.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.883+0000 7f0c3bfff700 1 -- 172.21.15.60:0/901329314 >> v2:172.21.15.135:3300/0 conn(0x7f0c3c159390 msgr2=0x7f0c3c0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:42.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.883+0000 7f0c3bfff700 1 --2- 172.21.15.60:0/901329314 >> v2:172.21.15.135:3300/0 conn(0x7f0c3c159390 0x7f0c3c0ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:42.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.883+0000 7f0c3bfff700 1 -- 172.21.15.60:0/901329314 >> v1:172.21.15.60:6789/0 conn(0x7f0c3c0ab240 legacy=0x7f0c3c069110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:42.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.883+0000 7f0c3bfff700 1 -- 172.21.15.60:0/901329314 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c0ace20 con 0x7f0c3c159760 2023-10-06T04:28:42.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.883+0000 7f0c3bfff700 1 --2- 172.21.15.60:0/901329314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3c159760 0x7f0c3c0aad00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c06eb90 tx=0x7f0c280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59cdeab4d4a1da09 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:42.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.883+0000 7f0c3b7fe700 1 -- 172.21.15.60:0/901329314 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2800b6b0 con 0x7f0c3c159760 2023-10-06T04:28:42.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.883+0000 7f0c3b7fe700 1 -- 172.21.15.60:0/901329314 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2800b810 con 0x7f0c3c159760 2023-10-06T04:28:42.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.883+0000 7f0c3b7fe700 1 -- 172.21.15.60:0/901329314 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2800bbb0 con 0x7f0c3c159760 2023-10-06T04:28:42.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.884+0000 7f0c41d9d700 1 -- 172.21.15.60:0/901329314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3c159760 msgr2=0x7f0c3c0aad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:42.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.884+0000 7f0c41d9d700 1 --2- 172.21.15.60:0/901329314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3c159760 0x7f0c3c0aad00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c06eb90 tx=0x7f0c280091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:42.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.884+0000 7f0c41d9d700 1 -- 172.21.15.60:0/901329314 shutdown_connections 2023-10-06T04:28:42.887 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.884+0000 7f0c41d9d700 1 --2- 172.21.15.60:0/901329314 >> v2:172.21.15.135:3300/0 conn(0x7f0c3c159390 0x7f0c3c0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:42.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.884+0000 7f0c41d9d700 1 --2- 172.21.15.60:0/901329314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3c159760 0x7f0c3c0aad00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:42.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.884+0000 7f0c41d9d700 1 -- 172.21.15.60:0/901329314 >> 172.21.15.60:0/901329314 conn(0x7f0c3c097410 msgr2=0x7f0c3c067d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:42.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.884+0000 7f0c41d9d700 1 -- 172.21.15.60:0/901329314 shutdown_connections 2023-10-06T04:28:42.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.884+0000 7f0c41d9d700 1 -- 172.21.15.60:0/901329314 wait complete. 2023-10-06T04:28:42.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.885+0000 7f0c41d9d700 1 Processor -- start 2023-10-06T04:28:42.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.885+0000 7f0c41d9d700 1 -- start start 2023-10-06T04:28:42.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.886+0000 7f0c41d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c3c0ab240 0x7f0c3c0b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:42.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.886+0000 7f0c41d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c3c159390 0x7f0c3c155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:42.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.886+0000 7f0c41d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3c159760 0x7f0c3c169c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.886+0000 7f0c41d9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0b3320 con 0x7f0c3c159760 2023-10-06T04:28:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.886+0000 7f0c41d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c16a750 con 0x7f0c3c159390 2023-10-06T04:28:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.886+0000 7f0c41d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c16aa30 con 0x7f0c3c0ab240 2023-10-06T04:28:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.887+0000 7f0c4159c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3c159760 0x7f0c3c169c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.887+0000 7f0c4159c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3c159760 0x7f0c3c169c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38590/0 (socket says 172.21.15.60:38590) 2023-10-06T04:28:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.887+0000 7f0c4159c700 1 -- 172.21.15.60:0/4098151234 learned_addr learned my addr 172.21.15.60:0/4098151234 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.887+0000 7f0c3bfff700 1 --2- 172.21.15.60:0/4098151234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c3c159390 0x7f0c3c155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.887+0000 7f0c40d9b700 1 --2- 172.21.15.60:0/4098151234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c3c0ab240 0x7f0c3c0b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.887+0000 7f0c4159c700 1 -- 172.21.15.60:0/4098151234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c3c0ab240 msgr2=0x7f0c3c0b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.887+0000 7f0c4159c700 1 --2- 172.21.15.60:0/4098151234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c3c0ab240 0x7f0c3c0b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.887+0000 7f0c4159c700 1 -- 172.21.15.60:0/4098151234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c3c159390 msgr2=0x7f0c3c155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:42.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.887+0000 7f0c4159c700 1 --2- 172.21.15.60:0/4098151234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c3c159390 0x7f0c3c155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:42.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.887+0000 7f0c4159c700 1 -- 172.21.15.60:0/4098151234 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c28009420 con 0x7f0c3c159760 2023-10-06T04:28:42.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.887+0000 7f0c3bfff700 1 --2- 172.21.15.60:0/4098151234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c3c159390 0x7f0c3c155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:42.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.887+0000 7f0c4159c700 1 --2- 172.21.15.60:0/4098151234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3c159760 0x7f0c3c169c50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400cbc0 tx=0x7f0c340019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:42.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.888+0000 7f0c38ff9700 1 -- 172.21.15.60:0/4098151234 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3400a940 con 0x7f0c3c159760 2023-10-06T04:28:42.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.888+0000 7f0c38ff9700 1 -- 172.21.15.60:0/4098151234 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3400aaa0 con 0x7f0c3c159760 2023-10-06T04:28:42.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.888+0000 7f0c38ff9700 1 -- 172.21.15.60:0/4098151234 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3400ae20 con 0x7f0c3c159760 2023-10-06T04:28:42.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.888+0000 7f0c41d9d700 1 -- 172.21.15.60:0/4098151234 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3c0b2fb0 con 0x7f0c3c159760 2023-10-06T04:28:42.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.888+0000 7f0c41d9d700 1 -- 172.21.15.60:0/4098151234 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3c097f40 con 0x7f0c3c159760 2023-10-06T04:28:42.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.889+0000 7f0c41d9d700 1 -- 172.21.15.60:0/4098151234 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c3c16ac50 con 0x7f0c3c159760 2023-10-06T04:28:42.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.890+0000 7f0c38ff9700 1 -- 172.21.15.60:0/4098151234 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c34007300 con 0x7f0c3c159760 2023-10-06T04:28:42.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.890+0000 7f0c38ff9700 1 --2- 172.21.15.60:0/4098151234 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0c20066f30 0x7f0c200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:42.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.890+0000 7f0c38ff9700 1 -- 172.21.15.60:0/4098151234 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0c34084e20 con 0x7f0c3c159760 2023-10-06T04:28:42.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.891+0000 7f0c40d9b700 1 --2- 172.21.15.60:0/4098151234 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0c20066f30 0x7f0c200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:42.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.891+0000 7f0c40d9b700 1 --2- 172.21.15.60:0/4098151234 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0c20066f30 0x7f0c200693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0c30006fd0 tx=0x7f0c30008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:42.897 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:42.895+0000 7f0c38ff9700 1 -- 172.21.15.60:0/4098151234 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c34051b90 con 0x7f0c3c159760 2023-10-06T04:28:43.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:43.146+0000 7f0c41d9d700 1 -- 172.21.15.60:0/4098151234 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0c3c05f230 con 0x7f0c3c159760 2023-10-06T04:28:43.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:43.146+0000 7f0c38ff9700 1 -- 172.21.15.60:0/4098151234 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0c340551b0 con 0x7f0c3c159760 2023-10-06T04:28:43.149 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T04:28:43.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:43.148+0000 7f0c41d9d700 1 -- 172.21.15.60:0/4098151234 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0c20066f30 msgr2=0x7f0c200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:43.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:43.148+0000 7f0c41d9d700 1 --2- 172.21.15.60:0/4098151234 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0c20066f30 0x7f0c200693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0c30006fd0 tx=0x7f0c30008040 comp rx=0 tx=0).stop 2023-10-06T04:28:43.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:43.148+0000 7f0c41d9d700 1 -- 172.21.15.60:0/4098151234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3c159760 msgr2=0x7f0c3c169c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:43.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:43.148+0000 7f0c41d9d700 1 --2- 172.21.15.60:0/4098151234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3c159760 0x7f0c3c169c50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400cbc0 tx=0x7f0c340019c0 comp rx=0 tx=0).stop 2023-10-06T04:28:43.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:43.149+0000 7f0c41d9d700 1 -- 172.21.15.60:0/4098151234 shutdown_connections 2023-10-06T04:28:43.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:43.149+0000 7f0c41d9d700 1 --2- 172.21.15.60:0/4098151234 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0c20066f30 0x7f0c200693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:43.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:43.149+0000 7f0c41d9d700 1 --2- 172.21.15.60:0/4098151234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3c159760 0x7f0c3c169c50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:43.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:43.149+0000 7f0c41d9d700 1 --2- 172.21.15.60:0/4098151234 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c3c0ab240 0x7f0c3c0b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:43.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:43.149+0000 7f0c41d9d700 1 --2- 172.21.15.60:0/4098151234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c3c159390 0x7f0c3c155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:43.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:43.149+0000 7f0c41d9d700 1 -- 172.21.15.60:0/4098151234 >> 172.21.15.60:0/4098151234 conn(0x7f0c3c097410 msgr2=0x7f0c3c0af820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:43.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:43.149+0000 7f0c41d9d700 1 -- 172.21.15.60:0/4098151234 shutdown_connections 2023-10-06T04:28:43.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:43.149+0000 7f0c41d9d700 1 -- 172.21.15.60:0/4098151234 wait complete. 2023-10-06T04:28:43.168 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:28:43.168 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:28:43.168 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2023-10-06T04:28:43.168 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T04:28:43.169 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T04:28:43.169 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:28:43.169 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:28:43.169 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:28:43.169 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T04:28:43.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:43.169 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2023-10-06T04:28:43.210 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:28:43.210 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:28:43.210 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:28:43.210 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:43.210 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2023-10-06T04:28:43.211 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:43.211 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:28:43.211 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:43.211 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2023-10-06T04:28:43.211 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:28:43.211 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:43.212 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2023-10-06T04:28:43.212 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:28:43.212 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:43.212 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:28:43.212 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:43.212 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T04:28:43.212 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42254sec preferred_lft 42254sec 2023-10-06T04:28:43.212 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::ec4:7aff:fe88:8083/64 scope link 2023-10-06T04:28:43.212 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:43.212 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T04:28:43.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:43.213 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-10-06T04:28:43.213 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-10-06T04:28:43.213 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add name ceph-brx type bridge 2023-10-06T04:28:43.213 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr flush dev ceph-brx 2023-10-06T04:28:43.213 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set ceph-brx up 2023-10-06T04:28:43.213 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T04:28:43.213 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-10-06T04:28:43.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:43.706 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:28:43.769 INFO:teuthology.orchestra.run.smithi135.stdout:1 2023-10-06T04:28:43.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:43.772 DEBUG:teuthology.orchestra.run.smithi135:> route 2023-10-06T04:28:43.827 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2023-10-06T04:28:43.827 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:28:43.827 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:28:43.827 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T04:28:43.827 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:28:43.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:43.829 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-10-06T04:28:43.829 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-10-06T04:28:43.829 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:28:43.829 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:28:43.829 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:28:43.829 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-10-06T04:28:44.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:44.552 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-10-06T04:28:44.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:44.588 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2023-10-06T04:28:44.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:44.665 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-10-06T04:28:44.665 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-10-06T04:28:44.665 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:28:44.665 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T04:28:44.665 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-10-06T04:28:44.831 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T04:28:44.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:44.832 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-10-06T04:28:44.832 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-10-06T04:28:44.832 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T04:28:44.832 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T04:28:44.832 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T04:28:44.832 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T04:28:44.832 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T04:28:44.832 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-10-06T04:28:45.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:45.074 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-10-06T04:28:45.074 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-10-06T04:28:45.074 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.0 up 2023-10-06T04:28:45.074 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T04:28:45.074 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-10-06T04:28:45.230 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:28:45.230 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T04:28:45.266 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T04:28:45.266 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:28:45.266 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T04:28:45.342 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:28:45.342 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:28:45.342 DEBUG:teuthology.orchestra.run.smithi135:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T04:28:45.491 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T04:28:45.491 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T04:28:45.491 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2023-10-06T04:28:45.950 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T04:28:45.950 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T04:28:45.950 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2023-10-06T04:28:45.950 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-06T04:28:45.950 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:28:45.974 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T04:28:45.974 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T04:28:45.974 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2023-10-06T04:28:45.975 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-06T04:28:45.975 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:28:45.975 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.135:6789,172.21.15.135:6790" 2023-10-06T04:28:45.975 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2023-10-06T04:28:45.975 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=caf6a2b8-149e-4228-9a04-404e2d811afd" will pass to kernel 2023-10-06T04:28:45.980 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:28:45.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:45.981 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T04:28:46.042 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-10-06T04:28:46.042 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:28:46.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.237+0000 7f0896f9d700 1 Processor -- start 2023-10-06T04:28:46.239 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.237+0000 7f0896f9d700 1 -- start start 2023-10-06T04:28:46.243 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.238+0000 7f0896f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0890159440 0x7f08900b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:46.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.238+0000 7f0896f9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f08900b35d0 0x7f08900cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:46.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.238+0000 7f0896f9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08900cb7a0 con 0x7f08900cc170 2023-10-06T04:28:46.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.238+0000 7f0896f9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08900b0860 con 0x7f08900b35d0 2023-10-06T04:28:46.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.238+0000 7f0896f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08900cb150 con 0x7f0890159440 2023-10-06T04:28:46.244 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.238+0000 7f089679c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f08900cc170 0x7f08900b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42324/0 (socket says 172.21.15.60:42324) 2023-10-06T04:28:46.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.238+0000 7f089679c700 1 -- 172.21.15.60:0/3249614398 learned_addr learned my addr 172.21.15.60:0/3249614398 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:46.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.238+0000 7f089579a700 1 --2- 172.21.15.60:0/3249614398 >> v2:172.21.15.60:3300/0 conn(0x7f08900b35d0 0x7f08900cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:46.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.239+0000 7f0894f99700 1 -- 172.21.15.60:0/3249614398 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862637878 0 0) 0x7f08900cb7a0 con 0x7f08900cc170 2023-10-06T04:28:46.245 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.239+0000 7f0894f99700 1 -- 172.21.15.60:0/3249614398 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f087c003570 con 0x7f08900cc170 2023-10-06T04:28:46.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.239+0000 7f0895f9b700 1 --2- 172.21.15.60:0/3249614398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0890159440 0x7f08900b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:46.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.239+0000 7f089579a700 1 -- 172.21.15.60:0/3249614398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0890159440 msgr2=0x7f08900b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:46.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.239+0000 7f089579a700 1 --2- 172.21.15.60:0/3249614398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0890159440 0x7f08900b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:46.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.239+0000 7f089579a700 1 -- 172.21.15.60:0/3249614398 >> v1:172.21.15.60:6789/0 conn(0x7f08900cc170 legacy=0x7f08900b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:46.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.239+0000 7f089579a700 1 -- 172.21.15.60:0/3249614398 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08900cb430 con 0x7f08900b35d0 2023-10-06T04:28:46.246 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.239+0000 7f0895f9b700 1 --2- 172.21.15.60:0/3249614398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0890159440 0x7f08900b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:46.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.239+0000 7f089579a700 1 --2- 172.21.15.60:0/3249614398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08900b35d0 0x7f08900cbc30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f08800098e0 tx=0x7f08800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a3e031471b3d68 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:46.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.239+0000 7f0894f99700 1 -- 172.21.15.60:0/3249614398 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088000b640 con 0x7f08900b35d0 2023-10-06T04:28:46.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.240+0000 7f0894f99700 1 -- 172.21.15.60:0/3249614398 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088000b7a0 con 0x7f08900b35d0 2023-10-06T04:28:46.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.240+0000 7f0894f99700 1 -- 172.21.15.60:0/3249614398 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088000bb40 con 0x7f08900b35d0 2023-10-06T04:28:46.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.240+0000 7f0896f9d700 1 -- 172.21.15.60:0/3249614398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08900b35d0 msgr2=0x7f08900cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:46.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.240+0000 7f0896f9d700 1 --2- 172.21.15.60:0/3249614398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08900b35d0 0x7f08900cbc30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f08800098e0 tx=0x7f08800091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:46.247 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.240+0000 7f0896f9d700 1 -- 172.21.15.60:0/3249614398 shutdown_connections 2023-10-06T04:28:46.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.240+0000 7f0896f9d700 1 --2- 172.21.15.60:0/3249614398 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0890159440 0x7f08900b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:46.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.240+0000 7f0896f9d700 1 --2- 172.21.15.60:0/3249614398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08900b35d0 0x7f08900cbc30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:46.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.240+0000 7f0896f9d700 1 -- 172.21.15.60:0/3249614398 >> 172.21.15.60:0/3249614398 conn(0x7f089006ece0 msgr2=0x7f089006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:46.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.240+0000 7f0896f9d700 1 -- 172.21.15.60:0/3249614398 shutdown_connections 2023-10-06T04:28:46.248 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.240+0000 7f0896f9d700 1 -- 172.21.15.60:0/3249614398 wait complete. 2023-10-06T04:28:46.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.242+0000 7f0896f9d700 1 Processor -- start 2023-10-06T04:28:46.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.242+0000 7f0896f9d700 1 -- start start 2023-10-06T04:28:46.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.243+0000 7f0896f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08900b35d0 0x7f089015fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:46.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.243+0000 7f0896f9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08900cc170 0x7f0890153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:46.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.243+0000 7f0896f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0890159440 0x7f08900b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:46.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.243+0000 7f0896f9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08900c6ef0 con 0x7f08900cc170 2023-10-06T04:28:46.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.243+0000 7f0896f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08900c6930 con 0x7f08900b35d0 2023-10-06T04:28:46.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.243+0000 7f0896f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08900c6c10 con 0x7f0890159440 2023-10-06T04:28:46.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.243+0000 7f089579a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08900cc170 0x7f0890153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:46.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.243+0000 7f089579a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08900cc170 0x7f0890153ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49290/0 (socket says 172.21.15.60:49290) 2023-10-06T04:28:46.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.243+0000 7f089579a700 1 -- 172.21.15.60:0/461991298 learned_addr learned my addr 172.21.15.60:0/461991298 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:46.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.243+0000 7f0895f9b700 1 --2- 172.21.15.60:0/461991298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08900b35d0 0x7f089015fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:46.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.243+0000 7f089679c700 1 --2- 172.21.15.60:0/461991298 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0890159440 0x7f08900b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:46.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.244+0000 7f089579a700 1 -- 172.21.15.60:0/461991298 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0890159440 msgr2=0x7f08900b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:46.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.244+0000 7f089579a700 1 --2- 172.21.15.60:0/461991298 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0890159440 0x7f08900b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:46.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.244+0000 7f089579a700 1 -- 172.21.15.60:0/461991298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08900b35d0 msgr2=0x7f089015fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:46.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.244+0000 7f089579a700 1 --2- 172.21.15.60:0/461991298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08900b35d0 0x7f089015fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:46.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.244+0000 7f089579a700 1 -- 172.21.15.60:0/461991298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0880009420 con 0x7f08900cc170 2023-10-06T04:28:46.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.244+0000 7f089579a700 1 --2- 172.21.15.60:0/461991298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08900cc170 0x7f0890153ec0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0890069150 tx=0x7f0880017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:46.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.244+0000 7f0885ffb700 1 -- 172.21.15.60:0/461991298 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088001bc40 con 0x7f08900cc170 2023-10-06T04:28:46.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.244+0000 7f0885ffb700 1 -- 172.21.15.60:0/461991298 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088001bdc0 con 0x7f08900cc170 2023-10-06T04:28:46.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.244+0000 7f0885ffb700 1 -- 172.21.15.60:0/461991298 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0880011670 con 0x7f08900cc170 2023-10-06T04:28:46.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.244+0000 7f0896f9d700 1 -- 172.21.15.60:0/461991298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f089015aee0 con 0x7f08900cc170 2023-10-06T04:28:46.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.244+0000 7f0896f9d700 1 -- 172.21.15.60:0/461991298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0890160180 con 0x7f08900cc170 2023-10-06T04:28:46.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.245+0000 7f0896f9d700 1 -- 172.21.15.60:0/461991298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f089015ad40 con 0x7f08900cc170 2023-10-06T04:28:46.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.246+0000 7f0885ffb700 1 -- 172.21.15.60:0/461991298 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0880011a20 con 0x7f08900cc170 2023-10-06T04:28:46.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.247+0000 7f0885ffb700 1 --2- 172.21.15.60:0/461991298 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0874066f30 0x7f08740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:46.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.247+0000 7f0885ffb700 1 -- 172.21.15.60:0/461991298 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0880085f80 con 0x7f08900cc170 2023-10-06T04:28:46.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.247+0000 7f0895f9b700 1 --2- 172.21.15.60:0/461991298 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0874066f30 0x7f08740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:46.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.248+0000 7f0895f9b700 1 --2- 172.21.15.60:0/461991298 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0874066f30 0x7f08740693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f088c006fd0 tx=0x7f088c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:46.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.251+0000 7f0885ffb700 1 -- 172.21.15.60:0/461991298 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f089015ad40 con 0x7f08900cc170 2023-10-06T04:28:46.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.503+0000 7f0896f9d700 1 -- 172.21.15.60:0/461991298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f089015ad40 con 0x7f08900cc170 2023-10-06T04:28:46.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.504+0000 7f0885ffb700 1 -- 172.21.15.60:0/461991298 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0880015070 con 0x7f08900cc170 2023-10-06T04:28:46.506 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T04:28:46.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.506+0000 7f0896f9d700 1 -- 172.21.15.60:0/461991298 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0874066f30 msgr2=0x7f08740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:46.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.506+0000 7f0896f9d700 1 --2- 172.21.15.60:0/461991298 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0874066f30 0x7f08740693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f088c006fd0 tx=0x7f088c008040 comp rx=0 tx=0).stop 2023-10-06T04:28:46.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.506+0000 7f0896f9d700 1 -- 172.21.15.60:0/461991298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08900cc170 msgr2=0x7f0890153ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:46.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.506+0000 7f0896f9d700 1 --2- 172.21.15.60:0/461991298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08900cc170 0x7f0890153ec0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0890069150 tx=0x7f0880017000 comp rx=0 tx=0).stop 2023-10-06T04:28:46.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.506+0000 7f0896f9d700 1 -- 172.21.15.60:0/461991298 shutdown_connections 2023-10-06T04:28:46.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.506+0000 7f0896f9d700 1 --2- 172.21.15.60:0/461991298 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0874066f30 0x7f08740693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:46.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.506+0000 7f0896f9d700 1 --2- 172.21.15.60:0/461991298 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0890159440 0x7f08900b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:46.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.506+0000 7f0896f9d700 1 --2- 172.21.15.60:0/461991298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08900b35d0 0x7f089015fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:46.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.506+0000 7f0896f9d700 1 --2- 172.21.15.60:0/461991298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08900cc170 0x7f0890153ec0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:46.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.506+0000 7f0896f9d700 1 -- 172.21.15.60:0/461991298 >> 172.21.15.60:0/461991298 conn(0x7f089006ece0 msgr2=0x7f08901566c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:46.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.506+0000 7f0896f9d700 1 -- 172.21.15.60:0/461991298 shutdown_connections 2023-10-06T04:28:46.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:46.506+0000 7f0896f9d700 1 -- 172.21.15.60:0/461991298 wait complete. 2023-10-06T04:28:46.526 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T04:28:46.526 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:28:46.526 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2023-10-06T04:28:46.526 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T04:28:46.526 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T04:28:46.526 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T04:28:46.527 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T04:28:46.527 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:28:46.527 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T04:28:46.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:46.527 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2023-10-06T04:28:46.564 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:28:46.564 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:28:46.564 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:28:46.564 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:46.564 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2023-10-06T04:28:46.564 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:46.565 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:28:46.565 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:46.565 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2023-10-06T04:28:46.565 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:28:46.565 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:46.565 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2023-10-06T04:28:46.565 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:28:46.565 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:46.565 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:28:46.565 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:46.565 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T04:28:46.565 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42251sec preferred_lft 42251sec 2023-10-06T04:28:46.566 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::ec4:7aff:fe88:8083/64 scope link 2023-10-06T04:28:46.566 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:46.566 INFO:teuthology.orchestra.run.smithi135.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:28:46.566 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether fe:7f:f2:3b:fc:48 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:28:46.566 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:28:46.566 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:46.566 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::48bb:cdff:fe4f:74e1/64 scope link 2023-10-06T04:28:46.566 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:46.566 INFO:teuthology.orchestra.run.smithi135.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:28:46.566 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether fe:7f:f2:3b:fc:48 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:28:46.566 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::fc7f:f2ff:fe3b:fc48/64 scope link tentative 2023-10-06T04:28:46.567 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:46.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:46.567 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:28:46.663 INFO:teuthology.orchestra.run.smithi135.stdout:1 2023-10-06T04:28:46.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:46.666 DEBUG:teuthology.orchestra.run.smithi135:> route 2023-10-06T04:28:46.705 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2023-10-06T04:28:46.705 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:28:46.705 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T04:28:46.705 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T04:28:46.705 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:28:46.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:46.706 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-10-06T04:28:46.706 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-10-06T04:28:46.706 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T04:28:46.706 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T04:28:46.706 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T04:28:46.706 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-10-06T04:28:46.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:46.898 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-10-06T04:28:46.934 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T04:28:46.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:46.935 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2023-10-06T04:28:47.011 INFO:teuthology.orchestra.run.smithi135.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T04:28:47.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:47.011 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-10-06T04:28:47.012 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-10-06T04:28:47.012 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T04:28:47.012 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T04:28:47.012 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-10-06T04:28:47.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:47.177 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T04:28:47.237 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:28:47.237 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:28:47.237 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:28:47.237 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:47.237 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2023-10-06T04:28:47.237 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:47.237 INFO:teuthology.orchestra.run.smithi135.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:28:47.237 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 46:53:66:92:89:52 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:28:47.237 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:28:47.237 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:47.238 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::4453:66ff:fe92:8952/64 scope link 2023-10-06T04:28:47.238 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:47.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:47.239 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T04:28:47.299 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:28:47.299 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:28:47.300 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:28:47.300 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:47.300 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2023-10-06T04:28:47.300 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:47.300 INFO:teuthology.orchestra.run.smithi135.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:28:47.300 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 46:53:66:92:89:52 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T04:28:47.300 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T04:28:47.300 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:47.300 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::4453:66ff:fe92:8952/64 scope link 2023-10-06T04:28:47.300 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:28:47.302 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T04:28:47.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:47.303 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-10-06T04:28:47.303 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-10-06T04:28:47.303 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T04:28:47.303 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T04:28:47.303 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T04:28:47.303 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T04:28:47.303 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T04:28:47.303 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-10-06T04:28:47.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:47.533 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2023-10-06T04:28:47.533 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2023-10-06T04:28:47.533 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.1 up 2023-10-06T04:28:47.533 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T04:28:47.533 DEBUG:teuthology.orchestra.run.smithi135:> ') 2023-10-06T04:28:47.688 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:28:47.689 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T04:28:47.724 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T04:28:47.725 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:28:47.725 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T04:28:47.800 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:28:47.800 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:28:47.800 DEBUG:teuthology.orchestra.run.smithi135:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T04:28:47.929 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T04:28:47.929 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T04:28:47.929 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2023-10-06T04:28:47.945 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T04:28:47.945 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T04:28:47.945 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2023-10-06T04:28:47.945 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-06T04:28:47.945 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:28:47.967 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T04:28:47.968 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T04:28:47.968 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2023-10-06T04:28:47.968 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-06T04:28:47.968 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:28:47.968 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.135:6789,172.21.15.135:6790" 2023-10-06T04:28:47.968 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2023-10-06T04:28:47.968 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=caf6a2b8-149e-4228-9a04-404e2d811afd" will pass to kernel 2023-10-06T04:28:47.971 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:28:47.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:28:47.972 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T04:28:48.032 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T04:28:48.051 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:28:48.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.251+0000 7f55e239d700 1 Processor -- start 2023-10-06T04:28:48.253 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.251+0000 7f55e239d700 1 -- start start 2023-10-06T04:28:48.254 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.252+0000 7f55e239d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f55dc159b60 0x7f55dc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:48.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.252+0000 7f55e239d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55dc06e040 con 0x7f55dc0cb5a0 2023-10-06T04:28:48.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.252+0000 7f55e239d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55dc06e320 con 0x7f55dc06f310 2023-10-06T04:28:48.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.252+0000 7f55e239d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55dc06ebc0 con 0x7f55dc159b60 2023-10-06T04:28:48.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.252+0000 7f55e139b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f55dc0cb5a0 0x7f55dc06d5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42336/0 (socket says 172.21.15.60:42336) 2023-10-06T04:28:48.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.252+0000 7f55e139b700 1 -- 172.21.15.60:0/22178733 learned_addr learned my addr 172.21.15.60:0/22178733 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:48.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.253+0000 7f55e1b9c700 1 --2- 172.21.15.60:0/22178733 >> v2:172.21.15.135:3300/0 conn(0x7f55dc159b60 0x7f55dc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:48.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.253+0000 7f55d3fff700 1 -- 172.21.15.60:0/22178733 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691654900 0 0) 0x7f55dc06e040 con 0x7f55dc0cb5a0 2023-10-06T04:28:48.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.253+0000 7f55d3fff700 1 -- 172.21.15.60:0/22178733 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55c8004680 con 0x7f55dc0cb5a0 2023-10-06T04:28:48.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.253+0000 7f55d3fff700 1 -- 172.21.15.60:0/22178733 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4013758929 0 0) 0x7f55c8004680 con 0x7f55dc0cb5a0 2023-10-06T04:28:48.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.253+0000 7f55d3fff700 1 -- 172.21.15.60:0/22178733 >> v2:172.21.15.135:3300/0 conn(0x7f55dc159b60 msgr2=0x7f55dc0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:48.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.253+0000 7f55d3fff700 1 --2- 172.21.15.60:0/22178733 >> v2:172.21.15.135:3300/0 conn(0x7f55dc159b60 0x7f55dc0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:48.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.253+0000 7f55d3fff700 1 -- 172.21.15.60:0/22178733 >> v1:172.21.15.135:6789/0 conn(0x7f55dc06f310 legacy=0x7f55dc159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:48.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.253+0000 7f55d3fff700 1 -- 172.21.15.60:0/22178733 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc06e600 con 0x7f55dc0cb5a0 2023-10-06T04:28:48.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.253+0000 7f55d3fff700 1 -- 172.21.15.60:0/22178733 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7f55d8001470 con 0x7f55dc0cb5a0 2023-10-06T04:28:48.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.253+0000 7f55d3fff700 1 -- 172.21.15.60:0/22178733 >> v1:172.21.15.60:6789/0 conn(0x7f55dc0cb5a0 legacy=0x7f55dc06d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:48.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.253+0000 7f55d3fff700 1 --2- 172.21.15.60:0/22178733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55c8004b70 0x7f55c8004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:48.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.253+0000 7f55d3fff700 1 --2- 172.21.15.60:0/22178733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55c8005920 0x7f55c8005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:48.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.253+0000 7f55d3fff700 1 --2- 172.21.15.60:0/22178733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55c80062d0 0x7f55c8003490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:48.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.253+0000 7f55d3fff700 1 -- 172.21.15.60:0/22178733 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc06ebc0 con 0x7f55c8004b70 2023-10-06T04:28:48.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.253+0000 7f55d3fff700 1 -- 172.21.15.60:0/22178733 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c8003b00 con 0x7f55c8005920 2023-10-06T04:28:48.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.253+0000 7f55d3fff700 1 -- 172.21.15.60:0/22178733 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c8003cc0 con 0x7f55c80062d0 2023-10-06T04:28:48.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.254+0000 7f55e139b700 1 --2- 172.21.15.60:0/22178733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55c8004b70 0x7f55c8004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:48.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.254+0000 7f55e0b9a700 1 --2- 172.21.15.60:0/22178733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55c8005920 0x7f55c8005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:48.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.254+0000 7f55e1b9c700 1 --2- 172.21.15.60:0/22178733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55c80062d0 0x7f55c8003490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:48.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.254+0000 7f55e139b700 1 -- 172.21.15.60:0/22178733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55c80062d0 msgr2=0x7f55c8003490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:48.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.254+0000 7f55e139b700 1 --2- 172.21.15.60:0/22178733 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55c80062d0 0x7f55c8003490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:48.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.254+0000 7f55e139b700 1 -- 172.21.15.60:0/22178733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55c8005920 msgr2=0x7f55c8005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:48.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.254+0000 7f55e139b700 1 --2- 172.21.15.60:0/22178733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55c8005920 0x7f55c8005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:48.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.254+0000 7f55e139b700 1 -- 172.21.15.60:0/22178733 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c8004680 con 0x7f55c8004b70 2023-10-06T04:28:48.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.254+0000 7f55e1b9c700 1 -- 172.21.15.60:0/22178733 reap_dead start 2023-10-06T04:28:48.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.254+0000 7f55e139b700 1 --2- 172.21.15.60:0/22178733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55c8004b70 0x7f55c8004f80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f55d800c3c0 tx=0x7f55d8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad66a18da47d02f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:48.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.255+0000 7f55d3fff700 1 -- 172.21.15.60:0/22178733 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d800cc90 con 0x7f55c8004b70 2023-10-06T04:28:48.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.255+0000 7f55d3fff700 1 -- 172.21.15.60:0/22178733 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d800ce10 con 0x7f55c8004b70 2023-10-06T04:28:48.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.255+0000 7f55d3fff700 1 -- 172.21.15.60:0/22178733 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d8005b70 con 0x7f55c8004b70 2023-10-06T04:28:48.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.255+0000 7f55e239d700 1 -- 172.21.15.60:0/22178733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55c8004b70 msgr2=0x7f55c8004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:48.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.255+0000 7f55e239d700 1 --2- 172.21.15.60:0/22178733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55c8004b70 0x7f55c8004f80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f55d800c3c0 tx=0x7f55d8001e50 comp rx=0 tx=0).stop 2023-10-06T04:28:48.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.255+0000 7f55e239d700 1 -- 172.21.15.60:0/22178733 shutdown_connections 2023-10-06T04:28:48.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.255+0000 7f55e239d700 1 --2- 172.21.15.60:0/22178733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55c8004b70 0x7f55c8004f80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:48.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.255+0000 7f55e239d700 1 -- 172.21.15.60:0/22178733 >> 172.21.15.60:0/22178733 conn(0x7f55dc068080 msgr2=0x7f55dc0cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:48.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.255+0000 7f55e239d700 1 -- 172.21.15.60:0/22178733 shutdown_connections 2023-10-06T04:28:48.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.255+0000 7f55e239d700 1 -- 172.21.15.60:0/22178733 wait complete. 2023-10-06T04:28:48.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.257+0000 7f55e239d700 1 Processor -- start 2023-10-06T04:28:48.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.257+0000 7f55e239d700 1 -- start start 2023-10-06T04:28:48.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.258+0000 7f55e239d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55c8004b70 0x7f55dc0c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:48.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.258+0000 7f55e239d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55dc0b0c60 0x7f55dc0cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:48.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.258+0000 7f55e239d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55dc0cbfc0 0x7f55dc0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:48.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.258+0000 7f55e239d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc0c37a0 con 0x7f55dc0b0c60 2023-10-06T04:28:48.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.258+0000 7f55e239d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc0cc430 con 0x7f55dc0cbfc0 2023-10-06T04:28:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.258+0000 7f55e239d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc0aca90 con 0x7f55c8004b70 2023-10-06T04:28:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.258+0000 7f55e0b9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55dc0b0c60 0x7f55dc0cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.258+0000 7f55e0b9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55dc0b0c60 0x7f55dc0cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49306/0 (socket says 172.21.15.60:49306) 2023-10-06T04:28:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.258+0000 7f55e0b9a700 1 -- 172.21.15.60:0/248824862 learned_addr learned my addr 172.21.15.60:0/248824862 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.258+0000 7f55e139b700 1 --2- 172.21.15.60:0/248824862 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55c8004b70 0x7f55dc0c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.258+0000 7f55e1b9c700 1 --2- 172.21.15.60:0/248824862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55dc0cbfc0 0x7f55dc0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.258+0000 7f55e0b9a700 1 -- 172.21.15.60:0/248824862 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55c8004b70 msgr2=0x7f55dc0c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.258+0000 7f55e0b9a700 1 --2- 172.21.15.60:0/248824862 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55c8004b70 0x7f55dc0c5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:48.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.258+0000 7f55e0b9a700 1 -- 172.21.15.60:0/248824862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55dc0cbfc0 msgr2=0x7f55dc0aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:48.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.258+0000 7f55e0b9a700 1 --2- 172.21.15.60:0/248824862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55dc0cbfc0 0x7f55dc0aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:48.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.258+0000 7f55e0b9a700 1 -- 172.21.15.60:0/248824862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc0acd70 con 0x7f55dc0b0c60 2023-10-06T04:28:48.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.258+0000 7f55e139b700 1 --2- 172.21.15.60:0/248824862 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55c8004b70 0x7f55dc0c5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:48.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.258+0000 7f55e1b9c700 1 --2- 172.21.15.60:0/248824862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55dc0cbfc0 0x7f55dc0aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:48.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.258+0000 7f55e0b9a700 1 --2- 172.21.15.60:0/248824862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55dc0b0c60 0x7f55dc0cba80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f55cc002a30 tx=0x7f55cc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:48.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.259+0000 7f55d17fa700 1 -- 172.21.15.60:0/248824862 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc00f870 con 0x7f55dc0b0c60 2023-10-06T04:28:48.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.259+0000 7f55d17fa700 1 -- 172.21.15.60:0/248824862 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc00f9d0 con 0x7f55dc0b0c60 2023-10-06T04:28:48.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.259+0000 7f55d17fa700 1 -- 172.21.15.60:0/248824862 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc00fd70 con 0x7f55dc0b0c60 2023-10-06T04:28:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.259+0000 7f55e239d700 1 -- 172.21.15.60:0/248824862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55dc0ad050 con 0x7f55dc0b0c60 2023-10-06T04:28:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.259+0000 7f55e239d700 1 -- 172.21.15.60:0/248824862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55dc0ae3c0 con 0x7f55dc0b0c60 2023-10-06T04:28:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.260+0000 7f55e239d700 1 -- 172.21.15.60:0/248824862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55dc0c3930 con 0x7f55dc0b0c60 2023-10-06T04:28:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.261+0000 7f55d17fa700 1 -- 172.21.15.60:0/248824862 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55cc013600 con 0x7f55dc0b0c60 2023-10-06T04:28:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.262+0000 7f55d17fa700 1 --2- 172.21.15.60:0/248824862 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f55c0066f30 0x7f55c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.262+0000 7f55d17fa700 1 -- 172.21.15.60:0/248824862 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f55cc084ec0 con 0x7f55dc0b0c60 2023-10-06T04:28:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.262+0000 7f55e139b700 1 --2- 172.21.15.60:0/248824862 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f55c0066f30 0x7f55c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.262+0000 7f55e139b700 1 --2- 172.21.15.60:0/248824862 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f55c0066f30 0x7f55c00693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f55d8001ed0 tx=0x7f55d8015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.266+0000 7f55d17fa700 1 -- 172.21.15.60:0/248824862 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55dc0c3930 con 0x7f55dc0b0c60 2023-10-06T04:28:48.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.472+0000 7f55e239d700 1 -- 172.21.15.60:0/248824862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55dc0c38e0 con 0x7f55dc0b0c60 2023-10-06T04:28:48.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.473+0000 7f55d17fa700 1 -- 172.21.15.60:0/248824862 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7f55cc051ce0 con 0x7f55dc0b0c60 2023-10-06T04:28:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:48.476 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:28:11.290557+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:28:04.355358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:28:05.208550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:28:08.791979+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:28:48.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.475+0000 7f55e239d700 1 -- 172.21.15.60:0/248824862 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f55c0066f30 msgr2=0x7f55c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:48.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.475+0000 7f55e239d700 1 --2- 172.21.15.60:0/248824862 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f55c0066f30 0x7f55c00693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f55d8001ed0 tx=0x7f55d8015000 comp rx=0 tx=0).stop 2023-10-06T04:28:48.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.475+0000 7f55e239d700 1 -- 172.21.15.60:0/248824862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55dc0b0c60 msgr2=0x7f55dc0cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:48.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.475+0000 7f55e239d700 1 --2- 172.21.15.60:0/248824862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55dc0b0c60 0x7f55dc0cba80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f55cc002a30 tx=0x7f55cc007d30 comp rx=0 tx=0).stop 2023-10-06T04:28:48.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.475+0000 7f55e239d700 1 -- 172.21.15.60:0/248824862 shutdown_connections 2023-10-06T04:28:48.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.475+0000 7f55e239d700 1 --2- 172.21.15.60:0/248824862 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f55c0066f30 0x7f55c00693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:48.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.475+0000 7f55e239d700 1 --2- 172.21.15.60:0/248824862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55dc0cbfc0 0x7f55dc0aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:48.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.475+0000 7f55e239d700 1 --2- 172.21.15.60:0/248824862 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f55c8004b70 0x7f55dc0c5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:48.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.475+0000 7f55e239d700 1 --2- 172.21.15.60:0/248824862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55dc0b0c60 0x7f55dc0cba80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:48.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.475+0000 7f55e239d700 1 -- 172.21.15.60:0/248824862 >> 172.21.15.60:0/248824862 conn(0x7f55dc068080 msgr2=0x7f55dc0ca030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:48.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.475+0000 7f55e239d700 1 -- 172.21.15.60:0/248824862 shutdown_connections 2023-10-06T04:28:48.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.475+0000 7f55e239d700 1 -- 172.21.15.60:0/248824862 wait complete. 2023-10-06T04:28:48.495 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:27:58.899938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:27:59.373527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:28:04.355358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:28:05.208550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:28:08.791979+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:28:48.496 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:28:48.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.683+0000 7f6c5679d700 1 Processor -- start 2023-10-06T04:28:48.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.683+0000 7f6c5679d700 1 -- start start 2023-10-06T04:28:48.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.684+0000 7f6c5679d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c500b2620 0x7f6c500cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:48.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.685+0000 7f6c5679d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6c500b29f0 0x7f6c500cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:48.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.685+0000 7f6c5679d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c500cc970 con 0x7f6c500ceaa0 2023-10-06T04:28:48.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.685+0000 7f6c5679d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c500cbd60 con 0x7f6c500b29f0 2023-10-06T04:28:48.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.685+0000 7f6c5679d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c500cc040 con 0x7f6c500b2620 2023-10-06T04:28:48.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.685+0000 7f6c5579b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c500b2620 0x7f6c500cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:48.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.685+0000 7f6c54f9a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6c500b29f0 0x7f6c500cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:48.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.685+0000 7f6c5579b700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c500b2620 0x7f6c500cccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:46804/0 (socket says 172.21.15.60:46804) 2023-10-06T04:28:48.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.685+0000 7f6c5579b700 1 -- 172.21.15.60:0/3852351669 learned_addr learned my addr 172.21.15.60:0/3852351669 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:48.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.686+0000 7f6c5579b700 1 -- 172.21.15.60:0/3852351669 >> v2:172.21.15.135:3300/0 conn(0x7f6c500b29f0 msgr2=0x7f6c500cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:48.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.686+0000 7f6c5579b700 1 --2- 172.21.15.60:0/3852351669 >> v2:172.21.15.135:3300/0 conn(0x7f6c500b29f0 0x7f6c500cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:48.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.686+0000 7f6c5579b700 1 -- 172.21.15.60:0/3852351669 >> v1:172.21.15.135:6789/0 conn(0x7f6c500ceaa0 legacy=0x7f6c500cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:48.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.686+0000 7f6c5579b700 1 -- 172.21.15.60:0/3852351669 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c500cc320 con 0x7f6c500b2620 2023-10-06T04:28:48.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.686+0000 7f6c47fff700 1 -- 172.21.15.60:0/3852351669 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2142160889 0 0) 0x7f6c500cc970 con 0x7f6c500ceaa0 2023-10-06T04:28:48.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.686+0000 7f6c54f9a700 1 --2- 172.21.15.60:0/3852351669 >> v2:172.21.15.135:3300/0 conn(0x7f6c500b29f0 0x7f6c500cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:48.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.686+0000 7f6c5579b700 1 --2- 172.21.15.60:0/3852351669 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c500b2620 0x7f6c500cccb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009990 tx=0x7f6c4c009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4fadf4bb0cc3d65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:48.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.686+0000 7f6c47fff700 1 -- 172.21.15.60:0/3852351669 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c009e80 con 0x7f6c500b2620 2023-10-06T04:28:48.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.686+0000 7f6c47fff700 1 -- 172.21.15.60:0/3852351669 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c005c10 con 0x7f6c500b2620 2023-10-06T04:28:48.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.686+0000 7f6c47fff700 1 -- 172.21.15.60:0/3852351669 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c00b650 con 0x7f6c500b2620 2023-10-06T04:28:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.687+0000 7f6c5679d700 1 -- 172.21.15.60:0/3852351669 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c500b2620 msgr2=0x7f6c500cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.687+0000 7f6c5679d700 1 --2- 172.21.15.60:0/3852351669 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c500b2620 0x7f6c500cccb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009990 tx=0x7f6c4c009220 comp rx=0 tx=0).stop 2023-10-06T04:28:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.687+0000 7f6c5679d700 1 -- 172.21.15.60:0/3852351669 shutdown_connections 2023-10-06T04:28:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.687+0000 7f6c5679d700 1 --2- 172.21.15.60:0/3852351669 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c500b2620 0x7f6c500cccb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.687+0000 7f6c5679d700 1 --2- 172.21.15.60:0/3852351669 >> v2:172.21.15.135:3300/0 conn(0x7f6c500b29f0 0x7f6c500cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.687+0000 7f6c5679d700 1 -- 172.21.15.60:0/3852351669 >> 172.21.15.60:0/3852351669 conn(0x7f6c50099520 msgr2=0x7f6c5006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.687+0000 7f6c5679d700 1 -- 172.21.15.60:0/3852351669 shutdown_connections 2023-10-06T04:28:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.687+0000 7f6c5679d700 1 -- 172.21.15.60:0/3852351669 wait complete. 2023-10-06T04:28:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.688+0000 7f6c5679d700 1 Processor -- start 2023-10-06T04:28:48.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.689+0000 7f6c5679d700 1 -- start start 2023-10-06T04:28:48.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.689+0000 7f6c5679d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c500b2620 0x7f6c500b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:48.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.689+0000 7f6c5679d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c500b29f0 0x7f6c500b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:48.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.689+0000 7f6c5679d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c500ceaa0 0x7f6c50153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:48.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.689+0000 7f6c5679d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c500b3640 con 0x7f6c500b29f0 2023-10-06T04:28:48.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.689+0000 7f6c5679d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5009b3b0 con 0x7f6c500ceaa0 2023-10-06T04:28:48.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.689+0000 7f6c5679d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c500b3850 con 0x7f6c500b2620 2023-10-06T04:28:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.690+0000 7f6c54f9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c500b29f0 0x7f6c500b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.690+0000 7f6c54f9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c500b29f0 0x7f6c500b3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49316/0 (socket says 172.21.15.60:49316) 2023-10-06T04:28:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.690+0000 7f6c54f9a700 1 -- 172.21.15.60:0/3857960881 learned_addr learned my addr 172.21.15.60:0/3857960881 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.690+0000 7f6c5579b700 1 --2- 172.21.15.60:0/3857960881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c500b2620 0x7f6c500b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.690+0000 7f6c55f9c700 1 --2- 172.21.15.60:0/3857960881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c500ceaa0 0x7f6c50153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.690+0000 7f6c54f9a700 1 -- 172.21.15.60:0/3857960881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c500b2620 msgr2=0x7f6c500b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.690+0000 7f6c54f9a700 1 --2- 172.21.15.60:0/3857960881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c500b2620 0x7f6c500b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.690+0000 7f6c54f9a700 1 -- 172.21.15.60:0/3857960881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c500ceaa0 msgr2=0x7f6c50153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.690+0000 7f6c54f9a700 1 --2- 172.21.15.60:0/3857960881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c500ceaa0 0x7f6c50153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.690+0000 7f6c54f9a700 1 -- 172.21.15.60:0/3857960881 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c40009420 con 0x7f6c500b29f0 2023-10-06T04:28:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.690+0000 7f6c54f9a700 1 --2- 172.21.15.60:0/3857960881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c500b29f0 0x7f6c500b3100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000ec80 tx=0x7f6c400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:48.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.691+0000 7f6c457fa700 1 -- 172.21.15.60:0/3857960881 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4000c920 con 0x7f6c500b29f0 2023-10-06T04:28:48.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.691+0000 7f6c457fa700 1 -- 172.21.15.60:0/3857960881 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4000ca80 con 0x7f6c500b29f0 2023-10-06T04:28:48.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.691+0000 7f6c457fa700 1 -- 172.21.15.60:0/3857960881 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4000ce00 con 0x7f6c500b29f0 2023-10-06T04:28:48.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.691+0000 7f6c5679d700 1 -- 172.21.15.60:0/3857960881 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c009480 con 0x7f6c500b29f0 2023-10-06T04:28:48.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.691+0000 7f6c5679d700 1 -- 172.21.15.60:0/3857960881 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c500b3e10 con 0x7f6c500b29f0 2023-10-06T04:28:48.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.692+0000 7f6c5679d700 1 -- 172.21.15.60:0/3857960881 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c5009b4f0 con 0x7f6c500b29f0 2023-10-06T04:28:48.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.693+0000 7f6c457fa700 1 -- 172.21.15.60:0/3857960881 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c40013680 con 0x7f6c500b29f0 2023-10-06T04:28:48.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.694+0000 7f6c457fa700 1 --2- 172.21.15.60:0/3857960881 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6c34066f30 0x7f6c340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:48.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.694+0000 7f6c457fa700 1 -- 172.21.15.60:0/3857960881 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6c40084d80 con 0x7f6c500b29f0 2023-10-06T04:28:48.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.694+0000 7f6c5579b700 1 --2- 172.21.15.60:0/3857960881 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6c34066f30 0x7f6c340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:48.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.695+0000 7f6c5579b700 1 --2- 172.21.15.60:0/3857960881 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6c34066f30 0x7f6c340693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009260 tx=0x7f6c4c016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:48.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.698+0000 7f6c457fa700 1 -- 172.21.15.60:0/3857960881 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c40051ba0 con 0x7f6c500b29f0 2023-10-06T04:28:48.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.900+0000 7f6c5679d700 1 -- 172.21.15.60:0/3857960881 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6c5005f230 con 0x7f6c500b29f0 2023-10-06T04:28:48.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.900+0000 7f6c457fa700 1 -- 172.21.15.60:0/3857960881 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6c400170a0 con 0x7f6c500b29f0 2023-10-06T04:28:48.903 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-10-06T04:28:48.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.903+0000 7f6c5679d700 1 -- 172.21.15.60:0/3857960881 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6c34066f30 msgr2=0x7f6c340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:48.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.903+0000 7f6c5679d700 1 --2- 172.21.15.60:0/3857960881 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6c34066f30 0x7f6c340693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009260 tx=0x7f6c4c016000 comp rx=0 tx=0).stop 2023-10-06T04:28:48.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.903+0000 7f6c5679d700 1 -- 172.21.15.60:0/3857960881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c500b29f0 msgr2=0x7f6c500b3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:48.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.903+0000 7f6c5679d700 1 --2- 172.21.15.60:0/3857960881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c500b29f0 0x7f6c500b3100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000ec80 tx=0x7f6c400091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:48.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.903+0000 7f6c5679d700 1 -- 172.21.15.60:0/3857960881 shutdown_connections 2023-10-06T04:28:48.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.903+0000 7f6c5679d700 1 --2- 172.21.15.60:0/3857960881 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6c34066f30 0x7f6c340693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:48.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.903+0000 7f6c5679d700 1 --2- 172.21.15.60:0/3857960881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c500ceaa0 0x7f6c50153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:48.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.903+0000 7f6c5679d700 1 --2- 172.21.15.60:0/3857960881 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c500b2620 0x7f6c500b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:48.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.903+0000 7f6c5679d700 1 --2- 172.21.15.60:0/3857960881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c500b29f0 0x7f6c500b3100 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:48.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.903+0000 7f6c5679d700 1 -- 172.21.15.60:0/3857960881 >> 172.21.15.60:0/3857960881 conn(0x7f6c50099520 msgr2=0x7f6c500692e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:48.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.903+0000 7f6c5679d700 1 -- 172.21.15.60:0/3857960881 shutdown_connections 2023-10-06T04:28:48.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:48.903+0000 7f6c5679d700 1 -- 172.21.15.60:0/3857960881 wait complete. 2023-10-06T04:28:48.923 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:28:49.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.111+0000 7f35d239d700 1 Processor -- start 2023-10-06T04:28:49.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.111+0000 7f35d239d700 1 -- start start 2023-10-06T04:28:49.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.113+0000 7f35d239d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35cc06e9f0 0x7f35cc06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:49.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.113+0000 7f35d239d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f35cc155db0 0x7f35cc1561f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:49.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.113+0000 7f35d239d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35cc0ad7f0 con 0x7f35cc0cb770 2023-10-06T04:28:49.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.113+0000 7f35d239d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35cc150320 con 0x7f35cc155db0 2023-10-06T04:28:49.115 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.113+0000 7f35d239d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc06f3b0 con 0x7f35cc06e9f0 2023-10-06T04:28:49.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.113+0000 7f35d1b9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f35cc155db0 0x7f35cc1561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:49.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.113+0000 7f35d0b9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35cc06e9f0 0x7f35cc06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:49.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.113+0000 7f35d139b700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f35cc0cb770 0x7f35cc156f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.60:50706/0 (socket says 172.21.15.60:50706) 2023-10-06T04:28:49.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.113+0000 7f35d139b700 1 -- 172.21.15.60:0/117498663 learned_addr learned my addr 172.21.15.60:0/117498663 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:49.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.114+0000 7f35d1b9c700 1 -- 172.21.15.60:0/117498663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35cc06e9f0 msgr2=0x7f35cc06ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:49.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.114+0000 7f35d1b9c700 1 --2- 172.21.15.60:0/117498663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35cc06e9f0 0x7f35cc06ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.114+0000 7f35d1b9c700 1 -- 172.21.15.60:0/117498663 >> v1:172.21.15.135:6789/0 conn(0x7f35cc0cb770 legacy=0x7f35cc156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:49.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.114+0000 7f35c3fff700 1 -- 172.21.15.60:0/117498663 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085113234 0 0) 0x7f35cc0ad7f0 con 0x7f35cc0cb770 2023-10-06T04:28:49.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.114+0000 7f35d1b9c700 1 -- 172.21.15.60:0/117498663 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc156b50 con 0x7f35cc155db0 2023-10-06T04:28:49.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.114+0000 7f35d1b9c700 1 --2- 172.21.15.60:0/117498663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35cc155db0 0x7f35cc1561f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f35c4009e90 tx=0x7f35c4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb802fd0cb899987 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:49.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.114+0000 7f35c3fff700 1 -- 172.21.15.60:0/117498663 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c400e070 con 0x7f35cc155db0 2023-10-06T04:28:49.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.114+0000 7f35c3fff700 1 -- 172.21.15.60:0/117498663 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c400bbf0 con 0x7f35cc155db0 2023-10-06T04:28:49.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.114+0000 7f35c3fff700 1 -- 172.21.15.60:0/117498663 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4012430 con 0x7f35cc155db0 2023-10-06T04:28:49.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.115+0000 7f35d239d700 1 -- 172.21.15.60:0/117498663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35cc155db0 msgr2=0x7f35cc1561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:49.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.115+0000 7f35d239d700 1 --2- 172.21.15.60:0/117498663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35cc155db0 0x7f35cc1561f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f35c4009e90 tx=0x7f35c4009780 comp rx=0 tx=0).stop 2023-10-06T04:28:49.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.115+0000 7f35d239d700 1 -- 172.21.15.60:0/117498663 shutdown_connections 2023-10-06T04:28:49.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.115+0000 7f35d239d700 1 --2- 172.21.15.60:0/117498663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35cc155db0 0x7f35cc1561f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.115+0000 7f35d239d700 1 --2- 172.21.15.60:0/117498663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35cc06e9f0 0x7f35cc06ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.115+0000 7f35d239d700 1 -- 172.21.15.60:0/117498663 >> 172.21.15.60:0/117498663 conn(0x7f35cc0cbed0 msgr2=0x7f35cc0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:49.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.115+0000 7f35d239d700 1 -- 172.21.15.60:0/117498663 shutdown_connections 2023-10-06T04:28:49.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.115+0000 7f35d239d700 1 -- 172.21.15.60:0/117498663 wait complete. 2023-10-06T04:28:49.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.116+0000 7f35d239d700 1 Processor -- start 2023-10-06T04:28:49.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.117+0000 7f35d239d700 1 -- start start 2023-10-06T04:28:49.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.117+0000 7f35d239d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35cc06e9f0 0x7f35cc152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:49.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.117+0000 7f35d239d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35cc0cb770 0x7f35cc13e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:49.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.117+0000 7f35d239d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35cc155db0 0x7f35cc13cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:49.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.117+0000 7f35d239d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc13c8b0 con 0x7f35cc06e9f0 2023-10-06T04:28:49.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.117+0000 7f35d239d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc150e40 con 0x7f35cc0cb770 2023-10-06T04:28:49.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.117+0000 7f35d239d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc13baf0 con 0x7f35cc155db0 2023-10-06T04:28:49.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.118+0000 7f35d139b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35cc06e9f0 0x7f35cc152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:49.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.118+0000 7f35d139b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35cc06e9f0 0x7f35cc152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49326/0 (socket says 172.21.15.60:49326) 2023-10-06T04:28:49.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.118+0000 7f35d139b700 1 -- 172.21.15.60:0/1293622656 learned_addr learned my addr 172.21.15.60:0/1293622656 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:49.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.118+0000 7f35d1b9c700 1 --2- 172.21.15.60:0/1293622656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35cc155db0 0x7f35cc13cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:49.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.118+0000 7f35d0b9a700 1 --2- 172.21.15.60:0/1293622656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35cc0cb770 0x7f35cc13e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:49.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.118+0000 7f35d139b700 1 -- 172.21.15.60:0/1293622656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35cc155db0 msgr2=0x7f35cc13cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:49.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.118+0000 7f35d139b700 1 --2- 172.21.15.60:0/1293622656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35cc155db0 0x7f35cc13cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.118+0000 7f35d139b700 1 -- 172.21.15.60:0/1293622656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35cc0cb770 msgr2=0x7f35cc13e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:49.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.118+0000 7f35d139b700 1 --2- 172.21.15.60:0/1293622656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35cc0cb770 0x7f35cc13e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.118+0000 7f35d139b700 1 -- 172.21.15.60:0/1293622656 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c4009a20 con 0x7f35cc06e9f0 2023-10-06T04:28:49.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.118+0000 7f35d1b9c700 1 --2- 172.21.15.60:0/1293622656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35cc155db0 0x7f35cc13cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:49.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.118+0000 7f35d0b9a700 1 --2- 172.21.15.60:0/1293622656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35cc0cb770 0x7f35cc13e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:49.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.118+0000 7f35d139b700 1 --2- 172.21.15.60:0/1293622656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35cc06e9f0 0x7f35cc152960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f35c800c810 tx=0x7f35c8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:49.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.119+0000 7f35c17fa700 1 -- 172.21.15.60:0/1293622656 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c8005b30 con 0x7f35cc06e9f0 2023-10-06T04:28:49.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.119+0000 7f35c17fa700 1 -- 172.21.15.60:0/1293622656 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c8005c90 con 0x7f35cc06e9f0 2023-10-06T04:28:49.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.119+0000 7f35c17fa700 1 -- 172.21.15.60:0/1293622656 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c8007300 con 0x7f35cc06e9f0 2023-10-06T04:28:49.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.119+0000 7f35d239d700 1 -- 172.21.15.60:0/1293622656 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35cc1510c0 con 0x7f35cc06e9f0 2023-10-06T04:28:49.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.119+0000 7f35d239d700 1 -- 172.21.15.60:0/1293622656 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35cc13c260 con 0x7f35cc06e9f0 2023-10-06T04:28:49.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.120+0000 7f35d239d700 1 -- 172.21.15.60:0/1293622656 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35cc05f230 con 0x7f35cc06e9f0 2023-10-06T04:28:49.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.121+0000 7f35c17fa700 1 -- 172.21.15.60:0/1293622656 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f35c801b3b0 con 0x7f35cc06e9f0 2023-10-06T04:28:49.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.122+0000 7f35c17fa700 1 --2- 172.21.15.60:0/1293622656 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f35b0066f30 0x7f35b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:49.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.122+0000 7f35c17fa700 1 -- 172.21.15.60:0/1293622656 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f35c8083ed0 con 0x7f35cc06e9f0 2023-10-06T04:28:49.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.122+0000 7f35d0b9a700 1 --2- 172.21.15.60:0/1293622656 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f35b0066f30 0x7f35b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:49.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.123+0000 7f35d0b9a700 1 --2- 172.21.15.60:0/1293622656 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f35b0066f30 0x7f35b00693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0ae7b0 tx=0x7f35bc0091a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:49.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.127+0000 7f35c17fa700 1 -- 172.21.15.60:0/1293622656 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35c8050c50 con 0x7f35cc06e9f0 2023-10-06T04:28:49.332 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.330+0000 7f35d239d700 1 -- 172.21.15.60:0/1293622656 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35cc0ad1a0 con 0x7f35cc06e9f0 2023-10-06T04:28:49.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.330+0000 7f35c17fa700 1 -- 172.21.15.60:0/1293622656 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35c80170a0 con 0x7f35cc06e9f0 2023-10-06T04:28:49.333 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-06T04:28:49.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.333+0000 7f35d239d700 1 -- 172.21.15.60:0/1293622656 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f35b0066f30 msgr2=0x7f35b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:49.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.333+0000 7f35d239d700 1 --2- 172.21.15.60:0/1293622656 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f35b0066f30 0x7f35b00693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0ae7b0 tx=0x7f35bc0091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.333+0000 7f35d239d700 1 -- 172.21.15.60:0/1293622656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35cc06e9f0 msgr2=0x7f35cc152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:49.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.333+0000 7f35d239d700 1 --2- 172.21.15.60:0/1293622656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35cc06e9f0 0x7f35cc152960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f35c800c810 tx=0x7f35c8007df0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.333+0000 7f35d239d700 1 -- 172.21.15.60:0/1293622656 shutdown_connections 2023-10-06T04:28:49.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.333+0000 7f35d239d700 1 --2- 172.21.15.60:0/1293622656 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f35b0066f30 0x7f35b00693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.333+0000 7f35d239d700 1 --2- 172.21.15.60:0/1293622656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35cc06e9f0 0x7f35cc152960 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.333+0000 7f35d239d700 1 --2- 172.21.15.60:0/1293622656 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f35cc155db0 0x7f35cc13cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.333+0000 7f35d239d700 1 --2- 172.21.15.60:0/1293622656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35cc0cb770 0x7f35cc13e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.333+0000 7f35d239d700 1 -- 172.21.15.60:0/1293622656 >> 172.21.15.60:0/1293622656 conn(0x7f35cc0cbed0 msgr2=0x7f35cc0adc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:49.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.333+0000 7f35d239d700 1 -- 172.21.15.60:0/1293622656 shutdown_connections 2023-10-06T04:28:49.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.333+0000 7f35d239d700 1 -- 172.21.15.60:0/1293622656 wait complete. 2023-10-06T04:28:49.353 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:28:49.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.541+0000 7f56affff700 1 Processor -- start 2023-10-06T04:28:49.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.541+0000 7f56affff700 1 -- start start 2023-10-06T04:28:49.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.543+0000 7f56affff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f56b01560f0 0x7f56b0159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:49.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.543+0000 7f56affff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f56b006e160 0x7f56b006e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:49.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.543+0000 7f56affff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b00acad0 con 0x7f56b00ae0b0 2023-10-06T04:28:49.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.543+0000 7f56affff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b006eac0 con 0x7f56b006e160 2023-10-06T04:28:49.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.543+0000 7f56affff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b01564c0 con 0x7f56b01560f0 2023-10-06T04:28:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.543+0000 7f56af7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f56b006e160 0x7f56b006e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.543+0000 7f56ae7fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f56b00ae0b0 0x7f56b00c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42346/0 (socket says 172.21.15.60:42346) 2023-10-06T04:28:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.543+0000 7f56ae7fc700 1 -- 172.21.15.60:0/629592838 learned_addr learned my addr 172.21.15.60:0/629592838 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.543+0000 7f56aeffd700 1 --2- 172.21.15.60:0/629592838 >> v2:172.21.15.135:3300/0 conn(0x7f56b01560f0 0x7f56b0159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.544+0000 7f56af7fe700 1 -- 172.21.15.60:0/629592838 >> v2:172.21.15.135:3300/0 conn(0x7f56b01560f0 msgr2=0x7f56b0159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.544+0000 7f56af7fe700 1 --2- 172.21.15.60:0/629592838 >> v2:172.21.15.135:3300/0 conn(0x7f56b01560f0 0x7f56b0159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.544+0000 7f56af7fe700 1 -- 172.21.15.60:0/629592838 >> v1:172.21.15.60:6789/0 conn(0x7f56b00ae0b0 legacy=0x7f56b00c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:49.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.544+0000 7f56af7fe700 1 -- 172.21.15.60:0/629592838 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b015a2d0 con 0x7f56b006e160 2023-10-06T04:28:49.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.544+0000 7f56adffb700 1 -- 172.21.15.60:0/629592838 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653633848 0 0) 0x7f56b00acad0 con 0x7f56b00ae0b0 2023-10-06T04:28:49.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.544+0000 7f56af7fe700 1 --2- 172.21.15.60:0/629592838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56b006e160 0x7f56b006e580 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f56b00ccfe0 tx=0x7f56a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b66695fb388aea3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.544+0000 7f56adffb700 1 -- 172.21.15.60:0/629592838 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a800e070 con 0x7f56b006e160 2023-10-06T04:28:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.544+0000 7f56adffb700 1 -- 172.21.15.60:0/629592838 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a800bb60 con 0x7f56b006e160 2023-10-06T04:28:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.544+0000 7f56adffb700 1 -- 172.21.15.60:0/629592838 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a8012430 con 0x7f56b006e160 2023-10-06T04:28:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.545+0000 7f56affff700 1 -- 172.21.15.60:0/629592838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56b006e160 msgr2=0x7f56b006e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.545+0000 7f56affff700 1 --2- 172.21.15.60:0/629592838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56b006e160 0x7f56b006e580 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f56b00ccfe0 tx=0x7f56a8009780 comp rx=0 tx=0).stop 2023-10-06T04:28:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.545+0000 7f56affff700 1 -- 172.21.15.60:0/629592838 shutdown_connections 2023-10-06T04:28:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.545+0000 7f56affff700 1 --2- 172.21.15.60:0/629592838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56b006e160 0x7f56b006e580 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.545+0000 7f56affff700 1 --2- 172.21.15.60:0/629592838 >> v2:172.21.15.135:3300/0 conn(0x7f56b01560f0 0x7f56b0159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.545+0000 7f56affff700 1 -- 172.21.15.60:0/629592838 >> 172.21.15.60:0/629592838 conn(0x7f56b00cbed0 msgr2=0x7f56b00cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.545+0000 7f56affff700 1 -- 172.21.15.60:0/629592838 shutdown_connections 2023-10-06T04:28:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.545+0000 7f56affff700 1 -- 172.21.15.60:0/629592838 wait complete. 2023-10-06T04:28:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.546+0000 7f56affff700 1 Processor -- start 2023-10-06T04:28:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.546+0000 7f56affff700 1 -- start start 2023-10-06T04:28:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.547+0000 7f56affff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56b006e160 0x7f56b016aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.547+0000 7f56affff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56b00ae0b0 0x7f56b016a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.547+0000 7f56affff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56b01560f0 0x7f56b00c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.547+0000 7f56affff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b00c9920 con 0x7f56b01560f0 2023-10-06T04:28:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.547+0000 7f56affff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b016a7a0 con 0x7f56b00ae0b0 2023-10-06T04:28:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.547+0000 7f56affff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b00c8d10 con 0x7f56b006e160 2023-10-06T04:28:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.547+0000 7f56af7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56b01560f0 0x7f56b00c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.548+0000 7f56af7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56b01560f0 0x7f56b00c62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49348/0 (socket says 172.21.15.60:49348) 2023-10-06T04:28:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.548+0000 7f56af7fe700 1 -- 172.21.15.60:0/3548979029 learned_addr learned my addr 172.21.15.60:0/3548979029 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.548+0000 7f56ae7fc700 1 --2- 172.21.15.60:0/3548979029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56b00ae0b0 0x7f56b016a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.548+0000 7f56aeffd700 1 --2- 172.21.15.60:0/3548979029 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56b006e160 0x7f56b016aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.548+0000 7f56af7fe700 1 -- 172.21.15.60:0/3548979029 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56b006e160 msgr2=0x7f56b016aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.548+0000 7f56af7fe700 1 --2- 172.21.15.60:0/3548979029 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56b006e160 0x7f56b016aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.548+0000 7f56af7fe700 1 -- 172.21.15.60:0/3548979029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56b00ae0b0 msgr2=0x7f56b016a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.548+0000 7f56af7fe700 1 --2- 172.21.15.60:0/3548979029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56b00ae0b0 0x7f56b016a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.548+0000 7f56af7fe700 1 -- 172.21.15.60:0/3548979029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a8009a20 con 0x7f56b01560f0 2023-10-06T04:28:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.548+0000 7f56af7fe700 1 --2- 172.21.15.60:0/3548979029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56b01560f0 0x7f56b00c62d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f56b006cdb0 tx=0x7f56a8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.548+0000 7f5696ffd700 1 -- 172.21.15.60:0/3548979029 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a8027470 con 0x7f56b01560f0 2023-10-06T04:28:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.549+0000 7f5696ffd700 1 -- 172.21.15.60:0/3548979029 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a80275d0 con 0x7f56b01560f0 2023-10-06T04:28:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.549+0000 7f56affff700 1 -- 172.21.15.60:0/3548979029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b00c8ff0 con 0x7f56b01560f0 2023-10-06T04:28:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.549+0000 7f5696ffd700 1 -- 172.21.15.60:0/3548979029 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a8027990 con 0x7f56b01560f0 2023-10-06T04:28:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.549+0000 7f56affff700 1 -- 172.21.15.60:0/3548979029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b00c95b0 con 0x7f56b01560f0 2023-10-06T04:28:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.550+0000 7f56affff700 1 -- 172.21.15.60:0/3548979029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b00c9ad0 con 0x7f56b01560f0 2023-10-06T04:28:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.551+0000 7f5696ffd700 1 -- 172.21.15.60:0/3548979029 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f56a8024070 con 0x7f56b01560f0 2023-10-06T04:28:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.551+0000 7f5696ffd700 1 --2- 172.21.15.60:0/3548979029 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f569c066f30 0x7f569c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:49.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.552+0000 7f5696ffd700 1 -- 172.21.15.60:0/3548979029 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f56a80873b0 con 0x7f56b01560f0 2023-10-06T04:28:49.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.552+0000 7f56aeffd700 1 --2- 172.21.15.60:0/3548979029 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f569c066f30 0x7f569c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:49.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.552+0000 7f56aeffd700 1 --2- 172.21.15.60:0/3548979029 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f569c066f30 0x7f569c0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f56a0009d10 tx=0x7f56a00091a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:49.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.556+0000 7f5696ffd700 1 -- 172.21.15.60:0/3548979029 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f56b00c9ad0 con 0x7f56b01560f0 2023-10-06T04:28:49.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.756+0000 7f56affff700 1 -- 172.21.15.60:0/3548979029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56b01586f0 con 0x7f56b01560f0 2023-10-06T04:28:49.759 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.756+0000 7f5696ffd700 1 -- 172.21.15.60:0/3548979029 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56a8054130 con 0x7f56b01560f0 2023-10-06T04:28:49.759 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-06T04:28:49.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.759+0000 7f56affff700 1 -- 172.21.15.60:0/3548979029 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f569c066f30 msgr2=0x7f569c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:49.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.759+0000 7f56affff700 1 --2- 172.21.15.60:0/3548979029 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f569c066f30 0x7f569c0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f56a0009d10 tx=0x7f56a00091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.759+0000 7f56affff700 1 -- 172.21.15.60:0/3548979029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56b01560f0 msgr2=0x7f56b00c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:49.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.759+0000 7f56affff700 1 --2- 172.21.15.60:0/3548979029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56b01560f0 0x7f56b00c62d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f56b006cdb0 tx=0x7f56a8019000 comp rx=0 tx=0).stop 2023-10-06T04:28:49.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.759+0000 7f56affff700 1 -- 172.21.15.60:0/3548979029 shutdown_connections 2023-10-06T04:28:49.762 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.759+0000 7f56affff700 1 --2- 172.21.15.60:0/3548979029 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f569c066f30 0x7f569c0693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.759+0000 7f56affff700 1 --2- 172.21.15.60:0/3548979029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56b01560f0 0x7f56b00c62d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.759+0000 7f56affff700 1 --2- 172.21.15.60:0/3548979029 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56b006e160 0x7f56b016aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.759+0000 7f56affff700 1 --2- 172.21.15.60:0/3548979029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56b00ae0b0 0x7f56b016a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.759+0000 7f56affff700 1 -- 172.21.15.60:0/3548979029 >> 172.21.15.60:0/3548979029 conn(0x7f56b00cbed0 msgr2=0x7f56b00b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:49.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.759+0000 7f56affff700 1 -- 172.21.15.60:0/3548979029 shutdown_connections 2023-10-06T04:28:49.763 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.759+0000 7f56affff700 1 -- 172.21.15.60:0/3548979029 wait complete. 2023-10-06T04:28:49.779 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:28:49.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.966+0000 7ffb8539d700 1 Processor -- start 2023-10-06T04:28:49.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.966+0000 7ffb8539d700 1 -- start start 2023-10-06T04:28:49.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.968+0000 7ffb8539d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffb8013c430 0x7ffb800ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:49.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.968+0000 7ffb8539d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb800ca5b0 con 0x7ffb8015a250 2023-10-06T04:28:49.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.968+0000 7ffb8539d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8015a8e0 con 0x7ffb800cae90 2023-10-06T04:28:49.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.968+0000 7ffb8539d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb800cb330 con 0x7ffb8013c430 2023-10-06T04:28:49.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.968+0000 7ffb84b9c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ffb8015a250 0x7ffb800c86f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42354/0 (socket says 172.21.15.60:42354) 2023-10-06T04:28:49.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.968+0000 7ffb84b9c700 1 -- 172.21.15.60:0/2724222675 learned_addr learned my addr 172.21.15.60:0/2724222675 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:49.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.968+0000 7ffb7ffff700 1 --2- 172.21.15.60:0/2724222675 >> v2:172.21.15.135:3300/0 conn(0x7ffb8013c430 0x7ffb800ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:49.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.969+0000 7ffb7effd700 1 -- 172.21.15.60:0/2724222675 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540956021 0 0) 0x7ffb800ca5b0 con 0x7ffb8015a250 2023-10-06T04:28:49.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.969+0000 7ffb7effd700 1 -- 172.21.15.60:0/2724222675 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb68003570 con 0x7ffb8015a250 2023-10-06T04:28:49.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.969+0000 7ffb7effd700 1 -- 172.21.15.60:0/2724222675 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582680709 0 0) 0x7ffb8015a8e0 con 0x7ffb800cae90 2023-10-06T04:28:49.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.969+0000 7ffb7effd700 1 -- 172.21.15.60:0/2724222675 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb800ca5b0 con 0x7ffb800cae90 2023-10-06T04:28:49.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.969+0000 7ffb7ffff700 1 -- 172.21.15.60:0/2724222675 >> v1:172.21.15.135:6789/0 conn(0x7ffb800cae90 legacy=0x7ffb80159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:49.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.969+0000 7ffb7ffff700 1 -- 172.21.15.60:0/2724222675 >> v1:172.21.15.60:6789/0 conn(0x7ffb8015a250 legacy=0x7ffb800c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:49.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.969+0000 7ffb7ffff700 1 -- 172.21.15.60:0/2724222675 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8006d500 con 0x7ffb8013c430 2023-10-06T04:28:49.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.969+0000 7ffb7ffff700 1 --2- 172.21.15.60:0/2724222675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb8013c430 0x7ffb800ca950 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffb70009910 tx=0x7ffb700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ae394779ac46b0d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:49.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.969+0000 7ffb7effd700 1 -- 172.21.15.60:0/2724222675 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70011630 con 0x7ffb8013c430 2023-10-06T04:28:49.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.970+0000 7ffb7effd700 1 -- 172.21.15.60:0/2724222675 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb70011790 con 0x7ffb8013c430 2023-10-06T04:28:49.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.970+0000 7ffb7effd700 1 -- 172.21.15.60:0/2724222675 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70011b30 con 0x7ffb8013c430 2023-10-06T04:28:49.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.970+0000 7ffb8539d700 1 -- 172.21.15.60:0/2724222675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb8013c430 msgr2=0x7ffb800ca950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:49.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.970+0000 7ffb8539d700 1 --2- 172.21.15.60:0/2724222675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb8013c430 0x7ffb800ca950 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffb70009910 tx=0x7ffb700091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.970+0000 7ffb8539d700 1 -- 172.21.15.60:0/2724222675 shutdown_connections 2023-10-06T04:28:49.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.970+0000 7ffb8539d700 1 --2- 172.21.15.60:0/2724222675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb8013c430 0x7ffb800ca950 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.970+0000 7ffb8539d700 1 -- 172.21.15.60:0/2724222675 >> 172.21.15.60:0/2724222675 conn(0x7ffb8006b330 msgr2=0x7ffb8006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:49.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.970+0000 7ffb8539d700 1 -- 172.21.15.60:0/2724222675 shutdown_connections 2023-10-06T04:28:49.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.970+0000 7ffb8539d700 1 -- 172.21.15.60:0/2724222675 wait complete. 2023-10-06T04:28:49.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.972+0000 7ffb8539d700 1 Processor -- start 2023-10-06T04:28:49.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.972+0000 7ffb8539d700 1 -- start start 2023-10-06T04:28:49.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.973+0000 7ffb8539d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb800cae90 0x7ffb8013f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:49.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.973+0000 7ffb8539d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb8013c430 0x7ffb8013b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:49.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.973+0000 7ffb8539d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb8015a250 0x7ffb800c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:49.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.973+0000 7ffb8539d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800c5420 con 0x7ffb8013c430 2023-10-06T04:28:49.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.973+0000 7ffb8539d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800c88a0 con 0x7ffb8015a250 2023-10-06T04:28:49.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.973+0000 7ffb8539d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8013f990 con 0x7ffb800cae90 2023-10-06T04:28:49.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.973+0000 7ffb7f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb8013c430 0x7ffb8013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:49.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.973+0000 7ffb7f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb8013c430 0x7ffb8013b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49364/0 (socket says 172.21.15.60:49364) 2023-10-06T04:28:49.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.973+0000 7ffb7f7fe700 1 -- 172.21.15.60:0/3833586957 learned_addr learned my addr 172.21.15.60:0/3833586957 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:49.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.973+0000 7ffb7ffff700 1 --2- 172.21.15.60:0/3833586957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb800cae90 0x7ffb8013f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:49.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.973+0000 7ffb84b9c700 1 --2- 172.21.15.60:0/3833586957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb8015a250 0x7ffb800c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:49.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.973+0000 7ffb7f7fe700 1 -- 172.21.15.60:0/3833586957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb800cae90 msgr2=0x7ffb8013f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:49.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.973+0000 7ffb7f7fe700 1 --2- 172.21.15.60:0/3833586957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb800cae90 0x7ffb8013f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.973+0000 7ffb7f7fe700 1 -- 172.21.15.60:0/3833586957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb8015a250 msgr2=0x7ffb800c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:49.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.973+0000 7ffb7f7fe700 1 --2- 172.21.15.60:0/3833586957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb8015a250 0x7ffb800c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:49.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.973+0000 7ffb7f7fe700 1 -- 172.21.15.60:0/3833586957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb70009420 con 0x7ffb8013c430 2023-10-06T04:28:49.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.973+0000 7ffb7ffff700 1 --2- 172.21.15.60:0/3833586957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb800cae90 0x7ffb8013f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:49.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.974+0000 7ffb7f7fe700 1 --2- 172.21.15.60:0/3833586957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb8013c430 0x7ffb8013b910 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400c790 tx=0x7ffb74007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:49.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.974+0000 7ffb67fff700 1 -- 172.21.15.60:0/3833586957 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74010510 con 0x7ffb8013c430 2023-10-06T04:28:49.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.974+0000 7ffb67fff700 1 -- 172.21.15.60:0/3833586957 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb74010670 con 0x7ffb8013c430 2023-10-06T04:28:49.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.974+0000 7ffb67fff700 1 -- 172.21.15.60:0/3833586957 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74010a10 con 0x7ffb8013c430 2023-10-06T04:28:49.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.974+0000 7ffb8539d700 1 -- 172.21.15.60:0/3833586957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb800c7c90 con 0x7ffb8013c430 2023-10-06T04:28:49.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.974+0000 7ffb8539d700 1 -- 172.21.15.60:0/3833586957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb800c8250 con 0x7ffb8013c430 2023-10-06T04:28:49.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.975+0000 7ffb8539d700 1 -- 172.21.15.60:0/3833586957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb800c8a30 con 0x7ffb8013c430 2023-10-06T04:28:49.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.977+0000 7ffb67fff700 1 -- 172.21.15.60:0/3833586957 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb7401b400 con 0x7ffb8013c430 2023-10-06T04:28:49.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.977+0000 7ffb67fff700 1 --2- 172.21.15.60:0/3833586957 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ffb6c066f30 0x7ffb6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:49.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.977+0000 7ffb67fff700 1 -- 172.21.15.60:0/3833586957 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ffb740847f0 con 0x7ffb8013c430 2023-10-06T04:28:49.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.978+0000 7ffb7ffff700 1 --2- 172.21.15.60:0/3833586957 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ffb6c066f30 0x7ffb6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:49.986 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.978+0000 7ffb7ffff700 1 --2- 172.21.15.60:0/3833586957 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ffb6c066f30 0x7ffb6c0693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffb700093f0 tx=0x7ffb70017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:49.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:49.982+0000 7ffb67fff700 1 -- 172.21.15.60:0/3833586957 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb74051570 con 0x7ffb8013c430 2023-10-06T04:28:50.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.181+0000 7ffb8539d700 1 -- 172.21.15.60:0/3833586957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffb8005f230 con 0x7ffb8013c430 2023-10-06T04:28:50.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.182+0000 7ffb67fff700 1 -- 172.21.15.60:0/3833586957 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffb74054b90 con 0x7ffb8013c430 2023-10-06T04:28:50.185 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-06T04:28:50.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.184+0000 7ffb8539d700 1 -- 172.21.15.60:0/3833586957 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ffb6c066f30 msgr2=0x7ffb6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:50.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.184+0000 7ffb8539d700 1 --2- 172.21.15.60:0/3833586957 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ffb6c066f30 0x7ffb6c0693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffb700093f0 tx=0x7ffb70017000 comp rx=0 tx=0).stop 2023-10-06T04:28:50.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.184+0000 7ffb8539d700 1 -- 172.21.15.60:0/3833586957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb8013c430 msgr2=0x7ffb8013b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:50.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.184+0000 7ffb8539d700 1 --2- 172.21.15.60:0/3833586957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb8013c430 0x7ffb8013b910 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400c790 tx=0x7ffb74007e10 comp rx=0 tx=0).stop 2023-10-06T04:28:50.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.184+0000 7ffb8539d700 1 -- 172.21.15.60:0/3833586957 shutdown_connections 2023-10-06T04:28:50.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.184+0000 7ffb8539d700 1 --2- 172.21.15.60:0/3833586957 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ffb6c066f30 0x7ffb6c0693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:50.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.184+0000 7ffb8539d700 1 --2- 172.21.15.60:0/3833586957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb8015a250 0x7ffb800c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:50.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.184+0000 7ffb8539d700 1 --2- 172.21.15.60:0/3833586957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffb800cae90 0x7ffb8013f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:50.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.184+0000 7ffb8539d700 1 --2- 172.21.15.60:0/3833586957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb8013c430 0x7ffb8013b910 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:50.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.184+0000 7ffb8539d700 1 -- 172.21.15.60:0/3833586957 >> 172.21.15.60:0/3833586957 conn(0x7ffb8006b330 msgr2=0x7ffb800686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:50.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.184+0000 7ffb8539d700 1 -- 172.21.15.60:0/3833586957 shutdown_connections 2023-10-06T04:28:50.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.184+0000 7ffb8539d700 1 -- 172.21.15.60:0/3833586957 wait complete. 2023-10-06T04:28:50.204 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:28:50.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.393+0000 7fe6c9f9d700 1 Processor -- start 2023-10-06T04:28:50.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.393+0000 7fe6c9f9d700 1 -- start start 2023-10-06T04:28:50.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.395+0000 7fe6c9f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe6c415c700 0x7fe6c40c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:50.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.395+0000 7fe6c9f9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c40c72c0 con 0x7fe6c415d670 2023-10-06T04:28:50.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.395+0000 7fe6c9f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c40cab70 con 0x7fe6c415cad0 2023-10-06T04:28:50.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.395+0000 7fe6c9f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c40ca310 con 0x7fe6c415c700 2023-10-06T04:28:50.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.395+0000 7fe6c979c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe6c415d670 0x7fe6c4068310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42358/0 (socket says 172.21.15.60:42358) 2023-10-06T04:28:50.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.395+0000 7fe6c979c700 1 -- 172.21.15.60:0/3513493251 learned_addr learned my addr 172.21.15.60:0/3513493251 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:50.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.395+0000 7fe6c8f9b700 1 --2- 172.21.15.60:0/3513493251 >> v2:172.21.15.135:3300/0 conn(0x7fe6c415c700 0x7fe6c40c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:50.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.396+0000 7fe6c37fe700 1 -- 172.21.15.60:0/3513493251 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2878915226 0 0) 0x7fe6c40c72c0 con 0x7fe6c415d670 2023-10-06T04:28:50.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.396+0000 7fe6c37fe700 1 -- 172.21.15.60:0/3513493251 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6b4003570 con 0x7fe6c415d670 2023-10-06T04:28:50.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.396+0000 7fe6c37fe700 1 -- 172.21.15.60:0/3513493251 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3562334439 0 0) 0x7fe6c40cab70 con 0x7fe6c415cad0 2023-10-06T04:28:50.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.396+0000 7fe6c37fe700 1 -- 172.21.15.60:0/3513493251 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6c40c72c0 con 0x7fe6c415cad0 2023-10-06T04:28:50.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.396+0000 7fe6c8f9b700 1 -- 172.21.15.60:0/3513493251 >> v1:172.21.15.135:6789/0 conn(0x7fe6c415cad0 legacy=0x7fe6c415cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:50.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.396+0000 7fe6c8f9b700 1 -- 172.21.15.60:0/3513493251 >> v1:172.21.15.60:6789/0 conn(0x7fe6c415d670 legacy=0x7fe6c4068310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:50.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.396+0000 7fe6c8f9b700 1 -- 172.21.15.60:0/3513493251 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c40cc390 con 0x7fe6c415c700 2023-10-06T04:28:50.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.396+0000 7fe6c8f9b700 1 --2- 172.21.15.60:0/3513493251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6c415c700 0x7fe6c40c6d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80098e0 tx=0x7fe6b80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=365073fcde9cb925 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:50.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.396+0000 7fe6c37fe700 1 -- 172.21.15.60:0/3513493251 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8011630 con 0x7fe6c415c700 2023-10-06T04:28:50.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.396+0000 7fe6c37fe700 1 -- 172.21.15.60:0/3513493251 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b8011790 con 0x7fe6c415c700 2023-10-06T04:28:50.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.396+0000 7fe6c37fe700 1 -- 172.21.15.60:0/3513493251 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8011b30 con 0x7fe6c415c700 2023-10-06T04:28:50.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.397+0000 7fe6c9f9d700 1 -- 172.21.15.60:0/3513493251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6c415c700 msgr2=0x7fe6c40c6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:50.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.397+0000 7fe6c9f9d700 1 --2- 172.21.15.60:0/3513493251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6c415c700 0x7fe6c40c6d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80098e0 tx=0x7fe6b80091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:50.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.397+0000 7fe6c9f9d700 1 -- 172.21.15.60:0/3513493251 shutdown_connections 2023-10-06T04:28:50.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.397+0000 7fe6c9f9d700 1 --2- 172.21.15.60:0/3513493251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6c415c700 0x7fe6c40c6d80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:50.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.397+0000 7fe6c9f9d700 1 -- 172.21.15.60:0/3513493251 >> 172.21.15.60:0/3513493251 conn(0x7fe6c40c91b0 msgr2=0x7fe6c40c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:50.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.397+0000 7fe6c9f9d700 1 -- 172.21.15.60:0/3513493251 shutdown_connections 2023-10-06T04:28:50.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.397+0000 7fe6c9f9d700 1 -- 172.21.15.60:0/3513493251 wait complete. 2023-10-06T04:28:50.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.399+0000 7fe6c9f9d700 1 Processor -- start 2023-10-06T04:28:50.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.399+0000 7fe6c9f9d700 1 -- start start 2023-10-06T04:28:50.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.400+0000 7fe6c9f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6c415c700 0x7fe6c414c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:50.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.400+0000 7fe6c9f9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c415cad0 0x7fe6c416a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:50.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.400+0000 7fe6c9f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6c415d670 0x7fe6c4158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:50.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.400+0000 7fe6c9f9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c40c4400 con 0x7fe6c415cad0 2023-10-06T04:28:50.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.400+0000 7fe6c9f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c40c6880 con 0x7fe6c415d670 2023-10-06T04:28:50.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.400+0000 7fe6c9f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c40c37f0 con 0x7fe6c415c700 2023-10-06T04:28:50.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.400+0000 7fe6c3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c415cad0 0x7fe6c416a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:50.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.400+0000 7fe6c3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c415cad0 0x7fe6c416a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49380/0 (socket says 172.21.15.60:49380) 2023-10-06T04:28:50.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.400+0000 7fe6c3fff700 1 -- 172.21.15.60:0/3999139828 learned_addr learned my addr 172.21.15.60:0/3999139828 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:50.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.400+0000 7fe6c979c700 1 --2- 172.21.15.60:0/3999139828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6c415d670 0x7fe6c4158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:50.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.400+0000 7fe6c8f9b700 1 --2- 172.21.15.60:0/3999139828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6c415c700 0x7fe6c414c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:50.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.400+0000 7fe6c3fff700 1 -- 172.21.15.60:0/3999139828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6c415c700 msgr2=0x7fe6c414c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:50.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.400+0000 7fe6c3fff700 1 --2- 172.21.15.60:0/3999139828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6c415c700 0x7fe6c414c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:50.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.400+0000 7fe6c3fff700 1 -- 172.21.15.60:0/3999139828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6c415d670 msgr2=0x7fe6c4158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.400+0000 7fe6c3fff700 1 --2- 172.21.15.60:0/3999139828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6c415d670 0x7fe6c4158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.400+0000 7fe6c3fff700 1 -- 172.21.15.60:0/3999139828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b8009420 con 0x7fe6c415cad0 2023-10-06T04:28:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.400+0000 7fe6c979c700 1 --2- 172.21.15.60:0/3999139828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6c415d670 0x7fe6c4158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.401+0000 7fe6c3fff700 1 --2- 172.21.15.60:0/3999139828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c415cad0 0x7fe6c416a2a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000c790 tx=0x7fe6b0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.401+0000 7fe6c0ff9700 1 -- 172.21.15.60:0/3999139828 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0010510 con 0x7fe6c415cad0 2023-10-06T04:28:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.401+0000 7fe6c0ff9700 1 -- 172.21.15.60:0/3999139828 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b0010670 con 0x7fe6c415cad0 2023-10-06T04:28:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.401+0000 7fe6c0ff9700 1 -- 172.21.15.60:0/3999139828 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0010a30 con 0x7fe6c415cad0 2023-10-06T04:28:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.401+0000 7fe6c9f9d700 1 -- 172.21.15.60:0/3999139828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c40c3ad0 con 0x7fe6c415cad0 2023-10-06T04:28:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.401+0000 7fe6c9f9d700 1 -- 172.21.15.60:0/3999139828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c40c4090 con 0x7fe6c415cad0 2023-10-06T04:28:50.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.402+0000 7fe6c9f9d700 1 -- 172.21.15.60:0/3999139828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c415dcb0 con 0x7fe6c415cad0 2023-10-06T04:28:50.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.403+0000 7fe6c0ff9700 1 -- 172.21.15.60:0/3999139828 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe6b001b3b0 con 0x7fe6c415cad0 2023-10-06T04:28:50.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.404+0000 7fe6c0ff9700 1 --2- 172.21.15.60:0/3999139828 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe6a8066f30 0x7fe6a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:50.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.404+0000 7fe6c0ff9700 1 -- 172.21.15.60:0/3999139828 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe6b0084290 con 0x7fe6c415cad0 2023-10-06T04:28:50.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.404+0000 7fe6c8f9b700 1 --2- 172.21.15.60:0/3999139828 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe6a8066f30 0x7fe6a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:50.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.405+0000 7fe6c8f9b700 1 --2- 172.21.15.60:0/3999139828 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe6a8066f30 0x7fe6a80693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80093f0 tx=0x7fe6b8017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:50.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.408+0000 7fe6c0ff9700 1 -- 172.21.15.60:0/3999139828 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6b0051010 con 0x7fe6c415cad0 2023-10-06T04:28:50.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.613+0000 7fe6c9f9d700 1 -- 172.21.15.60:0/3999139828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe6c406d310 con 0x7fe6c415cad0 2023-10-06T04:28:50.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.613+0000 7fe6c0ff9700 1 -- 172.21.15.60:0/3999139828 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe6b0017020 con 0x7fe6c415cad0 2023-10-06T04:28:50.616 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-06T04:28:50.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.616+0000 7fe6c9f9d700 1 -- 172.21.15.60:0/3999139828 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe6a8066f30 msgr2=0x7fe6a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:50.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.616+0000 7fe6c9f9d700 1 --2- 172.21.15.60:0/3999139828 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe6a8066f30 0x7fe6a80693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80093f0 tx=0x7fe6b8017000 comp rx=0 tx=0).stop 2023-10-06T04:28:50.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.616+0000 7fe6c9f9d700 1 -- 172.21.15.60:0/3999139828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c415cad0 msgr2=0x7fe6c416a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:50.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.616+0000 7fe6c9f9d700 1 --2- 172.21.15.60:0/3999139828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c415cad0 0x7fe6c416a2a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000c790 tx=0x7fe6b0007e10 comp rx=0 tx=0).stop 2023-10-06T04:28:50.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.616+0000 7fe6c9f9d700 1 -- 172.21.15.60:0/3999139828 shutdown_connections 2023-10-06T04:28:50.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.616+0000 7fe6c9f9d700 1 --2- 172.21.15.60:0/3999139828 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe6a8066f30 0x7fe6a80693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:50.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.616+0000 7fe6c9f9d700 1 --2- 172.21.15.60:0/3999139828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6c415d670 0x7fe6c4158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:50.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.616+0000 7fe6c9f9d700 1 --2- 172.21.15.60:0/3999139828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe6c415c700 0x7fe6c414c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:50.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.616+0000 7fe6c9f9d700 1 --2- 172.21.15.60:0/3999139828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6c415cad0 0x7fe6c416a2a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:50.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.616+0000 7fe6c9f9d700 1 -- 172.21.15.60:0/3999139828 >> 172.21.15.60:0/3999139828 conn(0x7fe6c40c91b0 msgr2=0x7fe6c4157590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:50.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.616+0000 7fe6c9f9d700 1 -- 172.21.15.60:0/3999139828 shutdown_connections 2023-10-06T04:28:50.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.616+0000 7fe6c9f9d700 1 -- 172.21.15.60:0/3999139828 wait complete. 2023-10-06T04:28:50.636 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:28:50.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.823+0000 7fc18ad9d700 1 Processor -- start 2023-10-06T04:28:50.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.824+0000 7fc18ad9d700 1 -- start start 2023-10-06T04:28:50.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.825+0000 7fc18ad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc184159390 0x7fc1840ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:50.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.825+0000 7fc18ad9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc184159760 0x7fc1840aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:50.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.825+0000 7fc18ad9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1840ab240 0x7fc184069110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:50.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.825+0000 7fc18ad9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1840ab6a0 con 0x7fc184159390 2023-10-06T04:28:50.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.825+0000 7fc18ad9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1840686c0 con 0x7fc184159760 2023-10-06T04:28:50.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.825+0000 7fc18ad9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc184068c80 con 0x7fc1840ab240 2023-10-06T04:28:50.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.825+0000 7fc189d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc184159390 0x7fc1840ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:50.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.825+0000 7fc189d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc184159390 0x7fc1840ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49388/0 (socket says 172.21.15.60:49388) 2023-10-06T04:28:50.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.825+0000 7fc189d9b700 1 -- 172.21.15.60:0/1122636695 learned_addr learned my addr 172.21.15.60:0/1122636695 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:50.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.826+0000 7fc18a59c700 1 --2- 172.21.15.60:0/1122636695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1840ab240 0x7fc184069110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:50.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.826+0000 7fc18959a700 1 --2- 172.21.15.60:0/1122636695 >> v2:172.21.15.135:3300/0 conn(0x7fc184159760 0x7fc1840aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:50.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.826+0000 7fc189d9b700 1 -- 172.21.15.60:0/1122636695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1840ab240 msgr2=0x7fc184069110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:50.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.826+0000 7fc189d9b700 1 --2- 172.21.15.60:0/1122636695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1840ab240 0x7fc184069110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:50.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.826+0000 7fc189d9b700 1 -- 172.21.15.60:0/1122636695 >> v2:172.21.15.135:3300/0 conn(0x7fc184159760 msgr2=0x7fc1840aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:50.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.826+0000 7fc189d9b700 1 --2- 172.21.15.60:0/1122636695 >> v2:172.21.15.135:3300/0 conn(0x7fc184159760 0x7fc1840aad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:50.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.826+0000 7fc189d9b700 1 -- 172.21.15.60:0/1122636695 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1840ace20 con 0x7fc184159390 2023-10-06T04:28:50.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.826+0000 7fc189d9b700 1 --2- 172.21.15.60:0/1122636695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc184159390 0x7fc1840ac8e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc18406ee70 tx=0x7fc180009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45366618d7f95a2c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:50.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.826+0000 7fc188d99700 1 -- 172.21.15.60:0/1122636695 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18000b860 con 0x7fc184159390 2023-10-06T04:28:50.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.826+0000 7fc188d99700 1 -- 172.21.15.60:0/1122636695 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18000b9c0 con 0x7fc184159390 2023-10-06T04:28:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.826+0000 7fc188d99700 1 -- 172.21.15.60:0/1122636695 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18000bd60 con 0x7fc184159390 2023-10-06T04:28:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.827+0000 7fc18ad9d700 1 -- 172.21.15.60:0/1122636695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc184159390 msgr2=0x7fc1840ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.827+0000 7fc18ad9d700 1 --2- 172.21.15.60:0/1122636695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc184159390 0x7fc1840ac8e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc18406ee70 tx=0x7fc180009250 comp rx=0 tx=0).stop 2023-10-06T04:28:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.827+0000 7fc18ad9d700 1 -- 172.21.15.60:0/1122636695 shutdown_connections 2023-10-06T04:28:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.827+0000 7fc18ad9d700 1 --2- 172.21.15.60:0/1122636695 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc1840ab240 0x7fc184069110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.827+0000 7fc18ad9d700 1 --2- 172.21.15.60:0/1122636695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc184159390 0x7fc1840ac8e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.827+0000 7fc18ad9d700 1 --2- 172.21.15.60:0/1122636695 >> v2:172.21.15.135:3300/0 conn(0x7fc184159760 0x7fc1840aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.827+0000 7fc18ad9d700 1 -- 172.21.15.60:0/1122636695 >> 172.21.15.60:0/1122636695 conn(0x7fc184097410 msgr2=0x7fc184067d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.827+0000 7fc18ad9d700 1 -- 172.21.15.60:0/1122636695 shutdown_connections 2023-10-06T04:28:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.827+0000 7fc18ad9d700 1 -- 172.21.15.60:0/1122636695 wait complete. 2023-10-06T04:28:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.828+0000 7fc18ad9d700 1 Processor -- start 2023-10-06T04:28:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.829+0000 7fc18ad9d700 1 -- start start 2023-10-06T04:28:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.829+0000 7fc18ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1840ab240 0x7fc184153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.829+0000 7fc18ad9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc184159390 0x7fc18416d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.829+0000 7fc18ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc184159760 0x7fc18406bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.830+0000 7fc18ad9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc184153f80 con 0x7fc184159760 2023-10-06T04:28:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.830+0000 7fc18ad9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840b2f90 con 0x7fc1840ab240 2023-10-06T04:28:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.830+0000 7fc18ad9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18416da00 con 0x7fc184159390 2023-10-06T04:28:50.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.830+0000 7fc18a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc184159760 0x7fc18406bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:50.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.830+0000 7fc18a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc184159760 0x7fc18406bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49390/0 (socket says 172.21.15.60:49390) 2023-10-06T04:28:50.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.830+0000 7fc18a59c700 1 -- 172.21.15.60:0/4032624101 learned_addr learned my addr 172.21.15.60:0/4032624101 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:50.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.830+0000 7fc18959a700 1 --2- 172.21.15.60:0/4032624101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc184159390 0x7fc18416d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:50.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.830+0000 7fc189d9b700 1 --2- 172.21.15.60:0/4032624101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1840ab240 0x7fc184153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:50.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.830+0000 7fc18a59c700 1 -- 172.21.15.60:0/4032624101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc184159390 msgr2=0x7fc18416d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:50.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.830+0000 7fc18a59c700 1 --2- 172.21.15.60:0/4032624101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc184159390 0x7fc18416d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:50.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.830+0000 7fc18a59c700 1 -- 172.21.15.60:0/4032624101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1840ab240 msgr2=0x7fc184153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:50.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.830+0000 7fc18a59c700 1 --2- 172.21.15.60:0/4032624101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1840ab240 0x7fc184153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:50.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.830+0000 7fc18a59c700 1 -- 172.21.15.60:0/4032624101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1800094f0 con 0x7fc184159760 2023-10-06T04:28:50.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.830+0000 7fc189d9b700 1 --2- 172.21.15.60:0/4032624101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1840ab240 0x7fc184153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:50.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.830+0000 7fc18959a700 1 --2- 172.21.15.60:0/4032624101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc184159390 0x7fc18416d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:50.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.830+0000 7fc18a59c700 1 --2- 172.21.15.60:0/4032624101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc184159760 0x7fc18406bfc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009fd0 tx=0x7fc17c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:50.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.831+0000 7fc179ffb700 1 -- 172.21.15.60:0/4032624101 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c00ed50 con 0x7fc184159760 2023-10-06T04:28:50.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.831+0000 7fc179ffb700 1 -- 172.21.15.60:0/4032624101 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c00eeb0 con 0x7fc184159760 2023-10-06T04:28:50.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.831+0000 7fc18ad9d700 1 -- 172.21.15.60:0/4032624101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1840b3c50 con 0x7fc184159760 2023-10-06T04:28:50.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.831+0000 7fc179ffb700 1 -- 172.21.15.60:0/4032624101 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c014650 con 0x7fc184159760 2023-10-06T04:28:50.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.831+0000 7fc18ad9d700 1 -- 172.21.15.60:0/4032624101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1840b2940 con 0x7fc184159760 2023-10-06T04:28:50.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.832+0000 7fc18ad9d700 1 -- 172.21.15.60:0/4032624101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1840b3120 con 0x7fc184159760 2023-10-06T04:28:50.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.833+0000 7fc179ffb700 1 -- 172.21.15.60:0/4032624101 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc17c0149c0 con 0x7fc184159760 2023-10-06T04:28:50.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.834+0000 7fc179ffb700 1 --2- 172.21.15.60:0/4032624101 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc168066f30 0x7fc1680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:50.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.834+0000 7fc179ffb700 1 -- 172.21.15.60:0/4032624101 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc17c085130 con 0x7fc184159760 2023-10-06T04:28:50.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.834+0000 7fc189d9b700 1 --2- 172.21.15.60:0/4032624101 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc168066f30 0x7fc1680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:50.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.835+0000 7fc189d9b700 1 --2- 172.21.15.60:0/4032624101 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc168066f30 0x7fc1680693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc18406ee70 tx=0x7fc180017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:50.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:50.838+0000 7fc179ffb700 1 -- 172.21.15.60:0/4032624101 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc17c051f50 con 0x7fc184159760 2023-10-06T04:28:51.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.040+0000 7fc18ad9d700 1 -- 172.21.15.60:0/4032624101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc18405f230 con 0x7fc184159760 2023-10-06T04:28:51.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.041+0000 7fc179ffb700 1 -- 172.21.15.60:0/4032624101 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18707 (secure 0 0 0) 0x7fc17c055570 con 0x7fc184159760 2023-10-06T04:28:51.044 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:51.044 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":25,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:28:11.290557+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:28:04.355358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:28:05.208550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:28:08.791979+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:28:51.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.044+0000 7fc18ad9d700 1 -- 172.21.15.60:0/4032624101 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc168066f30 msgr2=0x7fc1680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:51.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.044+0000 7fc18ad9d700 1 --2- 172.21.15.60:0/4032624101 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc168066f30 0x7fc1680693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc18406ee70 tx=0x7fc180017000 comp rx=0 tx=0).stop 2023-10-06T04:28:51.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.044+0000 7fc18ad9d700 1 -- 172.21.15.60:0/4032624101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc184159760 msgr2=0x7fc18406bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:51.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.044+0000 7fc18ad9d700 1 --2- 172.21.15.60:0/4032624101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc184159760 0x7fc18406bfc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009fd0 tx=0x7fc17c009900 comp rx=0 tx=0).stop 2023-10-06T04:28:51.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.044+0000 7fc18ad9d700 1 -- 172.21.15.60:0/4032624101 shutdown_connections 2023-10-06T04:28:51.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.044+0000 7fc18ad9d700 1 --2- 172.21.15.60:0/4032624101 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc168066f30 0x7fc1680693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:51.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.044+0000 7fc18ad9d700 1 --2- 172.21.15.60:0/4032624101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc184159760 0x7fc18406bfc0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:51.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.044+0000 7fc18ad9d700 1 --2- 172.21.15.60:0/4032624101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1840ab240 0x7fc184153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:51.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.044+0000 7fc18ad9d700 1 --2- 172.21.15.60:0/4032624101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc184159390 0x7fc18416d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:51.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.044+0000 7fc18ad9d700 1 -- 172.21.15.60:0/4032624101 >> 172.21.15.60:0/4032624101 conn(0x7fc184097410 msgr2=0x7fc1840b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:51.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.044+0000 7fc18ad9d700 1 -- 172.21.15.60:0/4032624101 shutdown_connections 2023-10-06T04:28:51.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.044+0000 7fc18ad9d700 1 -- 172.21.15.60:0/4032624101 wait complete. 2023-10-06T04:28:51.065 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:27:58.899938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:27:59.373527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:28:04.355358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:28:05.208550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:28:08.791979+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:28:51.066 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:28:51.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.253+0000 7fe9bc99d700 1 Processor -- start 2023-10-06T04:28:51.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.254+0000 7fe9bc99d700 1 -- start start 2023-10-06T04:28:51.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.255+0000 7fe9bc99d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe9b8159c60 0x7fe9b80c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:51.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.255+0000 7fe9bc99d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b80acad0 con 0x7fe9b80c8f30 2023-10-06T04:28:51.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.255+0000 7fe9bc99d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b81564c0 con 0x7fe9b81560f0 2023-10-06T04:28:51.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.255+0000 7fe9bc99d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b815a0e0 con 0x7fe9b8159c60 2023-10-06T04:28:51.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.255+0000 7fe9b6ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe9b8159c60 0x7fe9b80c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:51.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.255+0000 7fe9b7fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe9b80c8f30 0x7fe9b806e160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42368/0 (socket says 172.21.15.60:42368) 2023-10-06T04:28:51.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.255+0000 7fe9b7fff700 1 -- 172.21.15.60:0/3527073477 learned_addr learned my addr 172.21.15.60:0/3527073477 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:51.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.256+0000 7fe9b6ffd700 1 -- 172.21.15.60:0/3527073477 >> v1:172.21.15.135:6789/0 conn(0x7fe9b81560f0 legacy=0x7fe9b80ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:51.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.256+0000 7fe9b6ffd700 1 -- 172.21.15.60:0/3527073477 >> v1:172.21.15.60:6789/0 conn(0x7fe9b80c8f30 legacy=0x7fe9b806e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:51.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.256+0000 7fe9b6ffd700 1 -- 172.21.15.60:0/3527073477 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b815a2d0 con 0x7fe9b8159c60 2023-10-06T04:28:51.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.256+0000 7fe9b6ffd700 1 --2- 172.21.15.60:0/3527073477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9b8159c60 0x7fe9b80c89f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac00bb90 tx=0x7fe9ac00b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e548adb377e8cdb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:51.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.256+0000 7fe9b67fc700 1 -- 172.21.15.60:0/3527073477 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac00dc30 con 0x7fe9b8159c60 2023-10-06T04:28:51.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.256+0000 7fe9b67fc700 1 -- 172.21.15.60:0/3527073477 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac00dd90 con 0x7fe9b8159c60 2023-10-06T04:28:51.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.256+0000 7fe9b67fc700 1 -- 172.21.15.60:0/3527073477 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac0196b0 con 0x7fe9b8159c60 2023-10-06T04:28:51.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.257+0000 7fe9bc99d700 1 -- 172.21.15.60:0/3527073477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9b8159c60 msgr2=0x7fe9b80c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:51.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.257+0000 7fe9bc99d700 1 --2- 172.21.15.60:0/3527073477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9b8159c60 0x7fe9b80c89f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac00bb90 tx=0x7fe9ac00b430 comp rx=0 tx=0).stop 2023-10-06T04:28:51.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.257+0000 7fe9bc99d700 1 -- 172.21.15.60:0/3527073477 shutdown_connections 2023-10-06T04:28:51.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.257+0000 7fe9bc99d700 1 --2- 172.21.15.60:0/3527073477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9b8159c60 0x7fe9b80c89f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:51.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.257+0000 7fe9bc99d700 1 -- 172.21.15.60:0/3527073477 >> 172.21.15.60:0/3527073477 conn(0x7fe9b80cbed0 msgr2=0x7fe9b80cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:51.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.257+0000 7fe9bc99d700 1 -- 172.21.15.60:0/3527073477 shutdown_connections 2023-10-06T04:28:51.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.257+0000 7fe9bc99d700 1 -- 172.21.15.60:0/3527073477 wait complete. 2023-10-06T04:28:51.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.258+0000 7fe9bc99d700 1 Processor -- start 2023-10-06T04:28:51.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.258+0000 7fe9bc99d700 1 -- start start 2023-10-06T04:28:51.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.259+0000 7fe9bc99d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9b80c8f30 0x7fe9b81418e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:51.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.259+0000 7fe9bc99d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b81560f0 0x7fe9b815aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:51.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.259+0000 7fe9bc99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9b8159c60 0x7fe9b816da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:51.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.259+0000 7fe9bc99d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b80c6a50 con 0x7fe9b80c8f30 2023-10-06T04:28:51.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.259+0000 7fe9bc99d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b80c5e40 con 0x7fe9b81560f0 2023-10-06T04:28:51.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.259+0000 7fe9bc99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b80c6120 con 0x7fe9b8159c60 2023-10-06T04:28:51.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.260+0000 7fe9b77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9b80c8f30 0x7fe9b81418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:51.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.260+0000 7fe9b77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9b80c8f30 0x7fe9b81418e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49406/0 (socket says 172.21.15.60:49406) 2023-10-06T04:28:51.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.260+0000 7fe9b77fe700 1 -- 172.21.15.60:0/3088270240 learned_addr learned my addr 172.21.15.60:0/3088270240 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:51.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.260+0000 7fe9b6ffd700 1 --2- 172.21.15.60:0/3088270240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b81560f0 0x7fe9b815aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:51.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.260+0000 7fe9b7fff700 1 --2- 172.21.15.60:0/3088270240 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9b8159c60 0x7fe9b816da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:51.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.260+0000 7fe9b77fe700 1 -- 172.21.15.60:0/3088270240 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9b8159c60 msgr2=0x7fe9b816da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:51.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.260+0000 7fe9b77fe700 1 --2- 172.21.15.60:0/3088270240 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9b8159c60 0x7fe9b816da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:51.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.260+0000 7fe9b77fe700 1 -- 172.21.15.60:0/3088270240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b81560f0 msgr2=0x7fe9b815aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:51.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.260+0000 7fe9b77fe700 1 --2- 172.21.15.60:0/3088270240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b81560f0 0x7fe9b815aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:51.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.260+0000 7fe9b77fe700 1 -- 172.21.15.60:0/3088270240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac00b6d0 con 0x7fe9b80c8f30 2023-10-06T04:28:51.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.260+0000 7fe9b7fff700 1 --2- 172.21.15.60:0/3088270240 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9b8159c60 0x7fe9b816da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:51.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.260+0000 7fe9b77fe700 1 --2- 172.21.15.60:0/3088270240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9b80c8f30 0x7fe9b81418e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800c590 tx=0x7fe9a800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:51.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.261+0000 7fe99f7fe700 1 -- 172.21.15.60:0/3088270240 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8011590 con 0x7fe9b80c8f30 2023-10-06T04:28:51.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.261+0000 7fe99f7fe700 1 -- 172.21.15.60:0/3088270240 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a8011710 con 0x7fe9b80c8f30 2023-10-06T04:28:51.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.261+0000 7fe99f7fe700 1 -- 172.21.15.60:0/3088270240 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8011ad0 con 0x7fe9b80c8f30 2023-10-06T04:28:51.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.261+0000 7fe9bc99d700 1 -- 172.21.15.60:0/3088270240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b80c6400 con 0x7fe9b80c8f30 2023-10-06T04:28:51.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.261+0000 7fe9bc99d700 1 -- 172.21.15.60:0/3088270240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b8141e20 con 0x7fe9b80c8f30 2023-10-06T04:28:51.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.262+0000 7fe9bc99d700 1 -- 172.21.15.60:0/3088270240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b80c6de0 con 0x7fe9b80c8f30 2023-10-06T04:28:51.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.263+0000 7fe99f7fe700 1 -- 172.21.15.60:0/3088270240 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9a801b3b0 con 0x7fe9b80c8f30 2023-10-06T04:28:51.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.264+0000 7fe99f7fe700 1 --2- 172.21.15.60:0/3088270240 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe9a4066f30 0x7fe9a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:51.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.264+0000 7fe99f7fe700 1 -- 172.21.15.60:0/3088270240 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe9a8083ee0 con 0x7fe9b80c8f30 2023-10-06T04:28:51.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.264+0000 7fe9b6ffd700 1 --2- 172.21.15.60:0/3088270240 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe9a4066f30 0x7fe9a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:51.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.265+0000 7fe9b6ffd700 1 --2- 172.21.15.60:0/3088270240 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe9a4066f30 0x7fe9a40693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac00b6a0 tx=0x7fe9ac01b000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:51.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.268+0000 7fe99f7fe700 1 -- 172.21.15.60:0/3088270240 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9a8050c60 con 0x7fe9b80c8f30 2023-10-06T04:28:51.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.469+0000 7fe9bc99d700 1 -- 172.21.15.60:0/3088270240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe9b805f230 con 0x7fe9b80c8f30 2023-10-06T04:28:51.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.470+0000 7fe99f7fe700 1 -- 172.21.15.60:0/3088270240 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe9a8017070 con 0x7fe9b80c8f30 2023-10-06T04:28:51.472 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-10-06T04:28:51.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.472+0000 7fe9bc99d700 1 -- 172.21.15.60:0/3088270240 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe9a4066f30 msgr2=0x7fe9a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.472+0000 7fe9bc99d700 1 --2- 172.21.15.60:0/3088270240 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe9a4066f30 0x7fe9a40693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac00b6a0 tx=0x7fe9ac01b000 comp rx=0 tx=0).stop 2023-10-06T04:28:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.472+0000 7fe9bc99d700 1 -- 172.21.15.60:0/3088270240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9b80c8f30 msgr2=0x7fe9b81418e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.472+0000 7fe9bc99d700 1 --2- 172.21.15.60:0/3088270240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9b80c8f30 0x7fe9b81418e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800c590 tx=0x7fe9a800c8a0 comp rx=0 tx=0).stop 2023-10-06T04:28:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.472+0000 7fe9bc99d700 1 -- 172.21.15.60:0/3088270240 shutdown_connections 2023-10-06T04:28:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.472+0000 7fe9bc99d700 1 --2- 172.21.15.60:0/3088270240 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe9a4066f30 0x7fe9a40693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.472+0000 7fe9bc99d700 1 --2- 172.21.15.60:0/3088270240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9b80c8f30 0x7fe9b81418e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.472+0000 7fe9bc99d700 1 --2- 172.21.15.60:0/3088270240 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9b8159c60 0x7fe9b816da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.472+0000 7fe9bc99d700 1 --2- 172.21.15.60:0/3088270240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9b81560f0 0x7fe9b815aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.472+0000 7fe9bc99d700 1 -- 172.21.15.60:0/3088270240 >> 172.21.15.60:0/3088270240 conn(0x7fe9b80cbed0 msgr2=0x7fe9b80ace60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.472+0000 7fe9bc99d700 1 -- 172.21.15.60:0/3088270240 shutdown_connections 2023-10-06T04:28:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.472+0000 7fe9bc99d700 1 -- 172.21.15.60:0/3088270240 wait complete. 2023-10-06T04:28:51.492 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:28:51.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.680+0000 7f426219d700 1 Processor -- start 2023-10-06T04:28:51.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.680+0000 7f426219d700 1 -- start start 2023-10-06T04:28:51.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.681+0000 7f426219d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f425c06e9f0 0x7f425c06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:51.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.681+0000 7f426219d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f425c0ad7f0 con 0x7f425c0cb770 2023-10-06T04:28:51.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.681+0000 7f426219d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f425c156900 con 0x7f425c155db0 2023-10-06T04:28:51.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.681+0000 7f426219d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425c150320 con 0x7f425c06e9f0 2023-10-06T04:28:51.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.681+0000 7f426119b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f425c0cb770 0x7f425c156f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42378/0 (socket says 172.21.15.60:42378) 2023-10-06T04:28:51.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.681+0000 7f426119b700 1 -- 172.21.15.60:0/2124411524 learned_addr learned my addr 172.21.15.60:0/2124411524 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:51.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.681+0000 7f426099a700 1 --2- 172.21.15.60:0/2124411524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f425c06e9f0 0x7f425c06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:51.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.682+0000 7f4253fff700 1 -- 172.21.15.60:0/2124411524 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976288602 0 0) 0x7f425c0ad7f0 con 0x7f425c0cb770 2023-10-06T04:28:51.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.682+0000 7f4253fff700 1 -- 172.21.15.60:0/2124411524 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4248003570 con 0x7f425c0cb770 2023-10-06T04:28:51.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.682+0000 7f4253fff700 1 -- 172.21.15.60:0/2124411524 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386427272 0 0) 0x7f425c156900 con 0x7f425c155db0 2023-10-06T04:28:51.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.682+0000 7f4253fff700 1 -- 172.21.15.60:0/2124411524 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f425c0ad7f0 con 0x7f425c155db0 2023-10-06T04:28:51.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.682+0000 7f426099a700 1 -- 172.21.15.60:0/2124411524 >> v1:172.21.15.135:6789/0 conn(0x7f425c155db0 legacy=0x7f425c1561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:51.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.682+0000 7f426099a700 1 -- 172.21.15.60:0/2124411524 >> v1:172.21.15.60:6789/0 conn(0x7f425c0cb770 legacy=0x7f425c156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:51.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.682+0000 7f426099a700 1 -- 172.21.15.60:0/2124411524 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425c156b50 con 0x7f425c06e9f0 2023-10-06T04:28:51.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.682+0000 7f426099a700 1 --2- 172.21.15.60:0/2124411524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f425c06e9f0 0x7f425c06ee70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f424c009910 tx=0x7f424c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cf0f00b687e14e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:51.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.683+0000 7f4253fff700 1 -- 172.21.15.60:0/2124411524 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c011630 con 0x7f425c06e9f0 2023-10-06T04:28:51.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.683+0000 7f4253fff700 1 -- 172.21.15.60:0/2124411524 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c011790 con 0x7f425c06e9f0 2023-10-06T04:28:51.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.683+0000 7f4253fff700 1 -- 172.21.15.60:0/2124411524 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c011b30 con 0x7f425c06e9f0 2023-10-06T04:28:51.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.683+0000 7f426219d700 1 -- 172.21.15.60:0/2124411524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f425c06e9f0 msgr2=0x7f425c06ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:51.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.683+0000 7f426219d700 1 --2- 172.21.15.60:0/2124411524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f425c06e9f0 0x7f425c06ee70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f424c009910 tx=0x7f424c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:51.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.683+0000 7f426219d700 1 -- 172.21.15.60:0/2124411524 shutdown_connections 2023-10-06T04:28:51.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.683+0000 7f426219d700 1 --2- 172.21.15.60:0/2124411524 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f425c06e9f0 0x7f425c06ee70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:51.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.683+0000 7f426219d700 1 -- 172.21.15.60:0/2124411524 >> 172.21.15.60:0/2124411524 conn(0x7f425c0cbed0 msgr2=0x7f425c0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:51.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.683+0000 7f426219d700 1 -- 172.21.15.60:0/2124411524 shutdown_connections 2023-10-06T04:28:51.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.683+0000 7f426219d700 1 -- 172.21.15.60:0/2124411524 wait complete. 2023-10-06T04:28:51.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.685+0000 7f426219d700 1 Processor -- start 2023-10-06T04:28:51.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.685+0000 7f426219d700 1 -- start start 2023-10-06T04:28:51.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.686+0000 7f426219d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f425c06e9f0 0x7f425c0a6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:51.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.686+0000 7f426219d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f425c0cb770 0x7f425c167fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:51.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.686+0000 7f426219d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f425c155db0 0x7f425c14d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:51.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.686+0000 7f426219d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425c0abd20 con 0x7f425c0cb770 2023-10-06T04:28:51.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.686+0000 7f426219d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425c0a92e0 con 0x7f425c155db0 2023-10-06T04:28:51.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.686+0000 7f426219d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425c0a7420 con 0x7f425c06e9f0 2023-10-06T04:28:51.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.686+0000 7f426099a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f425c0cb770 0x7f425c167fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:51.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.686+0000 7f426099a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f425c0cb770 0x7f425c167fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49416/0 (socket says 172.21.15.60:49416) 2023-10-06T04:28:51.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.686+0000 7f426099a700 1 -- 172.21.15.60:0/1145101920 learned_addr learned my addr 172.21.15.60:0/1145101920 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:51.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.686+0000 7f426119b700 1 --2- 172.21.15.60:0/1145101920 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f425c06e9f0 0x7f425c0a6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:51.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.686+0000 7f426199c700 1 --2- 172.21.15.60:0/1145101920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f425c155db0 0x7f425c14d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:51.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.686+0000 7f426099a700 1 -- 172.21.15.60:0/1145101920 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f425c06e9f0 msgr2=0x7f425c0a6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:51.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.686+0000 7f426099a700 1 --2- 172.21.15.60:0/1145101920 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f425c06e9f0 0x7f425c0a6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:51.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.686+0000 7f426099a700 1 -- 172.21.15.60:0/1145101920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f425c155db0 msgr2=0x7f425c14d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:51.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.686+0000 7f426099a700 1 --2- 172.21.15.60:0/1145101920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f425c155db0 0x7f425c14d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:51.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.686+0000 7f426099a700 1 -- 172.21.15.60:0/1145101920 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c009420 con 0x7f425c0cb770 2023-10-06T04:28:51.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.686+0000 7f426199c700 1 --2- 172.21.15.60:0/1145101920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f425c155db0 0x7f425c14d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:51.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.687+0000 7f426099a700 1 --2- 172.21.15.60:0/1145101920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f425c0cb770 0x7f425c167fa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f424c009fd0 tx=0x7f424c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:51.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.687+0000 7f42517fa700 1 -- 172.21.15.60:0/1145101920 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c01f070 con 0x7f425c0cb770 2023-10-06T04:28:51.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.687+0000 7f42517fa700 1 -- 172.21.15.60:0/1145101920 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c000bc0 con 0x7f425c0cb770 2023-10-06T04:28:51.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.687+0000 7f426219d700 1 -- 172.21.15.60:0/1145101920 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f425c1684e0 con 0x7f425c0cb770 2023-10-06T04:28:51.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.687+0000 7f42517fa700 1 -- 172.21.15.60:0/1145101920 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c011b30 con 0x7f425c0cb770 2023-10-06T04:28:51.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.687+0000 7f426219d700 1 -- 172.21.15.60:0/1145101920 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f425c0a5d30 con 0x7f425c0cb770 2023-10-06T04:28:51.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.688+0000 7f426219d700 1 -- 172.21.15.60:0/1145101920 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f425c0a9490 con 0x7f425c0cb770 2023-10-06T04:28:51.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.689+0000 7f42517fa700 1 -- 172.21.15.60:0/1145101920 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f424c023070 con 0x7f425c0cb770 2023-10-06T04:28:51.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.690+0000 7f42517fa700 1 --2- 172.21.15.60:0/1145101920 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4240066f30 0x7f42400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:51.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.690+0000 7f42517fa700 1 -- 172.21.15.60:0/1145101920 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f424c085ce0 con 0x7f425c0cb770 2023-10-06T04:28:51.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.690+0000 7f426119b700 1 --2- 172.21.15.60:0/1145101920 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4240066f30 0x7f42400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:51.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.691+0000 7f426119b700 1 --2- 172.21.15.60:0/1145101920 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4240066f30 0x7f42400693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4258007fd0 tx=0x7f4258009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:51.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.695+0000 7f42517fa700 1 -- 172.21.15.60:0/1145101920 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f425c0a9490 con 0x7f425c0cb770 2023-10-06T04:28:51.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.895+0000 7f426219d700 1 -- 172.21.15.60:0/1145101920 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f425c0a9490 con 0x7f425c0cb770 2023-10-06T04:28:51.898 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.896+0000 7f42517fa700 1 -- 172.21.15.60:0/1145101920 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f425c0a9490 con 0x7f425c0cb770 2023-10-06T04:28:51.899 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-06T04:28:51.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.898+0000 7f426219d700 1 -- 172.21.15.60:0/1145101920 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4240066f30 msgr2=0x7f42400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:51.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.898+0000 7f426219d700 1 --2- 172.21.15.60:0/1145101920 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4240066f30 0x7f42400693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4258007fd0 tx=0x7f4258009040 comp rx=0 tx=0).stop 2023-10-06T04:28:51.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.898+0000 7f426219d700 1 -- 172.21.15.60:0/1145101920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f425c0cb770 msgr2=0x7f425c167fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:51.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.898+0000 7f426219d700 1 --2- 172.21.15.60:0/1145101920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f425c0cb770 0x7f425c167fa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f424c009fd0 tx=0x7f424c017000 comp rx=0 tx=0).stop 2023-10-06T04:28:51.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.898+0000 7f426219d700 1 -- 172.21.15.60:0/1145101920 shutdown_connections 2023-10-06T04:28:51.901 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.898+0000 7f426219d700 1 --2- 172.21.15.60:0/1145101920 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4240066f30 0x7f42400693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:51.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.898+0000 7f426219d700 1 --2- 172.21.15.60:0/1145101920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f425c155db0 0x7f425c14d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:51.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.898+0000 7f426219d700 1 --2- 172.21.15.60:0/1145101920 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f425c06e9f0 0x7f425c0a6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:51.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.898+0000 7f426219d700 1 --2- 172.21.15.60:0/1145101920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f425c0cb770 0x7f425c167fa0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:51.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.898+0000 7f426219d700 1 -- 172.21.15.60:0/1145101920 >> 172.21.15.60:0/1145101920 conn(0x7f425c0cbed0 msgr2=0x7f425c14e370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:51.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.898+0000 7f426219d700 1 -- 172.21.15.60:0/1145101920 shutdown_connections 2023-10-06T04:28:51.902 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:51.899+0000 7f426219d700 1 -- 172.21.15.60:0/1145101920 wait complete. 2023-10-06T04:28:51.919 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:28:52.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.106+0000 7f354ffff700 1 Processor -- start 2023-10-06T04:28:52.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.106+0000 7f354ffff700 1 -- start start 2023-10-06T04:28:52.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.107+0000 7f354ffff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3550155db0 0x7f3550156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:52.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.107+0000 7f354ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f35500adc80 0x7f35500ae080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:52.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.107+0000 7f354ffff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35500ad7f0 con 0x7f3550156f80 2023-10-06T04:28:52.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.107+0000 7f354ffff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3550150320 con 0x7f35500adc80 2023-10-06T04:28:52.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.107+0000 7f354ffff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3550156b50 con 0x7f3550155db0 2023-10-06T04:28:52.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.107+0000 7f354f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f35500adc80 0x7f35500ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:52.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.107+0000 7f354effd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3550156f80 0x7f35500cb770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42382/0 (socket says 172.21.15.60:42382) 2023-10-06T04:28:52.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.107+0000 7f354effd700 1 -- 172.21.15.60:0/1148306371 learned_addr learned my addr 172.21.15.60:0/1148306371 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:52.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.108+0000 7f354e7fc700 1 --2- 172.21.15.60:0/1148306371 >> v2:172.21.15.135:3300/0 conn(0x7f3550155db0 0x7f3550156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:52.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.108+0000 7f354f7fe700 1 -- 172.21.15.60:0/1148306371 >> v2:172.21.15.135:3300/0 conn(0x7f3550155db0 msgr2=0x7f3550156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:52.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.108+0000 7f354f7fe700 1 --2- 172.21.15.60:0/1148306371 >> v2:172.21.15.135:3300/0 conn(0x7f3550155db0 0x7f3550156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.108+0000 7f354f7fe700 1 -- 172.21.15.60:0/1148306371 >> v1:172.21.15.60:6789/0 conn(0x7f3550156f80 legacy=0x7f35500cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:52.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.108+0000 7f354f7fe700 1 -- 172.21.15.60:0/1148306371 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35500ad1a0 con 0x7f35500adc80 2023-10-06T04:28:52.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.108+0000 7f354dffb700 1 -- 172.21.15.60:0/1148306371 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042620904 0 0) 0x7f35500ad7f0 con 0x7f3550156f80 2023-10-06T04:28:52.112 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.108+0000 7f354f7fe700 1 --2- 172.21.15.60:0/1148306371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35500adc80 0x7f35500ae080 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f35500cbe80 tx=0x7f3548009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab72131aef001c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:52.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.108+0000 7f354dffb700 1 -- 172.21.15.60:0/1148306371 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354800e070 con 0x7f35500adc80 2023-10-06T04:28:52.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.108+0000 7f354dffb700 1 -- 172.21.15.60:0/1148306371 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354800bb60 con 0x7f35500adc80 2023-10-06T04:28:52.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.108+0000 7f354dffb700 1 -- 172.21.15.60:0/1148306371 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548012430 con 0x7f35500adc80 2023-10-06T04:28:52.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.109+0000 7f354ffff700 1 -- 172.21.15.60:0/1148306371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35500adc80 msgr2=0x7f35500ae080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:52.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.109+0000 7f354ffff700 1 --2- 172.21.15.60:0/1148306371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35500adc80 0x7f35500ae080 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f35500cbe80 tx=0x7f3548009780 comp rx=0 tx=0).stop 2023-10-06T04:28:52.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.109+0000 7f354ffff700 1 -- 172.21.15.60:0/1148306371 shutdown_connections 2023-10-06T04:28:52.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.109+0000 7f354ffff700 1 --2- 172.21.15.60:0/1148306371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35500adc80 0x7f35500ae080 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.109+0000 7f354ffff700 1 --2- 172.21.15.60:0/1148306371 >> v2:172.21.15.135:3300/0 conn(0x7f3550155db0 0x7f3550156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.113 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.109+0000 7f354ffff700 1 -- 172.21.15.60:0/1148306371 >> 172.21.15.60:0/1148306371 conn(0x7f35500cbed0 msgr2=0x7f35500cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:52.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.109+0000 7f354ffff700 1 -- 172.21.15.60:0/1148306371 shutdown_connections 2023-10-06T04:28:52.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.109+0000 7f354ffff700 1 -- 172.21.15.60:0/1148306371 wait complete. 2023-10-06T04:28:52.114 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.111+0000 7f354ffff700 1 Processor -- start 2023-10-06T04:28:52.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.111+0000 7f354ffff700 1 -- start start 2023-10-06T04:28:52.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.112+0000 7f354ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35500adc80 0x7f355013e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:52.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.112+0000 7f354ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3550155db0 0x7f3550154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:52.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.112+0000 7f354ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3550156f80 0x7f3550169170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:52.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.112+0000 7f354ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35501545f0 con 0x7f3550156f80 2023-10-06T04:28:52.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.112+0000 7f354ffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355006d6a0 con 0x7f35500adc80 2023-10-06T04:28:52.116 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.112+0000 7f354ffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355006dc60 con 0x7f3550155db0 2023-10-06T04:28:52.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.112+0000 7f354f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3550156f80 0x7f3550169170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:52.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.112+0000 7f354f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3550156f80 0x7f3550169170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49430/0 (socket says 172.21.15.60:49430) 2023-10-06T04:28:52.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.112+0000 7f354f7fe700 1 -- 172.21.15.60:0/1990403206 learned_addr learned my addr 172.21.15.60:0/1990403206 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:52.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.112+0000 7f354e7fc700 1 --2- 172.21.15.60:0/1990403206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3550155db0 0x7f3550154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:52.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.112+0000 7f354effd700 1 --2- 172.21.15.60:0/1990403206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35500adc80 0x7f355013e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:52.117 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.112+0000 7f354f7fe700 1 -- 172.21.15.60:0/1990403206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3550155db0 msgr2=0x7f3550154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:52.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.112+0000 7f354f7fe700 1 --2- 172.21.15.60:0/1990403206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3550155db0 0x7f3550154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.112+0000 7f354f7fe700 1 -- 172.21.15.60:0/1990403206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35500adc80 msgr2=0x7f355013e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:52.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.112+0000 7f354f7fe700 1 --2- 172.21.15.60:0/1990403206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35500adc80 0x7f355013e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.112+0000 7f354f7fe700 1 -- 172.21.15.60:0/1990403206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3548009a20 con 0x7f3550156f80 2023-10-06T04:28:52.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.112+0000 7f354e7fc700 1 --2- 172.21.15.60:0/1990403206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3550155db0 0x7f3550154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:52.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.112+0000 7f354effd700 1 --2- 172.21.15.60:0/1990403206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35500adc80 0x7f355013e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:52.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.113+0000 7f354f7fe700 1 --2- 172.21.15.60:0/1990403206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3550156f80 0x7f3550169170 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f354800b6c0 tx=0x7f3548019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:52.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.113+0000 7f3536ffd700 1 -- 172.21.15.60:0/1990403206 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548012e50 con 0x7f3550156f80 2023-10-06T04:28:52.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.113+0000 7f3536ffd700 1 -- 172.21.15.60:0/1990403206 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354801d630 con 0x7f3550156f80 2023-10-06T04:28:52.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.113+0000 7f3536ffd700 1 -- 172.21.15.60:0/1990403206 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354801d9f0 con 0x7f3550156f80 2023-10-06T04:28:52.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.113+0000 7f354ffff700 1 -- 172.21.15.60:0/1990403206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f355013ec80 con 0x7f3550156f80 2023-10-06T04:28:52.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.113+0000 7f354ffff700 1 -- 172.21.15.60:0/1990403206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3550140040 con 0x7f3550156f80 2023-10-06T04:28:52.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.114+0000 7f354ffff700 1 -- 172.21.15.60:0/1990403206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355005f230 con 0x7f3550156f80 2023-10-06T04:28:52.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.115+0000 7f3536ffd700 1 -- 172.21.15.60:0/1990403206 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3548024070 con 0x7f3550156f80 2023-10-06T04:28:52.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.116+0000 7f3536ffd700 1 --2- 172.21.15.60:0/1990403206 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f353c066f30 0x7f353c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:52.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.116+0000 7f3536ffd700 1 -- 172.21.15.60:0/1990403206 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3548087190 con 0x7f3550156f80 2023-10-06T04:28:52.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.116+0000 7f354effd700 1 --2- 172.21.15.60:0/1990403206 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f353c066f30 0x7f353c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:52.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.117+0000 7f354effd700 1 --2- 172.21.15.60:0/1990403206 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f353c066f30 0x7f353c0693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f35501490e0 tx=0x7f3540009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:52.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.120+0000 7f3536ffd700 1 -- 172.21.15.60:0/1990403206 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3548053fb0 con 0x7f3550156f80 2023-10-06T04:28:52.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.321+0000 7f354ffff700 1 -- 172.21.15.60:0/1990403206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f355006dda0 con 0x7f3550156f80 2023-10-06T04:28:52.324 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.322+0000 7f3536ffd700 1 -- 172.21.15.60:0/1990403206 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f35480575d0 con 0x7f3550156f80 2023-10-06T04:28:52.325 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-06T04:28:52.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.324+0000 7f354ffff700 1 -- 172.21.15.60:0/1990403206 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f353c066f30 msgr2=0x7f353c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:52.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.324+0000 7f354ffff700 1 --2- 172.21.15.60:0/1990403206 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f353c066f30 0x7f353c0693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f35501490e0 tx=0x7f3540009040 comp rx=0 tx=0).stop 2023-10-06T04:28:52.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.324+0000 7f354ffff700 1 -- 172.21.15.60:0/1990403206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3550156f80 msgr2=0x7f3550169170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:52.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.324+0000 7f354ffff700 1 --2- 172.21.15.60:0/1990403206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3550156f80 0x7f3550169170 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f354800b6c0 tx=0x7f3548019000 comp rx=0 tx=0).stop 2023-10-06T04:28:52.327 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.324+0000 7f354ffff700 1 -- 172.21.15.60:0/1990403206 shutdown_connections 2023-10-06T04:28:52.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.324+0000 7f354ffff700 1 --2- 172.21.15.60:0/1990403206 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f353c066f30 0x7f353c0693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.324+0000 7f354ffff700 1 --2- 172.21.15.60:0/1990403206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3550156f80 0x7f3550169170 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.324+0000 7f354ffff700 1 --2- 172.21.15.60:0/1990403206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35500adc80 0x7f355013e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.324+0000 7f354ffff700 1 --2- 172.21.15.60:0/1990403206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3550155db0 0x7f3550154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.324+0000 7f354ffff700 1 -- 172.21.15.60:0/1990403206 >> 172.21.15.60:0/1990403206 conn(0x7f35500cbed0 msgr2=0x7f3550157350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:52.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.325+0000 7f354ffff700 1 -- 172.21.15.60:0/1990403206 shutdown_connections 2023-10-06T04:28:52.328 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.325+0000 7f354ffff700 1 -- 172.21.15.60:0/1990403206 wait complete. 2023-10-06T04:28:52.344 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:28:52.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.532+0000 7f325639d700 1 Processor -- start 2023-10-06T04:28:52.535 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.532+0000 7f325639d700 1 -- start start 2023-10-06T04:28:52.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.534+0000 7f325639d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f325006e160 0x7f325006e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:52.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.534+0000 7f325639d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32500acad0 con 0x7f32501560f0 2023-10-06T04:28:52.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.534+0000 7f325639d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f325006eac0 con 0x7f3250159c60 2023-10-06T04:28:52.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.534+0000 7f325639d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f325015a0e0 con 0x7f325006e160 2023-10-06T04:28:52.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.534+0000 7f325539b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f32501560f0 0x7f32500ae0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42398/0 (socket says 172.21.15.60:42398) 2023-10-06T04:28:52.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.534+0000 7f325539b700 1 -- 172.21.15.60:0/2889029933 learned_addr learned my addr 172.21.15.60:0/2889029933 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:52.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.534+0000 7f3255b9c700 1 --2- 172.21.15.60:0/2889029933 >> v2:172.21.15.60:3300/0 conn(0x7f325006e160 0x7f325006e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:52.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.534+0000 7f3247fff700 1 -- 172.21.15.60:0/2889029933 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513110082 0 0) 0x7f32500acad0 con 0x7f32501560f0 2023-10-06T04:28:52.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.534+0000 7f3247fff700 1 -- 172.21.15.60:0/2889029933 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f323c003570 con 0x7f32501560f0 2023-10-06T04:28:52.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.534+0000 7f3255b9c700 1 -- 172.21.15.60:0/2889029933 >> v1:172.21.15.135:6789/0 conn(0x7f3250159c60 legacy=0x7f32500c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:52.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.534+0000 7f3255b9c700 1 -- 172.21.15.60:0/2889029933 >> v1:172.21.15.60:6789/0 conn(0x7f32501560f0 legacy=0x7f32500ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:52.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.534+0000 7f3255b9c700 1 -- 172.21.15.60:0/2889029933 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32501564c0 con 0x7f325006e160 2023-10-06T04:28:52.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.535+0000 7f3255b9c700 1 --2- 172.21.15.60:0/2889029933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f325006e160 0x7f325006e580 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3248009e60 tx=0x7f3248009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eeab5ffcafc666e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:52.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.535+0000 7f3247fff700 1 -- 172.21.15.60:0/2889029933 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324800e070 con 0x7f325006e160 2023-10-06T04:28:52.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.535+0000 7f3247fff700 1 -- 172.21.15.60:0/2889029933 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324800bbf0 con 0x7f325006e160 2023-10-06T04:28:52.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.535+0000 7f3247fff700 1 -- 172.21.15.60:0/2889029933 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3248012430 con 0x7f325006e160 2023-10-06T04:28:52.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.535+0000 7f325639d700 1 -- 172.21.15.60:0/2889029933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f325006e160 msgr2=0x7f325006e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:52.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.535+0000 7f325639d700 1 --2- 172.21.15.60:0/2889029933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f325006e160 0x7f325006e580 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3248009e60 tx=0x7f3248009780 comp rx=0 tx=0).stop 2023-10-06T04:28:52.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.536+0000 7f325639d700 1 -- 172.21.15.60:0/2889029933 shutdown_connections 2023-10-06T04:28:52.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.536+0000 7f325639d700 1 --2- 172.21.15.60:0/2889029933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f325006e160 0x7f325006e580 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.536+0000 7f325639d700 1 -- 172.21.15.60:0/2889029933 >> 172.21.15.60:0/2889029933 conn(0x7f32500cbed0 msgr2=0x7f32500cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:52.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.536+0000 7f325639d700 1 -- 172.21.15.60:0/2889029933 shutdown_connections 2023-10-06T04:28:52.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.536+0000 7f325639d700 1 -- 172.21.15.60:0/2889029933 wait complete. 2023-10-06T04:28:52.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.537+0000 7f325639d700 1 Processor -- start 2023-10-06T04:28:52.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.537+0000 7f325639d700 1 -- start start 2023-10-06T04:28:52.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.538+0000 7f325639d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f325006e160 0x7f32500cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:52.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.538+0000 7f325639d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32501560f0 0x7f3250151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:52.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.538+0000 7f325639d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3250159c60 0x7f32501524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:52.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.538+0000 7f325639d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32501566b0 con 0x7f32501560f0 2023-10-06T04:28:52.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.538+0000 7f325639d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3250156f50 con 0x7f3250159c60 2023-10-06T04:28:52.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.538+0000 7f325639d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32500c6090 con 0x7f325006e160 2023-10-06T04:28:52.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.538+0000 7f3254b9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32501560f0 0x7f3250151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:52.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.538+0000 7f3254b9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32501560f0 0x7f3250151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49448/0 (socket says 172.21.15.60:49448) 2023-10-06T04:28:52.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.538+0000 7f3254b9a700 1 -- 172.21.15.60:0/2241761864 learned_addr learned my addr 172.21.15.60:0/2241761864 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:52.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.539+0000 7f325539b700 1 --2- 172.21.15.60:0/2241761864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f325006e160 0x7f32500cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:52.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.539+0000 7f3255b9c700 1 --2- 172.21.15.60:0/2241761864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3250159c60 0x7f32501524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:52.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.539+0000 7f3254b9a700 1 -- 172.21.15.60:0/2241761864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f325006e160 msgr2=0x7f32500cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:52.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.539+0000 7f3254b9a700 1 --2- 172.21.15.60:0/2241761864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f325006e160 0x7f32500cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.539+0000 7f3254b9a700 1 -- 172.21.15.60:0/2241761864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3250159c60 msgr2=0x7f32501524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.539+0000 7f3254b9a700 1 --2- 172.21.15.60:0/2241761864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3250159c60 0x7f32501524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.539+0000 7f3254b9a700 1 -- 172.21.15.60:0/2241761864 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3248009a20 con 0x7f32501560f0 2023-10-06T04:28:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.539+0000 7f3254b9a700 1 --2- 172.21.15.60:0/2241761864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32501560f0 0x7f3250151f70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f324000c510 tx=0x7f324000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.539+0000 7f32457fa700 1 -- 172.21.15.60:0/2241761864 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3240011590 con 0x7f32501560f0 2023-10-06T04:28:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.539+0000 7f32457fa700 1 -- 172.21.15.60:0/2241761864 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3240011710 con 0x7f32501560f0 2023-10-06T04:28:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.539+0000 7f32457fa700 1 -- 172.21.15.60:0/2241761864 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3240011ad0 con 0x7f32501560f0 2023-10-06T04:28:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.539+0000 7f325639d700 1 -- 172.21.15.60:0/2241761864 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3250156900 con 0x7f32501560f0 2023-10-06T04:28:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.540+0000 7f325639d700 1 -- 172.21.15.60:0/2241761864 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325014e630 con 0x7f32501560f0 2023-10-06T04:28:52.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.541+0000 7f325639d700 1 -- 172.21.15.60:0/2241761864 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325005f230 con 0x7f32501560f0 2023-10-06T04:28:52.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.541+0000 7f32457fa700 1 -- 172.21.15.60:0/2241761864 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3240001050 con 0x7f32501560f0 2023-10-06T04:28:52.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.542+0000 7f32457fa700 1 --2- 172.21.15.60:0/2241761864 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3234066f30 0x7f32340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:52.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.542+0000 7f32457fa700 1 -- 172.21.15.60:0/2241761864 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3240083e70 con 0x7f32501560f0 2023-10-06T04:28:52.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.543+0000 7f325539b700 1 --2- 172.21.15.60:0/2241761864 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3234066f30 0x7f32340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:52.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.543+0000 7f325539b700 1 --2- 172.21.15.60:0/2241761864 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3234066f30 0x7f32340693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f324c0058d0 tx=0x7f324c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:52.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.546+0000 7f32457fa700 1 -- 172.21.15.60:0/2241761864 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3240050bf0 con 0x7f32501560f0 2023-10-06T04:28:52.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.748+0000 7f325639d700 1 -- 172.21.15.60:0/2241761864 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f325015a2d0 con 0x7f32501560f0 2023-10-06T04:28:52.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.749+0000 7f32457fa700 1 -- 172.21.15.60:0/2241761864 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3240017070 con 0x7f32501560f0 2023-10-06T04:28:52.751 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-06T04:28:52.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.751+0000 7f325639d700 1 -- 172.21.15.60:0/2241761864 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3234066f30 msgr2=0x7f32340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:52.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.751+0000 7f325639d700 1 --2- 172.21.15.60:0/2241761864 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3234066f30 0x7f32340693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f324c0058d0 tx=0x7f324c009040 comp rx=0 tx=0).stop 2023-10-06T04:28:52.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.751+0000 7f325639d700 1 -- 172.21.15.60:0/2241761864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32501560f0 msgr2=0x7f3250151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:52.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.751+0000 7f325639d700 1 --2- 172.21.15.60:0/2241761864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32501560f0 0x7f3250151f70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f324000c510 tx=0x7f324000c8d0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.751+0000 7f325639d700 1 -- 172.21.15.60:0/2241761864 shutdown_connections 2023-10-06T04:28:52.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.751+0000 7f325639d700 1 --2- 172.21.15.60:0/2241761864 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3234066f30 0x7f32340693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.751+0000 7f325639d700 1 --2- 172.21.15.60:0/2241761864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3250159c60 0x7f32501524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.751+0000 7f325639d700 1 --2- 172.21.15.60:0/2241761864 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f325006e160 0x7f32500cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.751+0000 7f325639d700 1 --2- 172.21.15.60:0/2241761864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32501560f0 0x7f3250151f70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.751+0000 7f325639d700 1 -- 172.21.15.60:0/2241761864 >> 172.21.15.60:0/2241761864 conn(0x7f32500cbed0 msgr2=0x7f3250150a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:52.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.751+0000 7f325639d700 1 -- 172.21.15.60:0/2241761864 shutdown_connections 2023-10-06T04:28:52.755 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.751+0000 7f325639d700 1 -- 172.21.15.60:0/2241761864 wait complete. 2023-10-06T04:28:52.770 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:28:52.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.958+0000 7fb80f59d700 1 Processor -- start 2023-10-06T04:28:52.961 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.958+0000 7fb80f59d700 1 -- start start 2023-10-06T04:28:52.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.959+0000 7fb80f59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8081560f0 0x7fb808159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:52.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.960+0000 7fb80f59d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb8080ae0b0 0x7fb8080c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:52.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.960+0000 7fb80f59d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8080acad0 con 0x7fb8080c8f30 2023-10-06T04:28:52.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.960+0000 7fb80f59d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8081564c0 con 0x7fb8080ae0b0 2023-10-06T04:28:52.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.960+0000 7fb80f59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80815a2d0 con 0x7fb8081560f0 2023-10-06T04:28:52.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.960+0000 7fb80dd9a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb8080ae0b0 0x7fb8080c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:52.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.960+0000 7fb80ed9c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb8080c8f30 0x7fb80806e160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34770/0 (socket says 172.21.15.60:34770) 2023-10-06T04:28:52.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.960+0000 7fb80ed9c700 1 -- 172.21.15.60:0/2884528678 learned_addr learned my addr 172.21.15.60:0/2884528678 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:52.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.960+0000 7fb80e59b700 1 --2- 172.21.15.60:0/2884528678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8081560f0 0x7fb808159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:52.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.960+0000 7fb80dd9a700 1 -- 172.21.15.60:0/2884528678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8081560f0 msgr2=0x7fb808159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:52.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.960+0000 7fb80dd9a700 1 --2- 172.21.15.60:0/2884528678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8081560f0 0x7fb808159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.963 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.960+0000 7fb80dd9a700 1 -- 172.21.15.60:0/2884528678 >> v1:172.21.15.60:6789/0 conn(0x7fb8080c8f30 legacy=0x7fb80806e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:52.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.960+0000 7fb80dd9a700 1 -- 172.21.15.60:0/2884528678 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80815a5b0 con 0x7fb8080ae0b0 2023-10-06T04:28:52.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.960+0000 7fb80d599700 1 -- 172.21.15.60:0/2884528678 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679766501 0 0) 0x7fb8080acad0 con 0x7fb8080c8f30 2023-10-06T04:28:52.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.961+0000 7fb80dd9a700 1 --2- 172.21.15.60:0/2884528678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8080ae0b0 0x7fb8080c89f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80098e0 tx=0x7fb7f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada4493742f70e33 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:52.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.961+0000 7fb80d599700 1 -- 172.21.15.60:0/2884528678 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8009e80 con 0x7fb8080ae0b0 2023-10-06T04:28:52.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.961+0000 7fb80d599700 1 -- 172.21.15.60:0/2884528678 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f800b860 con 0x7fb8080ae0b0 2023-10-06T04:28:52.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.961+0000 7fb80d599700 1 -- 172.21.15.60:0/2884528678 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f800bbe0 con 0x7fb8080ae0b0 2023-10-06T04:28:52.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.961+0000 7fb80f59d700 1 -- 172.21.15.60:0/2884528678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8080ae0b0 msgr2=0x7fb8080c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:52.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.961+0000 7fb80f59d700 1 --2- 172.21.15.60:0/2884528678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8080ae0b0 0x7fb8080c89f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80098e0 tx=0x7fb7f80091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.962+0000 7fb80f59d700 1 -- 172.21.15.60:0/2884528678 shutdown_connections 2023-10-06T04:28:52.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.962+0000 7fb80f59d700 1 --2- 172.21.15.60:0/2884528678 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8081560f0 0x7fb808159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.962+0000 7fb80f59d700 1 --2- 172.21.15.60:0/2884528678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8080ae0b0 0x7fb8080c89f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.962+0000 7fb80f59d700 1 -- 172.21.15.60:0/2884528678 >> 172.21.15.60:0/2884528678 conn(0x7fb8080cbed0 msgr2=0x7fb8080cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:52.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.962+0000 7fb80f59d700 1 -- 172.21.15.60:0/2884528678 shutdown_connections 2023-10-06T04:28:52.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.962+0000 7fb80f59d700 1 -- 172.21.15.60:0/2884528678 wait complete. 2023-10-06T04:28:52.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.963+0000 7fb80f59d700 1 Processor -- start 2023-10-06T04:28:52.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.963+0000 7fb80f59d700 1 -- start start 2023-10-06T04:28:52.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.964+0000 7fb80f59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8080ae0b0 0x7fb80814acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:52.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.964+0000 7fb80f59d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8080c8f30 0x7fb80806a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:52.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.964+0000 7fb80f59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8081560f0 0x7fb8081418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:52.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.964+0000 7fb80f59d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb808157070 con 0x7fb8080c8f30 2023-10-06T04:28:52.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.964+0000 7fb80f59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80806afc0 con 0x7fb8081560f0 2023-10-06T04:28:52.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.964+0000 7fb80f59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb808157330 con 0x7fb8080ae0b0 2023-10-06T04:28:52.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.965+0000 7fb80dd9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8080c8f30 0x7fb80806a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:52.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.965+0000 7fb80dd9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8080c8f30 0x7fb80806a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44558/0 (socket says 172.21.15.60:44558) 2023-10-06T04:28:52.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.965+0000 7fb80dd9a700 1 -- 172.21.15.60:0/2214738765 learned_addr learned my addr 172.21.15.60:0/2214738765 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:52.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.965+0000 7fb80e59b700 1 --2- 172.21.15.60:0/2214738765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8080ae0b0 0x7fb80814acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:52.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.965+0000 7fb80ed9c700 1 --2- 172.21.15.60:0/2214738765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8081560f0 0x7fb8081418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:52.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.965+0000 7fb80dd9a700 1 -- 172.21.15.60:0/2214738765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8080ae0b0 msgr2=0x7fb80814acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:52.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.965+0000 7fb80dd9a700 1 --2- 172.21.15.60:0/2214738765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8080ae0b0 0x7fb80814acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.965+0000 7fb80dd9a700 1 -- 172.21.15.60:0/2214738765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8081560f0 msgr2=0x7fb8081418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:52.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.965+0000 7fb80dd9a700 1 --2- 172.21.15.60:0/2214738765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8081560f0 0x7fb8081418c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:52.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.965+0000 7fb80dd9a700 1 -- 172.21.15.60:0/2214738765 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f8009420 con 0x7fb8080c8f30 2023-10-06T04:28:52.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.965+0000 7fb80dd9a700 1 --2- 172.21.15.60:0/2214738765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8080c8f30 0x7fb80806a020 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb80806cdb0 tx=0x7fb7f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:52.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.966+0000 7fb7fe7fc700 1 -- 172.21.15.60:0/2214738765 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f800bbe0 con 0x7fb8080c8f30 2023-10-06T04:28:52.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.966+0000 7fb7fe7fc700 1 -- 172.21.15.60:0/2214738765 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f8000d10 con 0x7fb8080c8f30 2023-10-06T04:28:52.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.966+0000 7fb7fe7fc700 1 -- 172.21.15.60:0/2214738765 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8011690 con 0x7fb8080c8f30 2023-10-06T04:28:52.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.966+0000 7fb80f59d700 1 -- 172.21.15.60:0/2214738765 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb80806a720 con 0x7fb8080c8f30 2023-10-06T04:28:52.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.966+0000 7fb80f59d700 1 -- 172.21.15.60:0/2214738765 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80806ace0 con 0x7fb8080c8f30 2023-10-06T04:28:52.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.967+0000 7fb80f59d700 1 -- 172.21.15.60:0/2214738765 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8081574c0 con 0x7fb8080c8f30 2023-10-06T04:28:52.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.968+0000 7fb7fe7fc700 1 -- 172.21.15.60:0/2214738765 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb7f8011a40 con 0x7fb8080c8f30 2023-10-06T04:28:52.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.968+0000 7fb7fe7fc700 1 --2- 172.21.15.60:0/2214738765 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb7ec066f30 0x7fb7ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:52.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.969+0000 7fb7fe7fc700 1 -- 172.21.15.60:0/2214738765 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb7f8086330 con 0x7fb8080c8f30 2023-10-06T04:28:52.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.969+0000 7fb80e59b700 1 --2- 172.21.15.60:0/2214738765 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb7ec066f30 0x7fb7ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:52.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.969+0000 7fb80e59b700 1 --2- 172.21.15.60:0/2214738765 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb7ec066f30 0x7fb7ec0693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb804006fd0 tx=0x7fb804008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:52.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:52.973+0000 7fb7fe7fc700 1 -- 172.21.15.60:0/2214738765 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7f80530b0 con 0x7fb8080c8f30 2023-10-06T04:28:53.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.175+0000 7fb80f59d700 1 -- 172.21.15.60:0/2214738765 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb80805f230 con 0x7fb8080c8f30 2023-10-06T04:28:53.178 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.175+0000 7fb7fe7fc700 1 -- 172.21.15.60:0/2214738765 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb7f80566d0 con 0x7fb8080c8f30 2023-10-06T04:28:53.178 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-06T04:28:53.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.178+0000 7fb80f59d700 1 -- 172.21.15.60:0/2214738765 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb7ec066f30 msgr2=0x7fb7ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:53.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.178+0000 7fb80f59d700 1 --2- 172.21.15.60:0/2214738765 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb7ec066f30 0x7fb7ec0693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb804006fd0 tx=0x7fb804008040 comp rx=0 tx=0).stop 2023-10-06T04:28:53.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.178+0000 7fb80f59d700 1 -- 172.21.15.60:0/2214738765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8080c8f30 msgr2=0x7fb80806a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:53.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.178+0000 7fb80f59d700 1 --2- 172.21.15.60:0/2214738765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8080c8f30 0x7fb80806a020 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb80806cdb0 tx=0x7fb7f8017000 comp rx=0 tx=0).stop 2023-10-06T04:28:53.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.178+0000 7fb80f59d700 1 -- 172.21.15.60:0/2214738765 shutdown_connections 2023-10-06T04:28:53.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.178+0000 7fb80f59d700 1 --2- 172.21.15.60:0/2214738765 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb7ec066f30 0x7fb7ec0693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:53.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.178+0000 7fb80f59d700 1 --2- 172.21.15.60:0/2214738765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8081560f0 0x7fb8081418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:53.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.178+0000 7fb80f59d700 1 --2- 172.21.15.60:0/2214738765 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8080ae0b0 0x7fb80814acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:53.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.178+0000 7fb80f59d700 1 --2- 172.21.15.60:0/2214738765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8080c8f30 0x7fb80806a020 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:53.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.178+0000 7fb80f59d700 1 -- 172.21.15.60:0/2214738765 >> 172.21.15.60:0/2214738765 conn(0x7fb8080cbed0 msgr2=0x7fb80814b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:53.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.178+0000 7fb80f59d700 1 -- 172.21.15.60:0/2214738765 shutdown_connections 2023-10-06T04:28:53.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.178+0000 7fb80f59d700 1 -- 172.21.15.60:0/2214738765 wait complete. 2023-10-06T04:28:53.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:28:53.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.389+0000 7fa1d6d9d700 1 Processor -- start 2023-10-06T04:28:53.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.389+0000 7fa1d6d9d700 1 -- start start 2023-10-06T04:28:53.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.390+0000 7fa1d6d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa1d00c6220 0x7fa1d00cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:53.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.390+0000 7fa1d6d9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d00cc800 con 0x7fa1d0159470 2023-10-06T04:28:53.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.390+0000 7fa1d6d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d00cbc30 con 0x7fa1d00cd330 2023-10-06T04:28:53.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.390+0000 7fa1d6d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d00cbed0 con 0x7fa1d00c6220 2023-10-06T04:28:53.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.390+0000 7fa1d5d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa1d0159470 0x7fa1d00ccc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34772/0 (socket says 172.21.15.60:34772) 2023-10-06T04:28:53.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.391+0000 7fa1d5d9b700 1 -- 172.21.15.60:0/209316161 learned_addr learned my addr 172.21.15.60:0/209316161 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:53.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.391+0000 7fa1d659c700 1 --2- 172.21.15.60:0/209316161 >> v2:172.21.15.135:3300/0 conn(0x7fa1d00c6220 0x7fa1d00cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:53.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.391+0000 7fa1d4d99700 1 -- 172.21.15.60:0/209316161 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439451245 0 0) 0x7fa1d00cc800 con 0x7fa1d0159470 2023-10-06T04:28:53.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.391+0000 7fa1d4d99700 1 -- 172.21.15.60:0/209316161 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1bc003570 con 0x7fa1d0159470 2023-10-06T04:28:53.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.391+0000 7fa1d659c700 1 -- 172.21.15.60:0/209316161 >> v1:172.21.15.135:6789/0 conn(0x7fa1d00cd330 legacy=0x7fa1d00ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:53.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.391+0000 7fa1d659c700 1 -- 172.21.15.60:0/209316161 >> v1:172.21.15.60:6789/0 conn(0x7fa1d0159470 legacy=0x7fa1d00ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:53.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.391+0000 7fa1d659c700 1 -- 172.21.15.60:0/209316161 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d00cc1b0 con 0x7fa1d00c6220 2023-10-06T04:28:53.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.392+0000 7fa1d659c700 1 --2- 172.21.15.60:0/209316161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1d00c6220 0x7fa1d00cf090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009e60 tx=0x7fa1c8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4ba2a78e18ea67d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:53.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.392+0000 7fa1d4d99700 1 -- 172.21.15.60:0/209316161 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c800e070 con 0x7fa1d00c6220 2023-10-06T04:28:53.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.392+0000 7fa1d4d99700 1 -- 172.21.15.60:0/209316161 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c800bb60 con 0x7fa1d00c6220 2023-10-06T04:28:53.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.392+0000 7fa1d4d99700 1 -- 172.21.15.60:0/209316161 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8012430 con 0x7fa1d00c6220 2023-10-06T04:28:53.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.392+0000 7fa1d6d9d700 1 -- 172.21.15.60:0/209316161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1d00c6220 msgr2=0x7fa1d00cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:53.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.392+0000 7fa1d6d9d700 1 --2- 172.21.15.60:0/209316161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1d00c6220 0x7fa1d00cf090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009e60 tx=0x7fa1c8009780 comp rx=0 tx=0).stop 2023-10-06T04:28:53.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.392+0000 7fa1d6d9d700 1 -- 172.21.15.60:0/209316161 shutdown_connections 2023-10-06T04:28:53.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.392+0000 7fa1d6d9d700 1 --2- 172.21.15.60:0/209316161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1d00c6220 0x7fa1d00cf090 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:53.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.393+0000 7fa1d6d9d700 1 -- 172.21.15.60:0/209316161 >> 172.21.15.60:0/209316161 conn(0x7fa1d00995c0 msgr2=0x7fa1d006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:53.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.393+0000 7fa1d6d9d700 1 -- 172.21.15.60:0/209316161 shutdown_connections 2023-10-06T04:28:53.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.393+0000 7fa1d6d9d700 1 -- 172.21.15.60:0/209316161 wait complete. 2023-10-06T04:28:53.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.394+0000 7fa1d6d9d700 1 Processor -- start 2023-10-06T04:28:53.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.394+0000 7fa1d6d9d700 1 -- start start 2023-10-06T04:28:53.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.395+0000 7fa1d6d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1d00c6220 0x7fa1d0158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:53.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.395+0000 7fa1d6d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1d00cd330 0x7fa1d00c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:53.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.395+0000 7fa1d6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d0159470 0x7fa1d0151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:53.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.395+0000 7fa1d6d9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d00c8720 con 0x7fa1d0159470 2023-10-06T04:28:53.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.395+0000 7fa1d6d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d00c9560 con 0x7fa1d00cd330 2023-10-06T04:28:53.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.395+0000 7fa1d6d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d00c8950 con 0x7fa1d00c6220 2023-10-06T04:28:53.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.395+0000 7fa1d659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d0159470 0x7fa1d0151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:53.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.395+0000 7fa1d659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d0159470 0x7fa1d0151dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44564/0 (socket says 172.21.15.60:44564) 2023-10-06T04:28:53.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.395+0000 7fa1d659c700 1 -- 172.21.15.60:0/3639035475 learned_addr learned my addr 172.21.15.60:0/3639035475 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:53.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.396+0000 7fa1d559a700 1 --2- 172.21.15.60:0/3639035475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1d00cd330 0x7fa1d00c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:53.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.396+0000 7fa1d5d9b700 1 --2- 172.21.15.60:0/3639035475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1d00c6220 0x7fa1d0158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:53.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.396+0000 7fa1d659c700 1 -- 172.21.15.60:0/3639035475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1d00c6220 msgr2=0x7fa1d0158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:53.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.396+0000 7fa1d659c700 1 --2- 172.21.15.60:0/3639035475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1d00c6220 0x7fa1d0158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:53.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.396+0000 7fa1d659c700 1 -- 172.21.15.60:0/3639035475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1d00cd330 msgr2=0x7fa1d00c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:53.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.396+0000 7fa1d659c700 1 --2- 172.21.15.60:0/3639035475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1d00cd330 0x7fa1d00c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:53.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.396+0000 7fa1d659c700 1 -- 172.21.15.60:0/3639035475 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c8009a20 con 0x7fa1d0159470 2023-10-06T04:28:53.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.396+0000 7fa1d5d9b700 1 --2- 172.21.15.60:0/3639035475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1d00c6220 0x7fa1d0158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:53.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.396+0000 7fa1d659c700 1 --2- 172.21.15.60:0/3639035475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d0159470 0x7fa1d0151dd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa1d006fc20 tx=0x7fa1c8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:53.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.396+0000 7fa1c5ffb700 1 -- 172.21.15.60:0/3639035475 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c80032b0 con 0x7fa1d0159470 2023-10-06T04:28:53.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.396+0000 7fa1c5ffb700 1 -- 172.21.15.60:0/3639035475 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c80263f0 con 0x7fa1d0159470 2023-10-06T04:28:53.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.396+0000 7fa1d6d9d700 1 -- 172.21.15.60:0/3639035475 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d00c8c30 con 0x7fa1d0159470 2023-10-06T04:28:53.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.396+0000 7fa1c5ffb700 1 -- 172.21.15.60:0/3639035475 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c80267b0 con 0x7fa1d0159470 2023-10-06T04:28:53.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.397+0000 7fa1d6d9d700 1 -- 172.21.15.60:0/3639035475 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d00c91f0 con 0x7fa1d0159470 2023-10-06T04:28:53.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.398+0000 7fa1d6d9d700 1 -- 172.21.15.60:0/3639035475 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d00c96f0 con 0x7fa1d0159470 2023-10-06T04:28:53.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.398+0000 7fa1c5ffb700 1 -- 172.21.15.60:0/3639035475 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa1c8026b60 con 0x7fa1d0159470 2023-10-06T04:28:53.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.399+0000 7fa1c5ffb700 1 --2- 172.21.15.60:0/3639035475 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa1b4066f30 0x7fa1b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:53.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.399+0000 7fa1c5ffb700 1 -- 172.21.15.60:0/3639035475 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fa1c8086900 con 0x7fa1d0159470 2023-10-06T04:28:53.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.399+0000 7fa1d5d9b700 1 --2- 172.21.15.60:0/3639035475 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa1b4066f30 0x7fa1b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:53.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.400+0000 7fa1d5d9b700 1 --2- 172.21.15.60:0/3639035475 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa1b4066f30 0x7fa1b40693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc001360 tx=0x7fa1cc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:53.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.403+0000 7fa1c5ffb700 1 -- 172.21.15.60:0/3639035475 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa1c8053760 con 0x7fa1d0159470 2023-10-06T04:28:53.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.609+0000 7fa1d6d9d700 1 -- 172.21.15.60:0/3639035475 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1d005f230 con 0x7fa1d0159470 2023-10-06T04:28:53.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.610+0000 7fa1c5ffb700 1 -- 172.21.15.60:0/3639035475 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18802 (secure 0 0 0) 0x7fa1c8056d00 con 0x7fa1d0159470 2023-10-06T04:28:53.613 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:53.613 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":26,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:28:53.362249+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:28:04.355358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:28:05.208550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:28:08.791979+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.1a","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:28:53.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.612+0000 7fa1d6d9d700 1 -- 172.21.15.60:0/3639035475 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa1b4066f30 msgr2=0x7fa1b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:53.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.612+0000 7fa1d6d9d700 1 --2- 172.21.15.60:0/3639035475 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa1b4066f30 0x7fa1b40693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc001360 tx=0x7fa1cc009040 comp rx=0 tx=0).stop 2023-10-06T04:28:53.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.612+0000 7fa1d6d9d700 1 -- 172.21.15.60:0/3639035475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d0159470 msgr2=0x7fa1d0151dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:53.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.612+0000 7fa1d6d9d700 1 --2- 172.21.15.60:0/3639035475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d0159470 0x7fa1d0151dd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa1d006fc20 tx=0x7fa1c8019000 comp rx=0 tx=0).stop 2023-10-06T04:28:53.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.613+0000 7fa1d6d9d700 1 -- 172.21.15.60:0/3639035475 shutdown_connections 2023-10-06T04:28:53.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.613+0000 7fa1d6d9d700 1 --2- 172.21.15.60:0/3639035475 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa1b4066f30 0x7fa1b40693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:53.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.613+0000 7fa1d6d9d700 1 --2- 172.21.15.60:0/3639035475 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d0159470 0x7fa1d0151dd0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:53.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.613+0000 7fa1d6d9d700 1 --2- 172.21.15.60:0/3639035475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1d00c6220 0x7fa1d0158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:53.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.613+0000 7fa1d6d9d700 1 --2- 172.21.15.60:0/3639035475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1d00cd330 0x7fa1d00c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:53.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.613+0000 7fa1d6d9d700 1 -- 172.21.15.60:0/3639035475 >> 172.21.15.60:0/3639035475 conn(0x7fa1d00995c0 msgr2=0x7fa1d00cdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:53.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.613+0000 7fa1d6d9d700 1 -- 172.21.15.60:0/3639035475 shutdown_connections 2023-10-06T04:28:53.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.613+0000 7fa1d6d9d700 1 -- 172.21.15.60:0/3639035475 wait complete. 2023-10-06T04:28:53.634 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:27:58.899938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:27:59.373527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:28:04.355358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:28:05.208550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:28:08.791979+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:28:53.635 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:28:53.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.824+0000 7f0c3dd9d700 1 Processor -- start 2023-10-06T04:28:53.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.824+0000 7f0c3dd9d700 1 -- start start 2023-10-06T04:28:53.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.826+0000 7f0c3dd9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0c380cb060 0x7f0c38159b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:53.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.826+0000 7f0c3dd9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c3815a080 0x7f0c380c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:53.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.826+0000 7f0c3dd9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c380ca5b0 con 0x7f0c3813c430 2023-10-06T04:28:53.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.826+0000 7f0c3dd9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3815a8e0 con 0x7f0c3815a080 2023-10-06T04:28:53.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.826+0000 7f0c3dd9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3806d500 con 0x7f0c380cb060 2023-10-06T04:28:53.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.826+0000 7f0c3d59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c3815a080 0x7f0c380c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:53.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.826+0000 7f0c3d59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c3815a080 0x7f0c380c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44580/0 (socket says 172.21.15.60:44580) 2023-10-06T04:28:53.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.826+0000 7f0c3d59c700 1 -- 172.21.15.60:0/3567409969 learned_addr learned my addr 172.21.15.60:0/3567409969 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:53.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.826+0000 7f0c37fff700 1 --2- 172.21.15.60:0/3567409969 >> v2:172.21.15.135:3300/0 conn(0x7f0c380cb060 0x7f0c38159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:53.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.827+0000 7f0c3d59c700 1 -- 172.21.15.60:0/3567409969 >> v2:172.21.15.135:3300/0 conn(0x7f0c380cb060 msgr2=0x7f0c38159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:53.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.827+0000 7f0c3d59c700 1 --2- 172.21.15.60:0/3567409969 >> v2:172.21.15.135:3300/0 conn(0x7f0c380cb060 0x7f0c38159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:53.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.827+0000 7f0c3d59c700 1 -- 172.21.15.60:0/3567409969 >> v1:172.21.15.135:6789/0 conn(0x7f0c3813c430 legacy=0x7f0c380ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:53.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.827+0000 7f0c3d59c700 1 -- 172.21.15.60:0/3567409969 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3813c800 con 0x7f0c3815a080 2023-10-06T04:28:53.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.827+0000 7f0c3d59c700 1 --2- 172.21.15.60:0/3567409969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3815a080 0x7f0c380c86f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0c380c5010 tx=0x7f0c30009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be51688fac0cba09 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:53.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.827+0000 7f0c377fe700 1 -- 172.21.15.60:0/3567409969 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3000e070 con 0x7f0c3815a080 2023-10-06T04:28:53.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.827+0000 7f0c377fe700 1 -- 172.21.15.60:0/3567409969 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3000ba10 con 0x7f0c3815a080 2023-10-06T04:28:53.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.827+0000 7f0c377fe700 1 -- 172.21.15.60:0/3567409969 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c300092e0 con 0x7f0c3815a080 2023-10-06T04:28:53.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.828+0000 7f0c3dd9d700 1 -- 172.21.15.60:0/3567409969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3815a080 msgr2=0x7f0c380c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:53.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.828+0000 7f0c3dd9d700 1 --2- 172.21.15.60:0/3567409969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3815a080 0x7f0c380c86f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0c380c5010 tx=0x7f0c30009840 comp rx=0 tx=0).stop 2023-10-06T04:28:53.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.828+0000 7f0c3dd9d700 1 -- 172.21.15.60:0/3567409969 shutdown_connections 2023-10-06T04:28:53.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.828+0000 7f0c3dd9d700 1 --2- 172.21.15.60:0/3567409969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3815a080 0x7f0c380c86f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:53.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.828+0000 7f0c3dd9d700 1 --2- 172.21.15.60:0/3567409969 >> v2:172.21.15.135:3300/0 conn(0x7f0c380cb060 0x7f0c38159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:53.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.828+0000 7f0c3dd9d700 1 -- 172.21.15.60:0/3567409969 >> 172.21.15.60:0/3567409969 conn(0x7f0c3806b330 msgr2=0x7f0c3806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:53.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.828+0000 7f0c3dd9d700 1 -- 172.21.15.60:0/3567409969 shutdown_connections 2023-10-06T04:28:53.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.828+0000 7f0c3dd9d700 1 -- 172.21.15.60:0/3567409969 wait complete. 2023-10-06T04:28:53.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.829+0000 7f0c3dd9d700 1 Processor -- start 2023-10-06T04:28:53.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.829+0000 7f0c3dd9d700 1 -- start start 2023-10-06T04:28:53.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.830+0000 7f0c3dd9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c380cb060 0x7f0c38158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:53.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.830+0000 7f0c3dd9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c3813c430 0x7f0c3813ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:53.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.830+0000 7f0c3dd9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3815a080 0x7f0c3813ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:53.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.830+0000 7f0c3dd9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3813cf70 con 0x7f0c3815a080 2023-10-06T04:28:53.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.830+0000 7f0c3dd9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c381695e0 con 0x7f0c3813c430 2023-10-06T04:28:53.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.830+0000 7f0c3dd9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3813da20 con 0x7f0c380cb060 2023-10-06T04:28:53.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.830+0000 7f0c3d59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3815a080 0x7f0c3813ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:53.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.831+0000 7f0c3d59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3815a080 0x7f0c3813ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44594/0 (socket says 172.21.15.60:44594) 2023-10-06T04:28:53.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.831+0000 7f0c3d59c700 1 -- 172.21.15.60:0/4210688520 learned_addr learned my addr 172.21.15.60:0/4210688520 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:53.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.831+0000 7f0c37fff700 1 --2- 172.21.15.60:0/4210688520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c3813c430 0x7f0c3813ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:53.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.831+0000 7f0c3cd9b700 1 --2- 172.21.15.60:0/4210688520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c380cb060 0x7f0c38158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:53.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.831+0000 7f0c3d59c700 1 -- 172.21.15.60:0/4210688520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c380cb060 msgr2=0x7f0c38158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:53.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.831+0000 7f0c3d59c700 1 --2- 172.21.15.60:0/4210688520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c380cb060 0x7f0c38158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:53.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.831+0000 7f0c3d59c700 1 -- 172.21.15.60:0/4210688520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c3813c430 msgr2=0x7f0c3813ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:53.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.831+0000 7f0c3d59c700 1 --2- 172.21.15.60:0/4210688520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c3813c430 0x7f0c3813ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:53.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.831+0000 7f0c3d59c700 1 -- 172.21.15.60:0/4210688520 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c30009ae0 con 0x7f0c3815a080 2023-10-06T04:28:53.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.831+0000 7f0c3cd9b700 1 --2- 172.21.15.60:0/4210688520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c380cb060 0x7f0c38158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:53.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.831+0000 7f0c37fff700 1 --2- 172.21.15.60:0/4210688520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c3813c430 0x7f0c3813ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:53.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.831+0000 7f0c3d59c700 1 --2- 172.21.15.60:0/4210688520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3815a080 0x7f0c3813ba20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0c380712e0 tx=0x7f0c30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:53.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.831+0000 7f0c34ff9700 1 -- 172.21.15.60:0/4210688520 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c300094e0 con 0x7f0c3815a080 2023-10-06T04:28:53.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.831+0000 7f0c34ff9700 1 -- 172.21.15.60:0/4210688520 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c30012e60 con 0x7f0c3815a080 2023-10-06T04:28:53.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.831+0000 7f0c34ff9700 1 -- 172.21.15.60:0/4210688520 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3001d670 con 0x7f0c3815a080 2023-10-06T04:28:53.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.831+0000 7f0c3dd9d700 1 -- 172.21.15.60:0/4210688520 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3813d180 con 0x7f0c3815a080 2023-10-06T04:28:53.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.832+0000 7f0c3dd9d700 1 -- 172.21.15.60:0/4210688520 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3813d740 con 0x7f0c3815a080 2023-10-06T04:28:53.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.833+0000 7f0c3dd9d700 1 -- 172.21.15.60:0/4210688520 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c3805f230 con 0x7f0c3815a080 2023-10-06T04:28:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.833+0000 7f0c34ff9700 1 -- 172.21.15.60:0/4210688520 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c3001da20 con 0x7f0c3815a080 2023-10-06T04:28:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.834+0000 7f0c34ff9700 1 --2- 172.21.15.60:0/4210688520 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0c1c066f30 0x7f0c1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.834+0000 7f0c34ff9700 1 -- 172.21.15.60:0/4210688520 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f0c30086210 con 0x7f0c3815a080 2023-10-06T04:28:53.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.835+0000 7f0c3cd9b700 1 --2- 172.21.15.60:0/4210688520 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0c1c066f30 0x7f0c1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:53.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.835+0000 7f0c3cd9b700 1 --2- 172.21.15.60:0/4210688520 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0c1c066f30 0x7f0c1c0693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c002880 tx=0x7f0c2c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:53.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:53.839+0000 7f0c34ff9700 1 -- 172.21.15.60:0/4210688520 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c30052f50 con 0x7f0c3815a080 2023-10-06T04:28:54.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.044+0000 7f0c3dd9d700 1 -- 172.21.15.60:0/4210688520 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0c38169720 con 0x7f0c3815a080 2023-10-06T04:28:54.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.044+0000 7f0c34ff9700 1 -- 172.21.15.60:0/4210688520 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0c30056570 con 0x7f0c3815a080 2023-10-06T04:28:54.047 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-10-06T04:28:54.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.046+0000 7f0c3dd9d700 1 -- 172.21.15.60:0/4210688520 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0c1c066f30 msgr2=0x7f0c1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:54.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.046+0000 7f0c3dd9d700 1 --2- 172.21.15.60:0/4210688520 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0c1c066f30 0x7f0c1c0693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c002880 tx=0x7f0c2c009040 comp rx=0 tx=0).stop 2023-10-06T04:28:54.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.046+0000 7f0c3dd9d700 1 -- 172.21.15.60:0/4210688520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3815a080 msgr2=0x7f0c3813ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:54.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.046+0000 7f0c3dd9d700 1 --2- 172.21.15.60:0/4210688520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3815a080 0x7f0c3813ba20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0c380712e0 tx=0x7f0c30017000 comp rx=0 tx=0).stop 2023-10-06T04:28:54.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.047+0000 7f0c3dd9d700 1 -- 172.21.15.60:0/4210688520 shutdown_connections 2023-10-06T04:28:54.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.047+0000 7f0c3dd9d700 1 --2- 172.21.15.60:0/4210688520 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0c1c066f30 0x7f0c1c0693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.047+0000 7f0c3dd9d700 1 --2- 172.21.15.60:0/4210688520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c3815a080 0x7f0c3813ba20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.047+0000 7f0c3dd9d700 1 --2- 172.21.15.60:0/4210688520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c380cb060 0x7f0c38158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.047+0000 7f0c3dd9d700 1 --2- 172.21.15.60:0/4210688520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c3813c430 0x7f0c3813ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.047+0000 7f0c3dd9d700 1 -- 172.21.15.60:0/4210688520 >> 172.21.15.60:0/4210688520 conn(0x7f0c3806b330 msgr2=0x7f0c381557a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:54.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.047+0000 7f0c3dd9d700 1 -- 172.21.15.60:0/4210688520 shutdown_connections 2023-10-06T04:28:54.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.047+0000 7f0c3dd9d700 1 -- 172.21.15.60:0/4210688520 wait complete. 2023-10-06T04:28:54.066 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:28:54.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.255+0000 7fa311d9d700 1 Processor -- start 2023-10-06T04:28:54.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.256+0000 7fa311d9d700 1 -- start start 2023-10-06T04:28:54.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.257+0000 7fa311d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa30c154e60 0x7fa30c0adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:54.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.257+0000 7fa311d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa30c0adfe0 0x7fa30c0ab790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:54.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.257+0000 7fa311d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30c0ae440 con 0x7fa30c154a90 2023-10-06T04:28:54.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.257+0000 7fa311d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30c06ef10 con 0x7fa30c0adfe0 2023-10-06T04:28:54.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.257+0000 7fa311d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c06e300 con 0x7fa30c154e60 2023-10-06T04:28:54.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.257+0000 7fa30bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa30c154e60 0x7fa30c0adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:54.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.257+0000 7fa31159c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa30c0adfe0 0x7fa30c0ab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:54.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.257+0000 7fa30bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa30c154e60 0x7fa30c0adaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:44026/0 (socket says 172.21.15.60:44026) 2023-10-06T04:28:54.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.257+0000 7fa30bfff700 1 -- 172.21.15.60:0/3989031963 learned_addr learned my addr 172.21.15.60:0/3989031963 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:54.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.257+0000 7fa310d9b700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fa30c154a90 0x7fa30c0b1590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.60:52996/0 (socket says 172.21.15.60:52996) 2023-10-06T04:28:54.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.258+0000 7fa30bfff700 1 -- 172.21.15.60:0/3989031963 >> v2:172.21.15.135:3300/0 conn(0x7fa30c0adfe0 msgr2=0x7fa30c0ab790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:54.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.258+0000 7fa30bfff700 1 --2- 172.21.15.60:0/3989031963 >> v2:172.21.15.135:3300/0 conn(0x7fa30c0adfe0 0x7fa30c0ab790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.258+0000 7fa30bfff700 1 -- 172.21.15.60:0/3989031963 >> v1:172.21.15.135:6789/0 conn(0x7fa30c154a90 legacy=0x7fa30c0b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:54.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.258+0000 7fa30bfff700 1 -- 172.21.15.60:0/3989031963 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c06e5e0 con 0x7fa30c154e60 2023-10-06T04:28:54.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.258+0000 7fa31159c700 1 --2- 172.21.15.60:0/3989031963 >> v2:172.21.15.135:3300/0 conn(0x7fa30c0adfe0 0x7fa30c0ab790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:54.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.258+0000 7fa30bfff700 1 --2- 172.21.15.60:0/3989031963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa30c154e60 0x7fa30c0adaa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80099b0 tx=0x7fa2f8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb887e80ee345806 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:54.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.259+0000 7fa30b7fe700 1 -- 172.21.15.60:0/3989031963 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8009ea0 con 0x7fa30c154e60 2023-10-06T04:28:54.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.259+0000 7fa30b7fe700 1 -- 172.21.15.60:0/3989031963 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f800b860 con 0x7fa30c154e60 2023-10-06T04:28:54.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.259+0000 7fa30b7fe700 1 -- 172.21.15.60:0/3989031963 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f800bc00 con 0x7fa30c154e60 2023-10-06T04:28:54.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.259+0000 7fa311d9d700 1 -- 172.21.15.60:0/3989031963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa30c154e60 msgr2=0x7fa30c0adaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:54.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.259+0000 7fa311d9d700 1 --2- 172.21.15.60:0/3989031963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa30c154e60 0x7fa30c0adaa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80099b0 tx=0x7fa2f8009250 comp rx=0 tx=0).stop 2023-10-06T04:28:54.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.259+0000 7fa311d9d700 1 -- 172.21.15.60:0/3989031963 shutdown_connections 2023-10-06T04:28:54.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.259+0000 7fa311d9d700 1 --2- 172.21.15.60:0/3989031963 >> v2:172.21.15.135:3300/0 conn(0x7fa30c0adfe0 0x7fa30c0ab790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.259+0000 7fa311d9d700 1 --2- 172.21.15.60:0/3989031963 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa30c154e60 0x7fa30c0adaa0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.259+0000 7fa311d9d700 1 -- 172.21.15.60:0/3989031963 >> 172.21.15.60:0/3989031963 conn(0x7fa30c0cbed0 msgr2=0x7fa30c0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:54.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.259+0000 7fa311d9d700 1 -- 172.21.15.60:0/3989031963 shutdown_connections 2023-10-06T04:28:54.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.259+0000 7fa311d9d700 1 -- 172.21.15.60:0/3989031963 wait complete. 2023-10-06T04:28:54.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.261+0000 7fa311d9d700 1 Processor -- start 2023-10-06T04:28:54.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.261+0000 7fa311d9d700 1 -- start start 2023-10-06T04:28:54.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.262+0000 7fa311d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa30c0adfe0 0x7fa30c14ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:54.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.262+0000 7fa311d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa30c154a90 0x7fa30c06a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:54.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.262+0000 7fa311d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa30c154e60 0x7fa30c06a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:54.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.262+0000 7fa311d9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c0c5d30 con 0x7fa30c154e60 2023-10-06T04:28:54.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.262+0000 7fa311d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c14f390 con 0x7fa30c0adfe0 2023-10-06T04:28:54.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.262+0000 7fa311d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c0c5120 con 0x7fa30c154a90 2023-10-06T04:28:54.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.262+0000 7fa31159c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa30c154e60 0x7fa30c06a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:54.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.262+0000 7fa31159c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa30c154e60 0x7fa30c06a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44602/0 (socket says 172.21.15.60:44602) 2023-10-06T04:28:54.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.262+0000 7fa31159c700 1 -- 172.21.15.60:0/724222368 learned_addr learned my addr 172.21.15.60:0/724222368 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:54.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.262+0000 7fa30bfff700 1 --2- 172.21.15.60:0/724222368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa30c154a90 0x7fa30c06a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:54.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.262+0000 7fa310d9b700 1 --2- 172.21.15.60:0/724222368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa30c0adfe0 0x7fa30c14ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:54.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.263+0000 7fa31159c700 1 -- 172.21.15.60:0/724222368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa30c154a90 msgr2=0x7fa30c06a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:54.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.263+0000 7fa31159c700 1 --2- 172.21.15.60:0/724222368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa30c154a90 0x7fa30c06a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.263+0000 7fa31159c700 1 -- 172.21.15.60:0/724222368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa30c0adfe0 msgr2=0x7fa30c14ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:54.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.263+0000 7fa31159c700 1 --2- 172.21.15.60:0/724222368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa30c0adfe0 0x7fa30c14ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.263+0000 7fa31159c700 1 -- 172.21.15.60:0/724222368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa304009a20 con 0x7fa30c154e60 2023-10-06T04:28:54.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.263+0000 7fa31159c700 1 --2- 172.21.15.60:0/724222368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa30c154e60 0x7fa30c06a740 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa304009fc0 tx=0x7fa30400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:54.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.263+0000 7fa308ff9700 1 -- 172.21.15.60:0/724222368 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30400cbd0 con 0x7fa30c154e60 2023-10-06T04:28:54.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.263+0000 7fa308ff9700 1 -- 172.21.15.60:0/724222368 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30400f040 con 0x7fa30c154e60 2023-10-06T04:28:54.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.263+0000 7fa308ff9700 1 -- 172.21.15.60:0/724222368 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa304014480 con 0x7fa30c154e60 2023-10-06T04:28:54.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.263+0000 7fa311d9d700 1 -- 172.21.15.60:0/724222368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f80094f0 con 0x7fa30c154e60 2023-10-06T04:28:54.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.264+0000 7fa311d9d700 1 -- 172.21.15.60:0/724222368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30c0c56e0 con 0x7fa30c154e60 2023-10-06T04:28:54.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.264+0000 7fa311d9d700 1 -- 172.21.15.60:0/724222368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa30c05f230 con 0x7fa30c154e60 2023-10-06T04:28:54.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.265+0000 7fa308ff9700 1 -- 172.21.15.60:0/724222368 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa304003020 con 0x7fa30c154e60 2023-10-06T04:28:54.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.266+0000 7fa308ff9700 1 --2- 172.21.15.60:0/724222368 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa2f0066f30 0x7fa2f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:54.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.266+0000 7fa308ff9700 1 -- 172.21.15.60:0/724222368 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fa304085340 con 0x7fa30c154e60 2023-10-06T04:28:54.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.267+0000 7fa310d9b700 1 --2- 172.21.15.60:0/724222368 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa2f0066f30 0x7fa2f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:54.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.267+0000 7fa310d9b700 1 --2- 172.21.15.60:0/724222368 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa2f0066f30 0x7fa2f00693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa300004fd0 tx=0x7fa300007eb0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:54.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.270+0000 7fa308ff9700 1 -- 172.21.15.60:0/724222368 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa304052120 con 0x7fa30c154e60 2023-10-06T04:28:54.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.478+0000 7fa311d9d700 1 -- 172.21.15.60:0/724222368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa30c06e8c0 con 0x7fa30c154e60 2023-10-06T04:28:54.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.479+0000 7fa308ff9700 1 -- 172.21.15.60:0/724222368 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa304055740 con 0x7fa30c154e60 2023-10-06T04:28:54.481 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-06T04:28:54.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.481+0000 7fa311d9d700 1 -- 172.21.15.60:0/724222368 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa2f0066f30 msgr2=0x7fa2f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:54.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.481+0000 7fa311d9d700 1 --2- 172.21.15.60:0/724222368 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa2f0066f30 0x7fa2f00693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa300004fd0 tx=0x7fa300007eb0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.481+0000 7fa311d9d700 1 -- 172.21.15.60:0/724222368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa30c154e60 msgr2=0x7fa30c06a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:54.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.481+0000 7fa311d9d700 1 --2- 172.21.15.60:0/724222368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa30c154e60 0x7fa30c06a740 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa304009fc0 tx=0x7fa30400b040 comp rx=0 tx=0).stop 2023-10-06T04:28:54.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.481+0000 7fa311d9d700 1 -- 172.21.15.60:0/724222368 shutdown_connections 2023-10-06T04:28:54.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.481+0000 7fa311d9d700 1 --2- 172.21.15.60:0/724222368 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa2f0066f30 0x7fa2f00693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.481+0000 7fa311d9d700 1 --2- 172.21.15.60:0/724222368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa30c154e60 0x7fa30c06a740 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.481+0000 7fa311d9d700 1 --2- 172.21.15.60:0/724222368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa30c0adfe0 0x7fa30c14ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.481+0000 7fa311d9d700 1 --2- 172.21.15.60:0/724222368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa30c154a90 0x7fa30c06a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.481+0000 7fa311d9d700 1 -- 172.21.15.60:0/724222368 >> 172.21.15.60:0/724222368 conn(0x7fa30c0cbed0 msgr2=0x7fa30c14fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:54.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.481+0000 7fa311d9d700 1 -- 172.21.15.60:0/724222368 shutdown_connections 2023-10-06T04:28:54.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.481+0000 7fa311d9d700 1 -- 172.21.15.60:0/724222368 wait complete. 2023-10-06T04:28:54.501 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:28:54.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.691+0000 7fb8fffff700 1 Processor -- start 2023-10-06T04:28:54.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.691+0000 7fb8fffff700 1 -- start start 2023-10-06T04:28:54.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.693+0000 7fb8fffff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb9001560f0 0x7fb900159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:54.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.693+0000 7fb8fffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000ae0b0 0x7fb9000c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:54.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.693+0000 7fb8fffff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9000acad0 con 0x7fb9000c8f30 2023-10-06T04:28:54.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.693+0000 7fb8fffff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9001564c0 con 0x7fb9001560f0 2023-10-06T04:28:54.695 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.693+0000 7fb8fffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90015a2d0 con 0x7fb9000ae0b0 2023-10-06T04:28:54.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.693+0000 7fb8fe7fc700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000ae0b0 0x7fb9000c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:54.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.693+0000 7fb8feffd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb9001560f0 0x7fb900159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:54.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.693+0000 7fb8fe7fc700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000ae0b0 0x7fb9000c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:44050/0 (socket says 172.21.15.60:44050) 2023-10-06T04:28:54.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.693+0000 7fb8fe7fc700 1 -- 172.21.15.60:0/448680950 learned_addr learned my addr 172.21.15.60:0/448680950 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:54.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.694+0000 7fb8fe7fc700 1 -- 172.21.15.60:0/448680950 >> v2:172.21.15.135:3300/0 conn(0x7fb9001560f0 msgr2=0x7fb900159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:54.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.694+0000 7fb8fe7fc700 1 --2- 172.21.15.60:0/448680950 >> v2:172.21.15.135:3300/0 conn(0x7fb9001560f0 0x7fb900159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.694+0000 7fb8fe7fc700 1 -- 172.21.15.60:0/448680950 >> v1:172.21.15.135:6789/0 conn(0x7fb9000c8f30 legacy=0x7fb90006e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:54.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.694+0000 7fb8fe7fc700 1 -- 172.21.15.60:0/448680950 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90015a5b0 con 0x7fb9000ae0b0 2023-10-06T04:28:54.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.694+0000 7fb8feffd700 1 --2- 172.21.15.60:0/448680950 >> v2:172.21.15.135:3300/0 conn(0x7fb9001560f0 0x7fb900159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:54.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.694+0000 7fb8fe7fc700 1 --2- 172.21.15.60:0/448680950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000ae0b0 0x7fb9000c89f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb8f40099b0 tx=0x7fb8f4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bc31555fa4fdd0c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:54.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.694+0000 7fb8fdffb700 1 -- 172.21.15.60:0/448680950 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4009ea0 con 0x7fb9000ae0b0 2023-10-06T04:28:54.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.694+0000 7fb8fdffb700 1 -- 172.21.15.60:0/448680950 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f400b860 con 0x7fb9000ae0b0 2023-10-06T04:28:54.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.695+0000 7fb8fdffb700 1 -- 172.21.15.60:0/448680950 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f400bc00 con 0x7fb9000ae0b0 2023-10-06T04:28:54.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.695+0000 7fb8fffff700 1 -- 172.21.15.60:0/448680950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000ae0b0 msgr2=0x7fb9000c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:54.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.695+0000 7fb8fffff700 1 --2- 172.21.15.60:0/448680950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000ae0b0 0x7fb9000c89f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb8f40099b0 tx=0x7fb8f4009250 comp rx=0 tx=0).stop 2023-10-06T04:28:54.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.695+0000 7fb8fffff700 1 -- 172.21.15.60:0/448680950 shutdown_connections 2023-10-06T04:28:54.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.695+0000 7fb8fffff700 1 --2- 172.21.15.60:0/448680950 >> v2:172.21.15.135:3300/0 conn(0x7fb9001560f0 0x7fb900159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.695+0000 7fb8fffff700 1 --2- 172.21.15.60:0/448680950 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000ae0b0 0x7fb9000c89f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.695+0000 7fb8fffff700 1 -- 172.21.15.60:0/448680950 >> 172.21.15.60:0/448680950 conn(0x7fb9000cbed0 msgr2=0x7fb9000cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:54.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.695+0000 7fb8fffff700 1 -- 172.21.15.60:0/448680950 shutdown_connections 2023-10-06T04:28:54.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.695+0000 7fb8fffff700 1 -- 172.21.15.60:0/448680950 wait complete. 2023-10-06T04:28:54.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.696+0000 7fb8fffff700 1 Processor -- start 2023-10-06T04:28:54.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.697+0000 7fb8fffff700 1 -- start start 2023-10-06T04:28:54.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.697+0000 7fb8fffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000ae0b0 0x7fb9000af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:54.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.697+0000 7fb8fffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9000c8f30 0x7fb9001687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:54.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.698+0000 7fb8fffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9001560f0 0x7fb900158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:54.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.698+0000 7fb8fffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb900167580 con 0x7fb9001560f0 2023-10-06T04:28:54.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.698+0000 7fb8fffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000ca730 con 0x7fb9000c8f30 2023-10-06T04:28:54.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.698+0000 7fb8fffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000caa10 con 0x7fb9000ae0b0 2023-10-06T04:28:54.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.698+0000 7fb8ff7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9001560f0 0x7fb900158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:54.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.698+0000 7fb8ff7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9001560f0 0x7fb900158520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44612/0 (socket says 172.21.15.60:44612) 2023-10-06T04:28:54.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.698+0000 7fb8ff7fe700 1 -- 172.21.15.60:0/68543971 learned_addr learned my addr 172.21.15.60:0/68543971 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:54.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.698+0000 7fb8feffd700 1 --2- 172.21.15.60:0/68543971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000ae0b0 0x7fb9000af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:54.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.698+0000 7fb8fe7fc700 1 --2- 172.21.15.60:0/68543971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9000c8f30 0x7fb9001687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:54.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.698+0000 7fb8ff7fe700 1 -- 172.21.15.60:0/68543971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000ae0b0 msgr2=0x7fb9000af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:54.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.698+0000 7fb8ff7fe700 1 --2- 172.21.15.60:0/68543971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000ae0b0 0x7fb9000af6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.698+0000 7fb8ff7fe700 1 -- 172.21.15.60:0/68543971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9000c8f30 msgr2=0x7fb9001687b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:54.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.698+0000 7fb8ff7fe700 1 --2- 172.21.15.60:0/68543971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9000c8f30 0x7fb9001687b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.698+0000 7fb8ff7fe700 1 -- 172.21.15.60:0/68543971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f0009420 con 0x7fb9001560f0 2023-10-06T04:28:54.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.698+0000 7fb8feffd700 1 --2- 172.21.15.60:0/68543971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000ae0b0 0x7fb9000af6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:54.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.698+0000 7fb8fe7fc700 1 --2- 172.21.15.60:0/68543971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9000c8f30 0x7fb9001687b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:54.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.698+0000 7fb8ff7fe700 1 --2- 172.21.15.60:0/68543971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9001560f0 0x7fb900158520 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb8f800c910 tx=0x7fb8f80016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:54.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.699+0000 7fb8e6ffd700 1 -- 172.21.15.60:0/68543971 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f800ce50 con 0x7fb9001560f0 2023-10-06T04:28:54.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.699+0000 7fb8e6ffd700 1 -- 172.21.15.60:0/68543971 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f800a7e0 con 0x7fb9001560f0 2023-10-06T04:28:54.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.699+0000 7fb8fffff700 1 -- 172.21.15.60:0/68543971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f40094f0 con 0x7fb9001560f0 2023-10-06T04:28:54.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.699+0000 7fb8e6ffd700 1 -- 172.21.15.60:0/68543971 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f800ab80 con 0x7fb9001560f0 2023-10-06T04:28:54.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.699+0000 7fb8fffff700 1 -- 172.21.15.60:0/68543971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9000cafd0 con 0x7fb9001560f0 2023-10-06T04:28:54.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.700+0000 7fb8fffff700 1 -- 172.21.15.60:0/68543971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9001677c0 con 0x7fb9001560f0 2023-10-06T04:28:54.705 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.701+0000 7fb8e6ffd700 1 -- 172.21.15.60:0/68543971 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8f8012420 con 0x7fb9001560f0 2023-10-06T04:28:54.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.702+0000 7fb8e6ffd700 1 --2- 172.21.15.60:0/68543971 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb8ec066f30 0x7fb8ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:54.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.702+0000 7fb8e6ffd700 1 -- 172.21.15.60:0/68543971 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fb8f8084c70 con 0x7fb9001560f0 2023-10-06T04:28:54.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.702+0000 7fb8feffd700 1 --2- 172.21.15.60:0/68543971 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb8ec066f30 0x7fb8ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:54.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.703+0000 7fb8feffd700 1 --2- 172.21.15.60:0/68543971 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb8ec066f30 0x7fb8ec0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb8f00093f0 tx=0x7fb8f0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:54.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.706+0000 7fb8e6ffd700 1 -- 172.21.15.60:0/68543971 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9001677c0 con 0x7fb9001560f0 2023-10-06T04:28:54.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.909+0000 7fb8fffff700 1 -- 172.21.15.60:0/68543971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9001677c0 con 0x7fb9001560f0 2023-10-06T04:28:54.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.909+0000 7fb8e6ffd700 1 -- 172.21.15.60:0/68543971 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb9001677c0 con 0x7fb9001560f0 2023-10-06T04:28:54.912 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-06T04:28:54.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.912+0000 7fb8fffff700 1 -- 172.21.15.60:0/68543971 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb8ec066f30 msgr2=0x7fb8ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:54.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.912+0000 7fb8fffff700 1 --2- 172.21.15.60:0/68543971 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb8ec066f30 0x7fb8ec0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb8f00093f0 tx=0x7fb8f0008040 comp rx=0 tx=0).stop 2023-10-06T04:28:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.912+0000 7fb8fffff700 1 -- 172.21.15.60:0/68543971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9001560f0 msgr2=0x7fb900158520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.912+0000 7fb8fffff700 1 --2- 172.21.15.60:0/68543971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9001560f0 0x7fb900158520 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb8f800c910 tx=0x7fb8f80016b0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.912+0000 7fb8fffff700 1 -- 172.21.15.60:0/68543971 shutdown_connections 2023-10-06T04:28:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.912+0000 7fb8fffff700 1 --2- 172.21.15.60:0/68543971 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb8ec066f30 0x7fb8ec0693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.912+0000 7fb8fffff700 1 --2- 172.21.15.60:0/68543971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9001560f0 0x7fb900158520 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.912+0000 7fb8fffff700 1 --2- 172.21.15.60:0/68543971 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb9000ae0b0 0x7fb9000af6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.912+0000 7fb8fffff700 1 --2- 172.21.15.60:0/68543971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9000c8f30 0x7fb9001687b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.912+0000 7fb8fffff700 1 -- 172.21.15.60:0/68543971 >> 172.21.15.60:0/68543971 conn(0x7fb9000cbed0 msgr2=0x7fb90006d900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.912+0000 7fb8fffff700 1 -- 172.21.15.60:0/68543971 shutdown_connections 2023-10-06T04:28:54.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:54.912+0000 7fb8fffff700 1 -- 172.21.15.60:0/68543971 wait complete. 2023-10-06T04:28:54.932 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:28:55.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.119+0000 7fecdeb9d700 1 Processor -- start 2023-10-06T04:28:55.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.119+0000 7fecdeb9d700 1 -- start start 2023-10-06T04:28:55.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.121+0000 7fecdeb9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fecd80cd3c0 0x7fecd80ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:55.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.121+0000 7fecdeb9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fecd80b29f0 0x7fecd80cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:55.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.121+0000 7fecdeb9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd80cc970 con 0x7fecd80b2620 2023-10-06T04:28:55.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.121+0000 7fecdeb9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd80cf520 con 0x7fecd80cd3c0 2023-10-06T04:28:55.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.121+0000 7fecdeb9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd80cbd60 con 0x7fecd80b29f0 2023-10-06T04:28:55.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.121+0000 7fecdd39a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fecd80cd3c0 0x7fecd80ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:55.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.121+0000 7fecddb9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fecd80b2620 0x7fecd80cccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34786/0 (socket says 172.21.15.60:34786) 2023-10-06T04:28:55.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.121+0000 7fecddb9b700 1 -- 172.21.15.60:0/4283376218 learned_addr learned my addr 172.21.15.60:0/4283376218 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:55.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.121+0000 7fecde39c700 1 --2- 172.21.15.60:0/4283376218 >> v2:172.21.15.135:3300/0 conn(0x7fecd80b29f0 0x7fecd80cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:55.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.121+0000 7fecdd39a700 1 -- 172.21.15.60:0/4283376218 >> v2:172.21.15.135:3300/0 conn(0x7fecd80b29f0 msgr2=0x7fecd80cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:55.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.121+0000 7fecdd39a700 1 --2- 172.21.15.60:0/4283376218 >> v2:172.21.15.135:3300/0 conn(0x7fecd80b29f0 0x7fecd80cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.121+0000 7fecdd39a700 1 -- 172.21.15.60:0/4283376218 >> v1:172.21.15.60:6789/0 conn(0x7fecd80b2620 legacy=0x7fecd80cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:55.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.121+0000 7fecdcb99700 1 -- 172.21.15.60:0/4283376218 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619938840 0 0) 0x7fecd80cc970 con 0x7fecd80b2620 2023-10-06T04:28:55.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.122+0000 7fecdd39a700 1 -- 172.21.15.60:0/4283376218 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd80cc040 con 0x7fecd80cd3c0 2023-10-06T04:28:55.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.122+0000 7fecdd39a700 1 --2- 172.21.15.60:0/4283376218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecd80cd3c0 0x7fecd80ceaa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fecd8099b90 tx=0x7fecc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7de3a77de6489c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:55.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.122+0000 7fecdcb99700 1 -- 172.21.15.60:0/4283376218 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc800b6b0 con 0x7fecd80cd3c0 2023-10-06T04:28:55.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.122+0000 7fecdcb99700 1 -- 172.21.15.60:0/4283376218 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc800b810 con 0x7fecd80cd3c0 2023-10-06T04:28:55.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.122+0000 7fecdcb99700 1 -- 172.21.15.60:0/4283376218 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc800bbb0 con 0x7fecd80cd3c0 2023-10-06T04:28:55.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.123+0000 7fecdeb9d700 1 -- 172.21.15.60:0/4283376218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecd80cd3c0 msgr2=0x7fecd80ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:55.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.123+0000 7fecdeb9d700 1 --2- 172.21.15.60:0/4283376218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecd80cd3c0 0x7fecd80ceaa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fecd8099b90 tx=0x7fecc80091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.123+0000 7fecdeb9d700 1 -- 172.21.15.60:0/4283376218 shutdown_connections 2023-10-06T04:28:55.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.123+0000 7fecdeb9d700 1 --2- 172.21.15.60:0/4283376218 >> v2:172.21.15.135:3300/0 conn(0x7fecd80b29f0 0x7fecd80cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.123+0000 7fecdeb9d700 1 --2- 172.21.15.60:0/4283376218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecd80cd3c0 0x7fecd80ceaa0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.123+0000 7fecdeb9d700 1 -- 172.21.15.60:0/4283376218 >> 172.21.15.60:0/4283376218 conn(0x7fecd8099520 msgr2=0x7fecd806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:55.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.123+0000 7fecdeb9d700 1 -- 172.21.15.60:0/4283376218 shutdown_connections 2023-10-06T04:28:55.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.123+0000 7fecdeb9d700 1 -- 172.21.15.60:0/4283376218 wait complete. 2023-10-06T04:28:55.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.124+0000 7fecdeb9d700 1 Processor -- start 2023-10-06T04:28:55.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.124+0000 7fecdeb9d700 1 -- start start 2023-10-06T04:28:55.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.125+0000 7fecdeb9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecd80b2620 0x7fecd815c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:55.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.125+0000 7fecdeb9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecd80b29f0 0x7fecd8147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:55.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.125+0000 7fecdeb9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fecd80cd3c0 0x7fecd8155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:55.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.125+0000 7fecdeb9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd815c140 con 0x7fecd80b29f0 2023-10-06T04:28:55.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.125+0000 7fecdeb9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd815b530 con 0x7fecd80b2620 2023-10-06T04:28:55.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.125+0000 7fecdeb9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd815b810 con 0x7fecd80cd3c0 2023-10-06T04:28:55.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.125+0000 7fecdd39a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecd80b29f0 0x7fecd8147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:55.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.126+0000 7fecdd39a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecd80b29f0 0x7fecd8147c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44632/0 (socket says 172.21.15.60:44632) 2023-10-06T04:28:55.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.126+0000 7fecdd39a700 1 -- 172.21.15.60:0/1249543681 learned_addr learned my addr 172.21.15.60:0/1249543681 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:55.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.126+0000 7fecde39c700 1 --2- 172.21.15.60:0/1249543681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fecd80cd3c0 0x7fecd8155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:55.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.126+0000 7fecddb9b700 1 --2- 172.21.15.60:0/1249543681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecd80b2620 0x7fecd815c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:55.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.126+0000 7fecdd39a700 1 -- 172.21.15.60:0/1249543681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fecd80cd3c0 msgr2=0x7fecd8155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:55.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.126+0000 7fecdd39a700 1 --2- 172.21.15.60:0/1249543681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fecd80cd3c0 0x7fecd8155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.126+0000 7fecdd39a700 1 -- 172.21.15.60:0/1249543681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecd80b2620 msgr2=0x7fecd815c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:55.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.126+0000 7fecdd39a700 1 --2- 172.21.15.60:0/1249543681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecd80b2620 0x7fecd815c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.126+0000 7fecdd39a700 1 -- 172.21.15.60:0/1249543681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc8009420 con 0x7fecd80b29f0 2023-10-06T04:28:55.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.126+0000 7fecdd39a700 1 --2- 172.21.15.60:0/1249543681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecd80b29f0 0x7fecd8147c60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fecc8013000 tx=0x7fecc8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:55.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.126+0000 7feccdffb700 1 -- 172.21.15.60:0/1249543681 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc8000d10 con 0x7fecd80b29f0 2023-10-06T04:28:55.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.127+0000 7feccdffb700 1 -- 172.21.15.60:0/1249543681 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc800bb90 con 0x7fecd80b29f0 2023-10-06T04:28:55.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.127+0000 7feccdffb700 1 -- 172.21.15.60:0/1249543681 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc8011670 con 0x7fecd80b29f0 2023-10-06T04:28:55.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.127+0000 7fecdeb9d700 1 -- 172.21.15.60:0/1249543681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd815baf0 con 0x7fecd80b29f0 2023-10-06T04:28:55.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.127+0000 7fecdeb9d700 1 -- 172.21.15.60:0/1249543681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd81481a0 con 0x7fecd80b29f0 2023-10-06T04:28:55.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.128+0000 7fecdeb9d700 1 -- 172.21.15.60:0/1249543681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd815bf90 con 0x7fecd80b29f0 2023-10-06T04:28:55.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.128+0000 7feccdffb700 1 -- 172.21.15.60:0/1249543681 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fecc8011aa0 con 0x7fecd80b29f0 2023-10-06T04:28:55.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.129+0000 7feccdffb700 1 --2- 172.21.15.60:0/1249543681 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fecbc066f60 0x7fecbc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:55.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.129+0000 7feccdffb700 1 -- 172.21.15.60:0/1249543681 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fecc8086300 con 0x7fecd80b29f0 2023-10-06T04:28:55.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.129+0000 7fecddb9b700 1 --2- 172.21.15.60:0/1249543681 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fecbc066f60 0x7fecbc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:55.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.130+0000 7fecddb9b700 1 --2- 172.21.15.60:0/1249543681 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fecbc066f60 0x7fecbc069410 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fecd40029c0 tx=0x7fecd4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:55.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.134+0000 7feccdffb700 1 -- 172.21.15.60:0/1249543681 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fecc8053040 con 0x7fecd80b29f0 2023-10-06T04:28:55.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.337+0000 7fecdeb9d700 1 -- 172.21.15.60:0/1249543681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fecd805f230 con 0x7fecd80b29f0 2023-10-06T04:28:55.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.337+0000 7feccdffb700 1 -- 172.21.15.60:0/1249543681 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fecc8056660 con 0x7fecd80b29f0 2023-10-06T04:28:55.340 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-06T04:28:55.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.340+0000 7fecdeb9d700 1 -- 172.21.15.60:0/1249543681 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fecbc066f60 msgr2=0x7fecbc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:55.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.340+0000 7fecdeb9d700 1 --2- 172.21.15.60:0/1249543681 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fecbc066f60 0x7fecbc069410 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fecd40029c0 tx=0x7fecd4009040 comp rx=0 tx=0).stop 2023-10-06T04:28:55.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.340+0000 7fecdeb9d700 1 -- 172.21.15.60:0/1249543681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecd80b29f0 msgr2=0x7fecd8147c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:55.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.340+0000 7fecdeb9d700 1 --2- 172.21.15.60:0/1249543681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecd80b29f0 0x7fecd8147c60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fecc8013000 tx=0x7fecc8017000 comp rx=0 tx=0).stop 2023-10-06T04:28:55.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.340+0000 7fecdeb9d700 1 -- 172.21.15.60:0/1249543681 shutdown_connections 2023-10-06T04:28:55.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.340+0000 7fecdeb9d700 1 --2- 172.21.15.60:0/1249543681 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fecbc066f60 0x7fecbc069410 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.340+0000 7fecdeb9d700 1 --2- 172.21.15.60:0/1249543681 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fecd80cd3c0 0x7fecd8155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.340+0000 7fecdeb9d700 1 --2- 172.21.15.60:0/1249543681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecd80b2620 0x7fecd815c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.340+0000 7fecdeb9d700 1 --2- 172.21.15.60:0/1249543681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecd80b29f0 0x7fecd8147c60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.340+0000 7fecdeb9d700 1 -- 172.21.15.60:0/1249543681 >> 172.21.15.60:0/1249543681 conn(0x7fecd8099520 msgr2=0x7fecd80ce480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:55.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.340+0000 7fecdeb9d700 1 -- 172.21.15.60:0/1249543681 shutdown_connections 2023-10-06T04:28:55.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.340+0000 7fecdeb9d700 1 -- 172.21.15.60:0/1249543681 wait complete. 2023-10-06T04:28:55.360 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:28:55.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.549+0000 7f1cdc99d700 1 Processor -- start 2023-10-06T04:28:55.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.549+0000 7f1cdc99d700 1 -- start start 2023-10-06T04:28:55.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.550+0000 7f1cdc99d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1cd80b2620 0x7f1cd80cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:55.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.550+0000 7f1cdc99d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1cd80b29f0 0x7f1cd80cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:55.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.550+0000 7f1cdc99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cd80ceaa0 0x7f1cd80cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:55.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.550+0000 7f1cdc99d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd80cc970 con 0x7f1cd80b29f0 2023-10-06T04:28:55.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.550+0000 7f1cdc99d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd80cf480 con 0x7f1cd80b2620 2023-10-06T04:28:55.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.550+0000 7f1cdc99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd80cbd60 con 0x7f1cd80ceaa0 2023-10-06T04:28:55.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.550+0000 7f1cd6ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1cd80b29f0 0x7f1cd80cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:55.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.551+0000 7f1cd6ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1cd80b29f0 0x7f1cd80cd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44642/0 (socket says 172.21.15.60:44642) 2023-10-06T04:28:55.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.551+0000 7f1cd6ffd700 1 -- 172.21.15.60:0/2626027568 learned_addr learned my addr 172.21.15.60:0/2626027568 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:55.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.551+0000 7f1cd7fff700 1 --2- 172.21.15.60:0/2626027568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cd80ceaa0 0x7f1cd80cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:55.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.551+0000 7f1cd77fe700 1 --2- 172.21.15.60:0/2626027568 >> v2:172.21.15.135:3300/0 conn(0x7f1cd80b2620 0x7f1cd80cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:55.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.551+0000 7f1cd6ffd700 1 -- 172.21.15.60:0/2626027568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cd80ceaa0 msgr2=0x7f1cd80cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:55.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.551+0000 7f1cd6ffd700 1 --2- 172.21.15.60:0/2626027568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cd80ceaa0 0x7f1cd80cef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.551+0000 7f1cd6ffd700 1 -- 172.21.15.60:0/2626027568 >> v2:172.21.15.135:3300/0 conn(0x7f1cd80b2620 msgr2=0x7f1cd80cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:55.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.551+0000 7f1cd6ffd700 1 --2- 172.21.15.60:0/2626027568 >> v2:172.21.15.135:3300/0 conn(0x7f1cd80b2620 0x7f1cd80cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.551+0000 7f1cd6ffd700 1 -- 172.21.15.60:0/2626027568 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd80cc040 con 0x7f1cd80b29f0 2023-10-06T04:28:55.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.551+0000 7f1cd6ffd700 1 --2- 172.21.15.60:0/2626027568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cd80b29f0 0x7f1cd80cd1f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80894c0 tx=0x7f1ccc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed6678e40fa5993 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.551+0000 7f1cd67fc700 1 -- 172.21.15.60:0/2626027568 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc00b860 con 0x7f1cd80b29f0 2023-10-06T04:28:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.552+0000 7f1cd67fc700 1 -- 172.21.15.60:0/2626027568 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ccc00b9c0 con 0x7f1cd80b29f0 2023-10-06T04:28:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.552+0000 7f1cd67fc700 1 -- 172.21.15.60:0/2626027568 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc00bd60 con 0x7f1cd80b29f0 2023-10-06T04:28:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.552+0000 7f1cdc99d700 1 -- 172.21.15.60:0/2626027568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cd80b29f0 msgr2=0x7f1cd80cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.552+0000 7f1cdc99d700 1 --2- 172.21.15.60:0/2626027568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cd80b29f0 0x7f1cd80cd1f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80894c0 tx=0x7f1ccc009250 comp rx=0 tx=0).stop 2023-10-06T04:28:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.552+0000 7f1cdc99d700 1 -- 172.21.15.60:0/2626027568 shutdown_connections 2023-10-06T04:28:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.552+0000 7f1cdc99d700 1 --2- 172.21.15.60:0/2626027568 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cd80ceaa0 0x7f1cd80cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.552+0000 7f1cdc99d700 1 --2- 172.21.15.60:0/2626027568 >> v2:172.21.15.135:3300/0 conn(0x7f1cd80b2620 0x7f1cd80cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.552+0000 7f1cdc99d700 1 --2- 172.21.15.60:0/2626027568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cd80b29f0 0x7f1cd80cd1f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.552+0000 7f1cdc99d700 1 -- 172.21.15.60:0/2626027568 >> 172.21.15.60:0/2626027568 conn(0x7f1cd8099520 msgr2=0x7f1cd806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.552+0000 7f1cdc99d700 1 -- 172.21.15.60:0/2626027568 shutdown_connections 2023-10-06T04:28:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.552+0000 7f1cdc99d700 1 -- 172.21.15.60:0/2626027568 wait complete. 2023-10-06T04:28:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.554+0000 7f1cdc99d700 1 Processor -- start 2023-10-06T04:28:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.554+0000 7f1cdc99d700 1 -- start start 2023-10-06T04:28:55.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.555+0000 7f1cdc99d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cd80b2620 0x7f1cd8158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:55.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.555+0000 7f1cdc99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cd80b29f0 0x7f1cd809c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:55.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.555+0000 7f1cdc99d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cd80ceaa0 0x7f1cd809b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:55.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.555+0000 7f1cdc99d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd809ac40 con 0x7f1cd80ceaa0 2023-10-06T04:28:55.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.555+0000 7f1cdc99d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd815cb10 con 0x7f1cd80b2620 2023-10-06T04:28:55.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.555+0000 7f1cdc99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd809a030 con 0x7f1cd80b29f0 2023-10-06T04:28:55.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.555+0000 7f1cd7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cd80ceaa0 0x7f1cd809b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:55.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.555+0000 7f1cd7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cd80ceaa0 0x7f1cd809b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44658/0 (socket says 172.21.15.60:44658) 2023-10-06T04:28:55.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.555+0000 7f1cd7fff700 1 -- 172.21.15.60:0/2839923155 learned_addr learned my addr 172.21.15.60:0/2839923155 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:55.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.555+0000 7f1cd6ffd700 1 --2- 172.21.15.60:0/2839923155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cd80b29f0 0x7f1cd809c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:55.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.555+0000 7f1cd77fe700 1 --2- 172.21.15.60:0/2839923155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cd80b2620 0x7f1cd8158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:55.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.555+0000 7f1cd7fff700 1 -- 172.21.15.60:0/2839923155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cd80b29f0 msgr2=0x7f1cd809c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:55.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.555+0000 7f1cd7fff700 1 --2- 172.21.15.60:0/2839923155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cd80b29f0 0x7f1cd809c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.555+0000 7f1cd7fff700 1 -- 172.21.15.60:0/2839923155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cd80b2620 msgr2=0x7f1cd8158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:55.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.555+0000 7f1cd7fff700 1 --2- 172.21.15.60:0/2839923155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cd80b2620 0x7f1cd8158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.555+0000 7f1cd7fff700 1 -- 172.21.15.60:0/2839923155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc0094f0 con 0x7f1cd80ceaa0 2023-10-06T04:28:55.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.556+0000 7f1cd7fff700 1 --2- 172.21.15.60:0/2839923155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cd80ceaa0 0x7f1cd809b0d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009fa0 tx=0x7f1cd0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:55.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.556+0000 7f1cbf7fe700 1 -- 172.21.15.60:0/2839923155 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd000ebc0 con 0x7f1cd80ceaa0 2023-10-06T04:28:55.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.556+0000 7f1cbf7fe700 1 -- 172.21.15.60:0/2839923155 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd000ed20 con 0x7f1cd80ceaa0 2023-10-06T04:28:55.560 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.556+0000 7f1cbf7fe700 1 -- 172.21.15.60:0/2839923155 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0014670 con 0x7f1cd80ceaa0 2023-10-06T04:28:55.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.556+0000 7f1cdc99d700 1 -- 172.21.15.60:0/2839923155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd809a310 con 0x7f1cd80ceaa0 2023-10-06T04:28:55.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.556+0000 7f1cdc99d700 1 -- 172.21.15.60:0/2839923155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd809a8d0 con 0x7f1cd80ceaa0 2023-10-06T04:28:55.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.557+0000 7f1cdc99d700 1 -- 172.21.15.60:0/2839923155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd809adb0 con 0x7f1cd80ceaa0 2023-10-06T04:28:55.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.558+0000 7f1cbf7fe700 1 -- 172.21.15.60:0/2839923155 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1cd00149e0 con 0x7f1cd80ceaa0 2023-10-06T04:28:55.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.559+0000 7f1cbf7fe700 1 --2- 172.21.15.60:0/2839923155 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1cc4066f30 0x7f1cc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:55.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.559+0000 7f1cbf7fe700 1 -- 172.21.15.60:0/2839923155 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f1cd00850c0 con 0x7f1cd80ceaa0 2023-10-06T04:28:55.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.559+0000 7f1cd77fe700 1 --2- 172.21.15.60:0/2839923155 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1cc4066f30 0x7f1cc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:55.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.560+0000 7f1cd77fe700 1 --2- 172.21.15.60:0/2839923155 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1cc4066f30 0x7f1cc40693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80061f0 tx=0x7f1cc8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:55.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.563+0000 7f1cbf7fe700 1 -- 172.21.15.60:0/2839923155 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cd0051e00 con 0x7f1cd80ceaa0 2023-10-06T04:28:55.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.763+0000 7f1cdc99d700 1 -- 172.21.15.60:0/2839923155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1cd805f230 con 0x7f1cd80ceaa0 2023-10-06T04:28:55.766 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.763+0000 7f1cbf7fe700 1 -- 172.21.15.60:0/2839923155 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1cd0055420 con 0x7f1cd80ceaa0 2023-10-06T04:28:55.766 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-06T04:28:55.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.766+0000 7f1cdc99d700 1 -- 172.21.15.60:0/2839923155 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1cc4066f30 msgr2=0x7f1cc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:55.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.766+0000 7f1cdc99d700 1 --2- 172.21.15.60:0/2839923155 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1cc4066f30 0x7f1cc40693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80061f0 tx=0x7f1cc8008040 comp rx=0 tx=0).stop 2023-10-06T04:28:55.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.766+0000 7f1cdc99d700 1 -- 172.21.15.60:0/2839923155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cd80ceaa0 msgr2=0x7f1cd809b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:55.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.766+0000 7f1cdc99d700 1 --2- 172.21.15.60:0/2839923155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cd80ceaa0 0x7f1cd809b0d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009fa0 tx=0x7f1cd0009900 comp rx=0 tx=0).stop 2023-10-06T04:28:55.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.766+0000 7f1cdc99d700 1 -- 172.21.15.60:0/2839923155 shutdown_connections 2023-10-06T04:28:55.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.766+0000 7f1cdc99d700 1 --2- 172.21.15.60:0/2839923155 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1cc4066f30 0x7f1cc40693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.766+0000 7f1cdc99d700 1 --2- 172.21.15.60:0/2839923155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cd80ceaa0 0x7f1cd809b0d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.766+0000 7f1cdc99d700 1 --2- 172.21.15.60:0/2839923155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cd80b2620 0x7f1cd8158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.766+0000 7f1cdc99d700 1 --2- 172.21.15.60:0/2839923155 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1cd80b29f0 0x7f1cd809c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.766+0000 7f1cdc99d700 1 -- 172.21.15.60:0/2839923155 >> 172.21.15.60:0/2839923155 conn(0x7f1cd8099520 msgr2=0x7f1cd80b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:55.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.766+0000 7f1cdc99d700 1 -- 172.21.15.60:0/2839923155 shutdown_connections 2023-10-06T04:28:55.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.766+0000 7f1cdc99d700 1 -- 172.21.15.60:0/2839923155 wait complete. 2023-10-06T04:28:55.787 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:28:55.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.971+0000 7f2b6c9fe700 1 Processor -- start 2023-10-06T04:28:55.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.971+0000 7f2b6c9fe700 1 -- start start 2023-10-06T04:28:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.973+0000 7f2b6c9fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2b68159600 0x7f2b680abc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.973+0000 7f2b6c9fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2b680ac1b0 0x7f2b680675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.973+0000 7f2b6c9fe700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6806a4e0 con 0x7f2b68159230 2023-10-06T04:28:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.973+0000 7f2b6c9fe700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b680ac6a0 con 0x7f2b68159600 2023-10-06T04:28:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.973+0000 7f2b6c9fe700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b6806b9b0 con 0x7f2b680ac1b0 2023-10-06T04:28:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.973+0000 7f2b6659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2b68159600 0x7f2b680abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:55.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.973+0000 7f2b6659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2b68159600 0x7f2b680abc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44672/0 (socket says 172.21.15.60:44672) 2023-10-06T04:28:55.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.973+0000 7f2b6659c700 1 -- 172.21.15.60:0/1911759688 learned_addr learned my addr 172.21.15.60:0/1911759688 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:55.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.973+0000 7f2b6759e700 1 --2- 172.21.15.60:0/1911759688 >> v2:172.21.15.135:3300/0 conn(0x7f2b680ac1b0 0x7f2b680675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:55.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.973+0000 7f2b6659c700 1 -- 172.21.15.60:0/1911759688 >> v2:172.21.15.135:3300/0 conn(0x7f2b680ac1b0 msgr2=0x7f2b680675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:55.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.973+0000 7f2b6659c700 1 --2- 172.21.15.60:0/1911759688 >> v2:172.21.15.135:3300/0 conn(0x7f2b680ac1b0 0x7f2b680675b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.973+0000 7f2b6659c700 1 -- 172.21.15.60:0/1911759688 >> v1:172.21.15.135:6789/0 conn(0x7f2b68159230 legacy=0x7f2b6806b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:55.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.973+0000 7f2b6659c700 1 -- 172.21.15.60:0/1911759688 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6806a7c0 con 0x7f2b68159600 2023-10-06T04:28:55.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.974+0000 7f2b6659c700 1 --2- 172.21.15.60:0/1911759688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b68159600 0x7f2b680abc70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2b680cc2b0 tx=0x7f2b5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0de0b830016c39a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:55.977 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.974+0000 7f2b65d9b700 1 -- 172.21.15.60:0/1911759688 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c009ea0 con 0x7f2b68159600 2023-10-06T04:28:55.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.974+0000 7f2b65d9b700 1 -- 172.21.15.60:0/1911759688 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5c00b820 con 0x7f2b68159600 2023-10-06T04:28:55.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.974+0000 7f2b65d9b700 1 -- 172.21.15.60:0/1911759688 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c00bbc0 con 0x7f2b68159600 2023-10-06T04:28:55.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.974+0000 7f2b6c9fe700 1 -- 172.21.15.60:0/1911759688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b68159600 msgr2=0x7f2b680abc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:55.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.974+0000 7f2b6c9fe700 1 --2- 172.21.15.60:0/1911759688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b68159600 0x7f2b680abc70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2b680cc2b0 tx=0x7f2b5c009250 comp rx=0 tx=0).stop 2023-10-06T04:28:55.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.975+0000 7f2b6c9fe700 1 -- 172.21.15.60:0/1911759688 shutdown_connections 2023-10-06T04:28:55.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.975+0000 7f2b6c9fe700 1 --2- 172.21.15.60:0/1911759688 >> v2:172.21.15.135:3300/0 conn(0x7f2b680ac1b0 0x7f2b680675b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.975+0000 7f2b6c9fe700 1 --2- 172.21.15.60:0/1911759688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b68159600 0x7f2b680abc70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.975+0000 7f2b6c9fe700 1 -- 172.21.15.60:0/1911759688 >> 172.21.15.60:0/1911759688 conn(0x7f2b68069130 msgr2=0x7f2b680ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:55.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.975+0000 7f2b6c9fe700 1 -- 172.21.15.60:0/1911759688 shutdown_connections 2023-10-06T04:28:55.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.975+0000 7f2b6c9fe700 1 -- 172.21.15.60:0/1911759688 wait complete. 2023-10-06T04:28:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.976+0000 7f2b6c9fe700 1 Processor -- start 2023-10-06T04:28:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.976+0000 7f2b6c9fe700 1 -- start start 2023-10-06T04:28:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.977+0000 7f2b6c9fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b680ac1b0 0x7f2b68145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.977+0000 7f2b6c9fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b68159230 0x7f2b680af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:55.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.977+0000 7f2b6c9fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b68159600 0x7f2b680ad170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:55.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.977+0000 7f2b6c9fe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b681460d0 con 0x7f2b68159600 2023-10-06T04:28:55.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.977+0000 7f2b6c9fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b680ab240 con 0x7f2b680ac1b0 2023-10-06T04:28:55.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.977+0000 7f2b6c9fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b68153490 con 0x7f2b68159230 2023-10-06T04:28:55.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.977+0000 7f2b6759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b68159600 0x7f2b680ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:55.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.977+0000 7f2b6759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b68159600 0x7f2b680ad170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44678/0 (socket says 172.21.15.60:44678) 2023-10-06T04:28:55.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.977+0000 7f2b6759e700 1 -- 172.21.15.60:0/1597513591 learned_addr learned my addr 172.21.15.60:0/1597513591 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:55.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.978+0000 7f2b66d9d700 1 --2- 172.21.15.60:0/1597513591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b680ac1b0 0x7f2b68145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:55.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.978+0000 7f2b6659c700 1 --2- 172.21.15.60:0/1597513591 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b68159230 0x7f2b680af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:55.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.978+0000 7f2b6759e700 1 -- 172.21.15.60:0/1597513591 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b68159230 msgr2=0x7f2b680af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:55.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.978+0000 7f2b6759e700 1 --2- 172.21.15.60:0/1597513591 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b68159230 0x7f2b680af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.978+0000 7f2b6759e700 1 -- 172.21.15.60:0/1597513591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b680ac1b0 msgr2=0x7f2b68145b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:55.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.978+0000 7f2b6759e700 1 --2- 172.21.15.60:0/1597513591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b680ac1b0 0x7f2b68145b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:55.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.978+0000 7f2b6759e700 1 -- 172.21.15.60:0/1597513591 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c0094f0 con 0x7f2b68159600 2023-10-06T04:28:55.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.978+0000 7f2b6759e700 1 --2- 172.21.15.60:0/1597513591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b68159600 0x7f2b680ad170 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2b60009f20 tx=0x7f2b6000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:55.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.978+0000 7f2b4effd700 1 -- 172.21.15.60:0/1597513591 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6000cc80 con 0x7f2b68159600 2023-10-06T04:28:55.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.978+0000 7f2b4effd700 1 -- 172.21.15.60:0/1597513591 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6000f040 con 0x7f2b68159600 2023-10-06T04:28:55.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.978+0000 7f2b4effd700 1 -- 172.21.15.60:0/1597513591 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b60014480 con 0x7f2b68159600 2023-10-06T04:28:55.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.978+0000 7f2b6c9fe700 1 -- 172.21.15.60:0/1597513591 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6816a670 con 0x7f2b68159600 2023-10-06T04:28:55.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.979+0000 7f2b6c9fe700 1 -- 172.21.15.60:0/1597513591 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b680aabf0 con 0x7f2b68159600 2023-10-06T04:28:55.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.980+0000 7f2b6c9fe700 1 -- 172.21.15.60:0/1597513591 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b680ab3d0 con 0x7f2b68159600 2023-10-06T04:28:55.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.980+0000 7f2b4effd700 1 -- 172.21.15.60:0/1597513591 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b60014850 con 0x7f2b68159600 2023-10-06T04:28:55.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.981+0000 7f2b4effd700 1 --2- 172.21.15.60:0/1597513591 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2b54066f30 0x7f2b540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:55.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.982+0000 7f2b4effd700 1 -- 172.21.15.60:0/1597513591 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f2b60085480 con 0x7f2b68159600 2023-10-06T04:28:55.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.982+0000 7f2b66d9d700 1 --2- 172.21.15.60:0/1597513591 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2b54066f30 0x7f2b540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:55.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.982+0000 7f2b66d9d700 1 --2- 172.21.15.60:0/1597513591 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2b54066f30 0x7f2b540693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2b681569b0 tx=0x7f2b58009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:55.987 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:55.985+0000 7f2b4effd700 1 -- 172.21.15.60:0/1597513591 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b60052260 con 0x7f2b68159600 2023-10-06T04:28:56.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.189+0000 7f2b6c9fe700 1 -- 172.21.15.60:0/1597513591 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b6805f230 con 0x7f2b68159600 2023-10-06T04:28:56.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.190+0000 7f2b4effd700 1 -- 172.21.15.60:0/1597513591 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18802 (secure 0 0 0) 0x7f2b60055880 con 0x7f2b68159600 2023-10-06T04:28:56.192 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:28:56.192 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":27,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:28:54.367692+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:28:04.355358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:28:05.208550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:28:08.791979+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.1a","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:28:56.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.192+0000 7f2b6c9fe700 1 -- 172.21.15.60:0/1597513591 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2b54066f30 msgr2=0x7f2b540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:56.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.192+0000 7f2b6c9fe700 1 --2- 172.21.15.60:0/1597513591 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2b54066f30 0x7f2b540693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2b681569b0 tx=0x7f2b58009040 comp rx=0 tx=0).stop 2023-10-06T04:28:56.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.192+0000 7f2b6c9fe700 1 -- 172.21.15.60:0/1597513591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b68159600 msgr2=0x7f2b680ad170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:56.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.192+0000 7f2b6c9fe700 1 --2- 172.21.15.60:0/1597513591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b68159600 0x7f2b680ad170 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2b60009f20 tx=0x7f2b6000b040 comp rx=0 tx=0).stop 2023-10-06T04:28:56.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.192+0000 7f2b6c9fe700 1 -- 172.21.15.60:0/1597513591 shutdown_connections 2023-10-06T04:28:56.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.192+0000 7f2b6c9fe700 1 --2- 172.21.15.60:0/1597513591 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2b54066f30 0x7f2b540693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:56.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.192+0000 7f2b6c9fe700 1 --2- 172.21.15.60:0/1597513591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b68159600 0x7f2b680ad170 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:56.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.192+0000 7f2b6c9fe700 1 --2- 172.21.15.60:0/1597513591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b680ac1b0 0x7f2b68145b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:56.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.192+0000 7f2b6c9fe700 1 --2- 172.21.15.60:0/1597513591 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b68159230 0x7f2b680af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:56.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.192+0000 7f2b6c9fe700 1 -- 172.21.15.60:0/1597513591 >> 172.21.15.60:0/1597513591 conn(0x7f2b68069130 msgr2=0x7f2b680c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:56.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.193+0000 7f2b6c9fe700 1 -- 172.21.15.60:0/1597513591 shutdown_connections 2023-10-06T04:28:56.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.193+0000 7f2b6c9fe700 1 -- 172.21.15.60:0/1597513591 wait complete. 2023-10-06T04:28:56.213 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:27:58.899938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:27:59.373527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:28:04.355358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:28:05.208550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:28:08.791979+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:28:56.213 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:28:56.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.402+0000 7f3769d9d700 1 Processor -- start 2023-10-06T04:28:56.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.402+0000 7f3769d9d700 1 -- start start 2023-10-06T04:28:56.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.403+0000 7f3769d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37640cd3c0 0x7f37640ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:56.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.403+0000 7f3769d9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37640cc970 con 0x7f37640b2620 2023-10-06T04:28:56.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.403+0000 7f3769d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37640cbd60 con 0x7f37640b29f0 2023-10-06T04:28:56.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.403+0000 7f3769d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37640cc040 con 0x7f37640cd3c0 2023-10-06T04:28:56.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.404+0000 7f3768d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f37640b2620 0x7f37640cccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34802/0 (socket says 172.21.15.60:34802) 2023-10-06T04:28:56.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.404+0000 7f3768d9b700 1 -- 172.21.15.60:0/4085787399 learned_addr learned my addr 172.21.15.60:0/4085787399 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:56.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.404+0000 7f3763fff700 1 --2- 172.21.15.60:0/4085787399 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37640cd3c0 0x7f37640ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:56.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.404+0000 7f37637fe700 1 -- 172.21.15.60:0/4085787399 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326900244 0 0) 0x7f37640cc970 con 0x7f37640b2620 2023-10-06T04:28:56.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.404+0000 7f37637fe700 1 -- 172.21.15.60:0/4085787399 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3754003570 con 0x7f37640b2620 2023-10-06T04:28:56.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.404+0000 7f37637fe700 1 -- 172.21.15.60:0/4085787399 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2293061956 0 0) 0x7f3754003570 con 0x7f37640b2620 2023-10-06T04:28:56.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.404+0000 7f37637fe700 1 -- 172.21.15.60:0/4085787399 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37640cd3c0 msgr2=0x7f37640ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:56.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.404+0000 7f37637fe700 1 --2- 172.21.15.60:0/4085787399 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37640cd3c0 0x7f37640ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:56.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.404+0000 7f37637fe700 1 -- 172.21.15.60:0/4085787399 >> v1:172.21.15.135:6789/0 conn(0x7f37640b29f0 legacy=0x7f37640c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:56.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.404+0000 7f37637fe700 1 -- 172.21.15.60:0/4085787399 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37640cc320 con 0x7f37640b2620 2023-10-06T04:28:56.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.404+0000 7f37637fe700 1 -- 172.21.15.60:0/4085787399 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7f37580015f0 con 0x7f37640b2620 2023-10-06T04:28:56.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.405+0000 7f37637fe700 1 -- 172.21.15.60:0/4085787399 >> v1:172.21.15.60:6789/0 conn(0x7f37640b2620 legacy=0x7f37640cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:56.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.405+0000 7f37637fe700 1 --2- 172.21.15.60:0/4085787399 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37640cd3c0 0x7f3754003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:56.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.405+0000 7f37637fe700 1 --2- 172.21.15.60:0/4085787399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3754003fd0 0x7f3754004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:56.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.405+0000 7f37637fe700 1 --2- 172.21.15.60:0/4085787399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3754004d50 0x7f37540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:56.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.405+0000 7f37637fe700 1 -- 172.21.15.60:0/4085787399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37640cc040 con 0x7f3754004d50 2023-10-06T04:28:56.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.405+0000 7f37637fe700 1 -- 172.21.15.60:0/4085787399 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375400bba0 con 0x7f3754003fd0 2023-10-06T04:28:56.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.405+0000 7f37637fe700 1 -- 172.21.15.60:0/4085787399 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375400bd60 con 0x7f37640cd3c0 2023-10-06T04:28:56.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.405+0000 7f376959c700 1 --2- 172.21.15.60:0/4085787399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3754004d50 0x7f37540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:56.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.405+0000 7f3768d9b700 1 --2- 172.21.15.60:0/4085787399 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37640cd3c0 0x7f3754003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:56.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.405+0000 7f3763fff700 1 --2- 172.21.15.60:0/4085787399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3754003fd0 0x7f3754004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:56.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.405+0000 7f376959c700 1 -- 172.21.15.60:0/4085787399 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37640cd3c0 msgr2=0x7f3754003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:56.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.405+0000 7f376959c700 1 --2- 172.21.15.60:0/4085787399 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f37640cd3c0 0x7f3754003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:56.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.405+0000 7f376959c700 1 -- 172.21.15.60:0/4085787399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3754003fd0 msgr2=0x7f3754004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:56.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.405+0000 7f376959c700 1 --2- 172.21.15.60:0/4085787399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3754003fd0 0x7f3754004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:56.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.405+0000 7f376959c700 1 -- 172.21.15.60:0/4085787399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3754003570 con 0x7f3754004d50 2023-10-06T04:28:56.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.406+0000 7f376959c700 1 --2- 172.21.15.60:0/4085787399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3754004d50 0x7f37540051c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f375c002070 tx=0x7f375c0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1110f2fa9b3cbf11 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:56.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.406+0000 7f37637fe700 1 -- 172.21.15.60:0/4085787399 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c0019e0 con 0x7f3754004d50 2023-10-06T04:28:56.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.406+0000 7f37637fe700 1 -- 172.21.15.60:0/4085787399 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c00c8b0 con 0x7f3754004d50 2023-10-06T04:28:56.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.406+0000 7f37637fe700 1 -- 172.21.15.60:0/4085787399 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c00cc50 con 0x7f3754004d50 2023-10-06T04:28:56.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.406+0000 7f3769d9d700 1 -- 172.21.15.60:0/4085787399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3754004d50 msgr2=0x7f37540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:56.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.406+0000 7f3769d9d700 1 --2- 172.21.15.60:0/4085787399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3754004d50 0x7f37540051c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f375c002070 tx=0x7f375c0016d0 comp rx=0 tx=0).stop 2023-10-06T04:28:56.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.406+0000 7f376959c700 1 -- 172.21.15.60:0/4085787399 reap_dead start 2023-10-06T04:28:56.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.406+0000 7f3769d9d700 1 -- 172.21.15.60:0/4085787399 shutdown_connections 2023-10-06T04:28:56.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.406+0000 7f3769d9d700 1 -- 172.21.15.60:0/4085787399 >> 172.21.15.60:0/4085787399 conn(0x7f3764099520 msgr2=0x7f376406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:56.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.407+0000 7f3769d9d700 1 -- 172.21.15.60:0/4085787399 shutdown_connections 2023-10-06T04:28:56.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.407+0000 7f3769d9d700 1 -- 172.21.15.60:0/4085787399 wait complete. 2023-10-06T04:28:56.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.408+0000 7f3769d9d700 1 Processor -- start 2023-10-06T04:28:56.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.408+0000 7f3769d9d700 1 -- start start 2023-10-06T04:28:56.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.409+0000 7f3769d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3754004d50 0x7f376414ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:56.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.409+0000 7f3769d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f376414f440 0x7f376414c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:56.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.409+0000 7f3769d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f376414cde0 0x7f37640c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:56.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.409+0000 7f3769d9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37640c7380 con 0x7f376414cde0 2023-10-06T04:28:56.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.409+0000 7f3769d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376414d280 con 0x7f3754004d50 2023-10-06T04:28:56.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.409+0000 7f3769d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37640c7590 con 0x7f376414f440 2023-10-06T04:28:56.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.409+0000 7f376959c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f376414cde0 0x7f37640c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:56.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.409+0000 7f376959c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f376414cde0 0x7f37640c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44698/0 (socket says 172.21.15.60:44698) 2023-10-06T04:28:56.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.409+0000 7f376959c700 1 -- 172.21.15.60:0/4240287887 learned_addr learned my addr 172.21.15.60:0/4240287887 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:56.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.409+0000 7f3763fff700 1 --2- 172.21.15.60:0/4240287887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f376414f440 0x7f376414c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:56.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.409+0000 7f3768d9b700 1 --2- 172.21.15.60:0/4240287887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3754004d50 0x7f376414ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:56.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.410+0000 7f376959c700 1 -- 172.21.15.60:0/4240287887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f376414f440 msgr2=0x7f376414c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:56.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.410+0000 7f376959c700 1 --2- 172.21.15.60:0/4240287887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f376414f440 0x7f376414c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:56.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.410+0000 7f376959c700 1 -- 172.21.15.60:0/4240287887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3754004d50 msgr2=0x7f376414ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:56.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.410+0000 7f376959c700 1 --2- 172.21.15.60:0/4240287887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3754004d50 0x7f376414ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:56.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.410+0000 7f376959c700 1 -- 172.21.15.60:0/4240287887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37640c7870 con 0x7f376414cde0 2023-10-06T04:28:56.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.410+0000 7f376959c700 1 --2- 172.21.15.60:0/4240287887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f376414cde0 0x7f37640c8630 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f375400bb70 tx=0x7f375c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:56.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.410+0000 7f3760ff9700 1 -- 172.21.15.60:0/4240287887 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c0019e0 con 0x7f376414cde0 2023-10-06T04:28:56.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.410+0000 7f3760ff9700 1 -- 172.21.15.60:0/4240287887 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c00c6d0 con 0x7f376414cde0 2023-10-06T04:28:56.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.410+0000 7f3769d9d700 1 -- 172.21.15.60:0/4240287887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37640c7b50 con 0x7f376414cde0 2023-10-06T04:28:56.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.410+0000 7f3760ff9700 1 -- 172.21.15.60:0/4240287887 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c01f640 con 0x7f376414cde0 2023-10-06T04:28:56.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.410+0000 7f3769d9d700 1 -- 172.21.15.60:0/4240287887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37640c8110 con 0x7f376414cde0 2023-10-06T04:28:56.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.411+0000 7f3769d9d700 1 -- 172.21.15.60:0/4240287887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37640c8300 con 0x7f376414cde0 2023-10-06T04:28:56.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.412+0000 7f3760ff9700 1 -- 172.21.15.60:0/4240287887 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f375c01fa30 con 0x7f376414cde0 2023-10-06T04:28:56.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.413+0000 7f3760ff9700 1 --2- 172.21.15.60:0/4240287887 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3748066f30 0x7f37480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:56.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.413+0000 7f3760ff9700 1 -- 172.21.15.60:0/4240287887 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f375c086900 con 0x7f376414cde0 2023-10-06T04:28:56.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.413+0000 7f3768d9b700 1 --2- 172.21.15.60:0/4240287887 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3748066f30 0x7f37480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:56.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.414+0000 7f3768d9b700 1 --2- 172.21.15.60:0/4240287887 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3748066f30 0x7f37480693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3758001260 tx=0x7f3758009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:56.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.418+0000 7f3760ff9700 1 -- 172.21.15.60:0/4240287887 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f375c053640 con 0x7f376414cde0 2023-10-06T04:28:56.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.623+0000 7f3769d9d700 1 -- 172.21.15.60:0/4240287887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f376405f230 con 0x7f376414cde0 2023-10-06T04:28:56.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.623+0000 7f3760ff9700 1 -- 172.21.15.60:0/4240287887 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f375c017020 con 0x7f376414cde0 2023-10-06T04:28:56.627 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-10-06T04:28:56.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.625+0000 7f3769d9d700 1 -- 172.21.15.60:0/4240287887 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3748066f30 msgr2=0x7f37480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:56.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.625+0000 7f3769d9d700 1 --2- 172.21.15.60:0/4240287887 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3748066f30 0x7f37480693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3758001260 tx=0x7f3758009040 comp rx=0 tx=0).stop 2023-10-06T04:28:56.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.626+0000 7f3769d9d700 1 -- 172.21.15.60:0/4240287887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f376414cde0 msgr2=0x7f37640c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:56.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.626+0000 7f3769d9d700 1 --2- 172.21.15.60:0/4240287887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f376414cde0 0x7f37640c8630 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f375400bb70 tx=0x7f375c015000 comp rx=0 tx=0).stop 2023-10-06T04:28:56.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.626+0000 7f3769d9d700 1 -- 172.21.15.60:0/4240287887 shutdown_connections 2023-10-06T04:28:56.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.626+0000 7f3769d9d700 1 --2- 172.21.15.60:0/4240287887 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3748066f30 0x7f37480693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:56.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.626+0000 7f3769d9d700 1 --2- 172.21.15.60:0/4240287887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f376414cde0 0x7f37640c8630 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:56.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.626+0000 7f3769d9d700 1 --2- 172.21.15.60:0/4240287887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3754004d50 0x7f376414ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:56.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.626+0000 7f3769d9d700 1 --2- 172.21.15.60:0/4240287887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f376414f440 0x7f376414c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:56.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.626+0000 7f3769d9d700 1 -- 172.21.15.60:0/4240287887 >> 172.21.15.60:0/4240287887 conn(0x7f3764099520 msgr2=0x7f3764068e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:56.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.626+0000 7f3769d9d700 1 -- 172.21.15.60:0/4240287887 shutdown_connections 2023-10-06T04:28:56.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.626+0000 7f3769d9d700 1 -- 172.21.15.60:0/4240287887 wait complete. 2023-10-06T04:28:56.645 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:28:56.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.832+0000 7f818ed9d700 1 Processor -- start 2023-10-06T04:28:56.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.832+0000 7f818ed9d700 1 -- start start 2023-10-06T04:28:56.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.834+0000 7f818ed9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f818806e9f0 0x7f818806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:56.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.834+0000 7f818ed9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8188155db0 0x7f81881561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:56.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.834+0000 7f818ed9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81880ad7f0 con 0x7f81880cb770 2023-10-06T04:28:56.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.834+0000 7f818ed9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8188150320 con 0x7f818806e9f0 2023-10-06T04:28:56.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.834+0000 7f818ed9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818806f3b0 con 0x7f8188155db0 2023-10-06T04:28:56.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.834+0000 7f818dd9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f81880cb770 0x7f8188156f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34814/0 (socket says 172.21.15.60:34814) 2023-10-06T04:28:56.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.834+0000 7f818dd9b700 1 -- 172.21.15.60:0/1354231612 learned_addr learned my addr 172.21.15.60:0/1354231612 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:56.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.834+0000 7f818d59a700 1 --2- 172.21.15.60:0/1354231612 >> v2:172.21.15.60:3300/0 conn(0x7f818806e9f0 0x7f818806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:56.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.834+0000 7f818e59c700 1 --2- 172.21.15.60:0/1354231612 >> v2:172.21.15.135:3300/0 conn(0x7f8188155db0 0x7f81881561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:56.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.835+0000 7f818d59a700 1 -- 172.21.15.60:0/1354231612 >> v2:172.21.15.135:3300/0 conn(0x7f8188155db0 msgr2=0x7f81881561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:56.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.835+0000 7f818d59a700 1 --2- 172.21.15.60:0/1354231612 >> v2:172.21.15.135:3300/0 conn(0x7f8188155db0 0x7f81881561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:56.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.834+0000 7f818cd99700 1 -- 172.21.15.60:0/1354231612 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267021011 0 0) 0x7f81880ad7f0 con 0x7f81880cb770 2023-10-06T04:28:56.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.835+0000 7f818d59a700 1 -- 172.21.15.60:0/1354231612 >> v1:172.21.15.60:6789/0 conn(0x7f81880cb770 legacy=0x7f8188156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:56.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.835+0000 7f818d59a700 1 -- 172.21.15.60:0/1354231612 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8188156b50 con 0x7f818806e9f0 2023-10-06T04:28:56.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.835+0000 7f818e59c700 1 --2- 172.21.15.60:0/1354231612 >> v2:172.21.15.135:3300/0 conn(0x7f8188155db0 0x7f81881561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:56.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.835+0000 7f818d59a700 1 --2- 172.21.15.60:0/1354231612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f818806e9f0 0x7f818806ee70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f817800aac0 tx=0x7f817800a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b16eaf5cf26ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:56.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.835+0000 7f818cd99700 1 -- 172.21.15.60:0/1354231612 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817800c8f0 con 0x7f818806e9f0 2023-10-06T04:28:56.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.835+0000 7f818cd99700 1 -- 172.21.15.60:0/1354231612 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817800ca50 con 0x7f818806e9f0 2023-10-06T04:28:56.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.835+0000 7f818cd99700 1 -- 172.21.15.60:0/1354231612 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817800cdf0 con 0x7f818806e9f0 2023-10-06T04:28:56.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.836+0000 7f818ed9d700 1 -- 172.21.15.60:0/1354231612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f818806e9f0 msgr2=0x7f818806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:56.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.836+0000 7f818ed9d700 1 --2- 172.21.15.60:0/1354231612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f818806e9f0 0x7f818806ee70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f817800aac0 tx=0x7f817800a330 comp rx=0 tx=0).stop 2023-10-06T04:28:56.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.836+0000 7f818ed9d700 1 -- 172.21.15.60:0/1354231612 shutdown_connections 2023-10-06T04:28:56.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.836+0000 7f818ed9d700 1 --2- 172.21.15.60:0/1354231612 >> v2:172.21.15.135:3300/0 conn(0x7f8188155db0 0x7f81881561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:56.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.836+0000 7f818ed9d700 1 --2- 172.21.15.60:0/1354231612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f818806e9f0 0x7f818806ee70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:56.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.836+0000 7f818ed9d700 1 -- 172.21.15.60:0/1354231612 >> 172.21.15.60:0/1354231612 conn(0x7f81880cbed0 msgr2=0x7f81880cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:56.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.836+0000 7f818ed9d700 1 -- 172.21.15.60:0/1354231612 shutdown_connections 2023-10-06T04:28:56.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.836+0000 7f818ed9d700 1 -- 172.21.15.60:0/1354231612 wait complete. 2023-10-06T04:28:56.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.837+0000 7f818ed9d700 1 Processor -- start 2023-10-06T04:28:56.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.837+0000 7f818ed9d700 1 -- start start 2023-10-06T04:28:56.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.838+0000 7f818ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f818806e9f0 0x7f8188138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:56.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.838+0000 7f818ed9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81880cb770 0x7f818806dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:56.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.838+0000 7f818ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8188155db0 0x7f818806e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:56.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.838+0000 7f818ed9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818813c9a0 con 0x7f818806e9f0 2023-10-06T04:28:56.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.838+0000 7f818ed9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818813d0e0 con 0x7f8188155db0 2023-10-06T04:28:56.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.838+0000 7f818ed9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818813c100 con 0x7f81880cb770 2023-10-06T04:28:56.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.839+0000 7f818dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f818806e9f0 0x7f8188138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:56.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.839+0000 7f818dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f818806e9f0 0x7f8188138ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44708/0 (socket says 172.21.15.60:44708) 2023-10-06T04:28:56.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.839+0000 7f818dd9b700 1 -- 172.21.15.60:0/3627293241 learned_addr learned my addr 172.21.15.60:0/3627293241 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:56.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.839+0000 7f818dd9b700 1 -- 172.21.15.60:0/3627293241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81880cb770 msgr2=0x7f818806dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:56.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.839+0000 7f818dd9b700 1 --2- 172.21.15.60:0/3627293241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81880cb770 0x7f818806dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:56.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.839+0000 7f818dd9b700 1 -- 172.21.15.60:0/3627293241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8188155db0 msgr2=0x7f818806e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:56.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.839+0000 7f818dd9b700 1 --2- 172.21.15.60:0/3627293241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8188155db0 0x7f818806e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:56.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.839+0000 7f818dd9b700 1 -- 172.21.15.60:0/3627293241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817800a5d0 con 0x7f818806e9f0 2023-10-06T04:28:56.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.839+0000 7f818dd9b700 1 --2- 172.21.15.60:0/3627293241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f818806e9f0 0x7f8188138ff0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f818400c7e0 tx=0x7f8184007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:56.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.839+0000 7f817dffb700 1 -- 172.21.15.60:0/3627293241 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8184005b30 con 0x7f818806e9f0 2023-10-06T04:28:56.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.839+0000 7f817dffb700 1 -- 172.21.15.60:0/3627293241 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8184005c90 con 0x7f818806e9f0 2023-10-06T04:28:56.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.839+0000 7f818ed9d700 1 -- 172.21.15.60:0/3627293241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818813c3e0 con 0x7f818806e9f0 2023-10-06T04:28:56.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.839+0000 7f817dffb700 1 -- 172.21.15.60:0/3627293241 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8184007300 con 0x7f818806e9f0 2023-10-06T04:28:56.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.840+0000 7f818ed9d700 1 -- 172.21.15.60:0/3627293241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8188139530 con 0x7f818806e9f0 2023-10-06T04:28:56.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.840+0000 7f818ed9d700 1 -- 172.21.15.60:0/3627293241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818813ceb0 con 0x7f818806e9f0 2023-10-06T04:28:56.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.841+0000 7f817dffb700 1 -- 172.21.15.60:0/3627293241 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f818401b400 con 0x7f818806e9f0 2023-10-06T04:28:56.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.842+0000 7f817dffb700 1 --2- 172.21.15.60:0/3627293241 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f816c066f30 0x7f816c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:56.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.842+0000 7f817dffb700 1 -- 172.21.15.60:0/3627293241 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f81840844c0 con 0x7f818806e9f0 2023-10-06T04:28:56.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.843+0000 7f818d59a700 1 --2- 172.21.15.60:0/3627293241 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f816c066f30 0x7f816c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:56.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.843+0000 7f818d59a700 1 --2- 172.21.15.60:0/3627293241 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f816c066f30 0x7f816c0693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8188140020 tx=0x7f8178019000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:56.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:56.846+0000 7f817dffb700 1 -- 172.21.15.60:0/3627293241 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8184051320 con 0x7f818806e9f0 2023-10-06T04:28:57.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.048+0000 7f818ed9d700 1 -- 172.21.15.60:0/3627293241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f818805f230 con 0x7f818806e9f0 2023-10-06T04:28:57.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.049+0000 7f817dffb700 1 -- 172.21.15.60:0/3627293241 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8184054940 con 0x7f818806e9f0 2023-10-06T04:28:57.051 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-06T04:28:57.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.051+0000 7f818ed9d700 1 -- 172.21.15.60:0/3627293241 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f816c066f30 msgr2=0x7f816c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:57.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.051+0000 7f818ed9d700 1 --2- 172.21.15.60:0/3627293241 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f816c066f30 0x7f816c0693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8188140020 tx=0x7f8178019000 comp rx=0 tx=0).stop 2023-10-06T04:28:57.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.051+0000 7f818ed9d700 1 -- 172.21.15.60:0/3627293241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f818806e9f0 msgr2=0x7f8188138ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:57.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.051+0000 7f818ed9d700 1 --2- 172.21.15.60:0/3627293241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f818806e9f0 0x7f8188138ff0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f818400c7e0 tx=0x7f8184007df0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.051+0000 7f818ed9d700 1 -- 172.21.15.60:0/3627293241 shutdown_connections 2023-10-06T04:28:57.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.051+0000 7f818ed9d700 1 --2- 172.21.15.60:0/3627293241 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f816c066f30 0x7f816c0693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.051+0000 7f818ed9d700 1 --2- 172.21.15.60:0/3627293241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f818806e9f0 0x7f8188138ff0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.051+0000 7f818ed9d700 1 --2- 172.21.15.60:0/3627293241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8188155db0 0x7f818806e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.051+0000 7f818ed9d700 1 --2- 172.21.15.60:0/3627293241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f81880cb770 0x7f818806dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.051+0000 7f818ed9d700 1 -- 172.21.15.60:0/3627293241 >> 172.21.15.60:0/3627293241 conn(0x7f81880cbed0 msgr2=0x7f81880694e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:57.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.051+0000 7f818ed9d700 1 -- 172.21.15.60:0/3627293241 shutdown_connections 2023-10-06T04:28:57.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.051+0000 7f818ed9d700 1 -- 172.21.15.60:0/3627293241 wait complete. 2023-10-06T04:28:57.071 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:28:57.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.259+0000 7f95f7fff700 1 Processor -- start 2023-10-06T04:28:57.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.259+0000 7f95f7fff700 1 -- start start 2023-10-06T04:28:57.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.260+0000 7f95f7fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f95f8159c60 0x7f95f80c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:57.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.260+0000 7f95f7fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f80acad0 con 0x7f95f80c8f30 2023-10-06T04:28:57.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.260+0000 7f95f7fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f81564c0 con 0x7f95f81560f0 2023-10-06T04:28:57.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.260+0000 7f95f7fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f815a0e0 con 0x7f95f8159c60 2023-10-06T04:28:57.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.260+0000 7f95f67fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f95f8159c60 0x7f95f80c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:57.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.260+0000 7f95f77fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f95f80c8f30 0x7f95f806e160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34824/0 (socket says 172.21.15.60:34824) 2023-10-06T04:28:57.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.260+0000 7f95f77fe700 1 -- 172.21.15.60:0/2569777256 learned_addr learned my addr 172.21.15.60:0/2569777256 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:57.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.261+0000 7f95f5ffb700 1 -- 172.21.15.60:0/2569777256 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612067335 0 0) 0x7f95f80acad0 con 0x7f95f80c8f30 2023-10-06T04:28:57.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.261+0000 7f95f5ffb700 1 -- 172.21.15.60:0/2569777256 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95e0003570 con 0x7f95f80c8f30 2023-10-06T04:28:57.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.261+0000 7f95f67fc700 1 -- 172.21.15.60:0/2569777256 >> v1:172.21.15.135:6789/0 conn(0x7f95f81560f0 legacy=0x7f95f80ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:57.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.261+0000 7f95f67fc700 1 -- 172.21.15.60:0/2569777256 >> v1:172.21.15.60:6789/0 conn(0x7f95f80c8f30 legacy=0x7f95f806e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:57.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.261+0000 7f95f67fc700 1 -- 172.21.15.60:0/2569777256 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f815a2d0 con 0x7f95f8159c60 2023-10-06T04:28:57.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.261+0000 7f95f67fc700 1 --2- 172.21.15.60:0/2569777256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95f8159c60 0x7f95f80c89f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f95ec0098e0 tx=0x7f95ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7737a65ff075308 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:57.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.261+0000 7f95f5ffb700 1 -- 172.21.15.60:0/2569777256 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec00b6d0 con 0x7f95f8159c60 2023-10-06T04:28:57.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.261+0000 7f95f5ffb700 1 -- 172.21.15.60:0/2569777256 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec00b830 con 0x7f95f8159c60 2023-10-06T04:28:57.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.261+0000 7f95f5ffb700 1 -- 172.21.15.60:0/2569777256 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec00bbd0 con 0x7f95f8159c60 2023-10-06T04:28:57.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.262+0000 7f95f7fff700 1 -- 172.21.15.60:0/2569777256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95f8159c60 msgr2=0x7f95f80c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:57.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.262+0000 7f95f7fff700 1 --2- 172.21.15.60:0/2569777256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95f8159c60 0x7f95f80c89f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f95ec0098e0 tx=0x7f95ec0091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.262+0000 7f95f7fff700 1 -- 172.21.15.60:0/2569777256 shutdown_connections 2023-10-06T04:28:57.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.262+0000 7f95f7fff700 1 --2- 172.21.15.60:0/2569777256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95f8159c60 0x7f95f80c89f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.262+0000 7f95f7fff700 1 -- 172.21.15.60:0/2569777256 >> 172.21.15.60:0/2569777256 conn(0x7f95f80cbed0 msgr2=0x7f95f80cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:57.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.262+0000 7f95f7fff700 1 -- 172.21.15.60:0/2569777256 shutdown_connections 2023-10-06T04:28:57.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.262+0000 7f95f7fff700 1 -- 172.21.15.60:0/2569777256 wait complete. 2023-10-06T04:28:57.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.263+0000 7f95f7fff700 1 Processor -- start 2023-10-06T04:28:57.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.264+0000 7f95f7fff700 1 -- start start 2023-10-06T04:28:57.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.264+0000 7f95f7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95f80c8f30 0x7f95f814e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:57.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.264+0000 7f95f7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95f81560f0 0x7f95f8145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:57.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.264+0000 7f95f7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95f8159c60 0x7f95f814ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:57.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.265+0000 7f95f7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f814dcd0 con 0x7f95f81560f0 2023-10-06T04:28:57.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.265+0000 7f95f7fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f8146070 con 0x7f95f8159c60 2023-10-06T04:28:57.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.265+0000 7f95f7fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f814d200 con 0x7f95f80c8f30 2023-10-06T04:28:57.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.265+0000 7f95f67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95f81560f0 0x7f95f8145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:57.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.265+0000 7f95f67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95f81560f0 0x7f95f8145b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44734/0 (socket says 172.21.15.60:44734) 2023-10-06T04:28:57.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.265+0000 7f95f67fc700 1 -- 172.21.15.60:0/4199869101 learned_addr learned my addr 172.21.15.60:0/4199869101 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:57.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.265+0000 7f95f77fe700 1 --2- 172.21.15.60:0/4199869101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95f8159c60 0x7f95f814ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:57.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.265+0000 7f95f6ffd700 1 --2- 172.21.15.60:0/4199869101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95f80c8f30 0x7f95f814e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:57.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.265+0000 7f95f67fc700 1 -- 172.21.15.60:0/4199869101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95f80c8f30 msgr2=0x7f95f814e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:57.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.265+0000 7f95f67fc700 1 --2- 172.21.15.60:0/4199869101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95f80c8f30 0x7f95f814e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.265+0000 7f95f67fc700 1 -- 172.21.15.60:0/4199869101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95f8159c60 msgr2=0x7f95f814ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:57.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.265+0000 7f95f67fc700 1 --2- 172.21.15.60:0/4199869101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95f8159c60 0x7f95f814ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.265+0000 7f95f67fc700 1 -- 172.21.15.60:0/4199869101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec009420 con 0x7f95f81560f0 2023-10-06T04:28:57.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.265+0000 7f95f77fe700 1 --2- 172.21.15.60:0/4199869101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95f8159c60 0x7f95f814ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:57.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.266+0000 7f95f67fc700 1 --2- 172.21.15.60:0/4199869101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95f81560f0 0x7f95f8145b30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f95f806cdb0 tx=0x7f95ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:57.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.266+0000 7f95deffd700 1 -- 172.21.15.60:0/4199869101 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec00bbb0 con 0x7f95f81560f0 2023-10-06T04:28:57.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.266+0000 7f95deffd700 1 -- 172.21.15.60:0/4199869101 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec011420 con 0x7f95f81560f0 2023-10-06T04:28:57.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.266+0000 7f95deffd700 1 -- 172.21.15.60:0/4199869101 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec0117a0 con 0x7f95f81560f0 2023-10-06T04:28:57.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.266+0000 7f95f7fff700 1 -- 172.21.15.60:0/4199869101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f8157dc0 con 0x7f95f81560f0 2023-10-06T04:28:57.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.266+0000 7f95f7fff700 1 -- 172.21.15.60:0/4199869101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f814d4b0 con 0x7f95f81560f0 2023-10-06T04:28:57.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.267+0000 7f95f7fff700 1 -- 172.21.15.60:0/4199869101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f8157f50 con 0x7f95f81560f0 2023-10-06T04:28:57.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.268+0000 7f95deffd700 1 -- 172.21.15.60:0/4199869101 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f95ec011b90 con 0x7f95f81560f0 2023-10-06T04:28:57.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.270+0000 7f95deffd700 1 --2- 172.21.15.60:0/4199869101 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f95e4066f30 0x7f95e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:57.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.270+0000 7f95deffd700 1 -- 172.21.15.60:0/4199869101 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f95ec086180 con 0x7f95f81560f0 2023-10-06T04:28:57.272 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.270+0000 7f95f6ffd700 1 --2- 172.21.15.60:0/4199869101 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f95e4066f30 0x7f95e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:57.273 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.271+0000 7f95f6ffd700 1 --2- 172.21.15.60:0/4199869101 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f95e4066f30 0x7f95e40693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f95e80037c0 tx=0x7f95e8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:57.276 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.274+0000 7f95deffd700 1 -- 172.21.15.60:0/4199869101 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95ec052ec0 con 0x7f95f81560f0 2023-10-06T04:28:57.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.479+0000 7f95f7fff700 1 -- 172.21.15.60:0/4199869101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f95f805f230 con 0x7f95f81560f0 2023-10-06T04:28:57.482 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.479+0000 7f95deffd700 1 -- 172.21.15.60:0/4199869101 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f95ec0564e0 con 0x7f95f81560f0 2023-10-06T04:28:57.482 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-06T04:28:57.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.482+0000 7f95f7fff700 1 -- 172.21.15.60:0/4199869101 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f95e4066f30 msgr2=0x7f95e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:57.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.482+0000 7f95f7fff700 1 --2- 172.21.15.60:0/4199869101 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f95e4066f30 0x7f95e40693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f95e80037c0 tx=0x7f95e8009040 comp rx=0 tx=0).stop 2023-10-06T04:28:57.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.482+0000 7f95f7fff700 1 -- 172.21.15.60:0/4199869101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95f81560f0 msgr2=0x7f95f8145b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:57.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.482+0000 7f95f7fff700 1 --2- 172.21.15.60:0/4199869101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95f81560f0 0x7f95f8145b30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f95f806cdb0 tx=0x7f95ec017000 comp rx=0 tx=0).stop 2023-10-06T04:28:57.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.482+0000 7f95f7fff700 1 -- 172.21.15.60:0/4199869101 shutdown_connections 2023-10-06T04:28:57.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.482+0000 7f95f7fff700 1 --2- 172.21.15.60:0/4199869101 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f95e4066f30 0x7f95e40693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.482+0000 7f95f7fff700 1 --2- 172.21.15.60:0/4199869101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95f8159c60 0x7f95f814ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.482+0000 7f95f7fff700 1 --2- 172.21.15.60:0/4199869101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f95f80c8f30 0x7f95f814e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.482+0000 7f95f7fff700 1 --2- 172.21.15.60:0/4199869101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95f81560f0 0x7f95f8145b30 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.482+0000 7f95f7fff700 1 -- 172.21.15.60:0/4199869101 >> 172.21.15.60:0/4199869101 conn(0x7f95f80cbed0 msgr2=0x7f95f81507b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:57.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.482+0000 7f95f7fff700 1 -- 172.21.15.60:0/4199869101 shutdown_connections 2023-10-06T04:28:57.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.482+0000 7f95f7fff700 1 -- 172.21.15.60:0/4199869101 wait complete. 2023-10-06T04:28:57.502 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:28:57.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.690+0000 7f017f59e700 1 Processor -- start 2023-10-06T04:28:57.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.690+0000 7f017f59e700 1 -- start start 2023-10-06T04:28:57.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.691+0000 7f017f59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f01800cd3c0 0x7f01800ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:57.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.691+0000 7f017f59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01800cc970 con 0x7f01800b29f0 2023-10-06T04:28:57.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.691+0000 7f017f59e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01800cbd60 con 0x7f01800b2620 2023-10-06T04:28:57.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.691+0000 7f017f59e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01800cc040 con 0x7f01800cd3c0 2023-10-06T04:28:57.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.691+0000 7f017ed9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f01800b29f0 0x7f01800c5350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34826/0 (socket says 172.21.15.60:34826) 2023-10-06T04:28:57.694 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.692+0000 7f017ed9d700 1 -- 172.21.15.60:0/252451267 learned_addr learned my addr 172.21.15.60:0/252451267 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:57.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.692+0000 7f017dd9b700 1 --2- 172.21.15.60:0/252451267 >> v2:172.21.15.135:3300/0 conn(0x7f01800cd3c0 0x7f01800ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:57.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.692+0000 7f017d59a700 1 -- 172.21.15.60:0/252451267 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973131278 0 0) 0x7f01800cc970 con 0x7f01800b29f0 2023-10-06T04:28:57.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.692+0000 7f017d59a700 1 -- 172.21.15.60:0/252451267 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0168003570 con 0x7f01800b29f0 2023-10-06T04:28:57.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.692+0000 7f017d59a700 1 -- 172.21.15.60:0/252451267 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190582739 0 0) 0x7f01800cbd60 con 0x7f01800b2620 2023-10-06T04:28:57.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.692+0000 7f017d59a700 1 -- 172.21.15.60:0/252451267 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01800cc970 con 0x7f01800b2620 2023-10-06T04:28:57.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.692+0000 7f017d59a700 1 -- 172.21.15.60:0/252451267 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1100325185 0 0) 0x7f0168003570 con 0x7f01800b29f0 2023-10-06T04:28:57.697 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.692+0000 7f017d59a700 1 -- 172.21.15.60:0/252451267 >> v2:172.21.15.135:3300/0 conn(0x7f01800cd3c0 msgr2=0x7f01800ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:57.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.692+0000 7f017d59a700 1 --2- 172.21.15.60:0/252451267 >> v2:172.21.15.135:3300/0 conn(0x7f01800cd3c0 0x7f01800ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.692+0000 7f017d59a700 1 -- 172.21.15.60:0/252451267 >> v1:172.21.15.135:6789/0 conn(0x7f01800b2620 legacy=0x7f01800cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:57.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.692+0000 7f017d59a700 1 -- 172.21.15.60:0/252451267 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01800cc320 con 0x7f01800b29f0 2023-10-06T04:28:57.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.692+0000 7f017d59a700 1 -- 172.21.15.60:0/252451267 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7f01780017f0 con 0x7f01800b29f0 2023-10-06T04:28:57.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.692+0000 7f017d59a700 1 -- 172.21.15.60:0/252451267 >> v1:172.21.15.60:6789/0 conn(0x7f01800b29f0 legacy=0x7f01800c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:57.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.692+0000 7f017d59a700 1 --2- 172.21.15.60:0/252451267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0168003c40 0x7f0168004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:57.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.693+0000 7f017d59a700 1 --2- 172.21.15.60:0/252451267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0168004810 0x7f0168004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:57.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.693+0000 7f017d59a700 1 --2- 172.21.15.60:0/252451267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0168005210 0x7f016800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:57.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.693+0000 7f017d59a700 1 -- 172.21.15.60:0/252451267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01800cc040 con 0x7f0168004810 2023-10-06T04:28:57.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.693+0000 7f017d59a700 1 -- 172.21.15.60:0/252451267 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016800c130 con 0x7f0168003c40 2023-10-06T04:28:57.698 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.693+0000 7f017d59a700 1 -- 172.21.15.60:0/252451267 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016800c2c0 con 0x7f0168005210 2023-10-06T04:28:57.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.693+0000 7f017e59c700 1 --2- 172.21.15.60:0/252451267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0168003c40 0x7f0168004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:57.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.693+0000 7f017dd9b700 1 --2- 172.21.15.60:0/252451267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0168004810 0x7f0168004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:57.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.693+0000 7f017ed9d700 1 --2- 172.21.15.60:0/252451267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0168005210 0x7f016800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:57.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.693+0000 7f017dd9b700 1 -- 172.21.15.60:0/252451267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0168005210 msgr2=0x7f016800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:57.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.693+0000 7f017dd9b700 1 --2- 172.21.15.60:0/252451267 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0168005210 0x7f016800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.693+0000 7f017dd9b700 1 -- 172.21.15.60:0/252451267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0168003c40 msgr2=0x7f0168004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:57.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.693+0000 7f017dd9b700 1 --2- 172.21.15.60:0/252451267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0168003c40 0x7f0168004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.699 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.693+0000 7f017dd9b700 1 -- 172.21.15.60:0/252451267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0168003570 con 0x7f0168004810 2023-10-06T04:28:57.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.693+0000 7f017ed9d700 1 -- 172.21.15.60:0/252451267 reap_dead start 2023-10-06T04:28:57.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.694+0000 7f017dd9b700 1 --2- 172.21.15.60:0/252451267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0168004810 0x7f0168004c80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0174009c00 tx=0x7f01740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722eceea756b8ca7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:57.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.694+0000 7f017d59a700 1 -- 172.21.15.60:0/252451267 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01740095b0 con 0x7f0168004810 2023-10-06T04:28:57.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.694+0000 7f017d59a700 1 -- 172.21.15.60:0/252451267 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017400e710 con 0x7f0168004810 2023-10-06T04:28:57.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.694+0000 7f017d59a700 1 -- 172.21.15.60:0/252451267 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017400ead0 con 0x7f0168004810 2023-10-06T04:28:57.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.694+0000 7f017f59e700 1 -- 172.21.15.60:0/252451267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0168004810 msgr2=0x7f0168004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:57.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.694+0000 7f017f59e700 1 --2- 172.21.15.60:0/252451267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0168004810 0x7f0168004c80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0174009c00 tx=0x7f01740091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.694+0000 7f017f59e700 1 -- 172.21.15.60:0/252451267 shutdown_connections 2023-10-06T04:28:57.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.694+0000 7f017f59e700 1 --2- 172.21.15.60:0/252451267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0168004810 0x7f0168004c80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.700 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.694+0000 7f017f59e700 1 -- 172.21.15.60:0/252451267 >> 172.21.15.60:0/252451267 conn(0x7f0180099520 msgr2=0x7f018006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:57.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.695+0000 7f017f59e700 1 -- 172.21.15.60:0/252451267 shutdown_connections 2023-10-06T04:28:57.701 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.695+0000 7f017f59e700 1 -- 172.21.15.60:0/252451267 wait complete. 2023-10-06T04:28:57.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.696+0000 7f017f59e700 1 Processor -- start 2023-10-06T04:28:57.703 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.696+0000 7f017f59e700 1 -- start start 2023-10-06T04:28:57.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.697+0000 7f017f59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0168004810 0x7f01801530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:57.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.697+0000 7f017f59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0180157ac0 0x7f0180158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:57.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.697+0000 7f017f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0180159bc0 0x7f01800b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:57.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.697+0000 7f017f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01801536e0 con 0x7f0180159bc0 2023-10-06T04:28:57.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.697+0000 7f017f59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0180154260 con 0x7f0180157ac0 2023-10-06T04:28:57.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.697+0000 7f017f59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0180153930 con 0x7f0168004810 2023-10-06T04:28:57.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.697+0000 7f017ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0180159bc0 0x7f01800b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:57.704 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.697+0000 7f017ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0180159bc0 0x7f01800b3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44760/0 (socket says 172.21.15.60:44760) 2023-10-06T04:28:57.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.697+0000 7f017ed9d700 1 -- 172.21.15.60:0/872839211 learned_addr learned my addr 172.21.15.60:0/872839211 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:57.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.697+0000 7f017e59c700 1 --2- 172.21.15.60:0/872839211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0168004810 0x7f01801530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:57.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.698+0000 7f017ed9d700 1 -- 172.21.15.60:0/872839211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0168004810 msgr2=0x7f01801530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:57.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.698+0000 7f017ed9d700 1 --2- 172.21.15.60:0/872839211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0168004810 0x7f01801530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.698+0000 7f017ed9d700 1 -- 172.21.15.60:0/872839211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0180157ac0 msgr2=0x7f0180158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:57.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.698+0000 7f017dd9b700 1 --2- 172.21.15.60:0/872839211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0180157ac0 0x7f0180158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:57.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.698+0000 7f017ed9d700 1 --2- 172.21.15.60:0/872839211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0180157ac0 0x7f0180158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.698+0000 7f017ed9d700 1 -- 172.21.15.60:0/872839211 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0180153c10 con 0x7f0180159bc0 2023-10-06T04:28:57.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.698+0000 7f017dd9b700 1 --2- 172.21.15.60:0/872839211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0180157ac0 0x7f0180158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:57.706 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.698+0000 7f017ed9d700 1 --2- 172.21.15.60:0/872839211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0180159bc0 0x7f01800b3e60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f018006a5d0 tx=0x7f01780013f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:57.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.698+0000 7f016e7fc700 1 -- 172.21.15.60:0/872839211 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0178017070 con 0x7f0180159bc0 2023-10-06T04:28:57.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.698+0000 7f016e7fc700 1 -- 172.21.15.60:0/872839211 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017800eb60 con 0x7f0180159bc0 2023-10-06T04:28:57.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.698+0000 7f017f59e700 1 -- 172.21.15.60:0/872839211 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0180153ef0 con 0x7f0180159bc0 2023-10-06T04:28:57.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.698+0000 7f016e7fc700 1 -- 172.21.15.60:0/872839211 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0178013420 con 0x7f0180159bc0 2023-10-06T04:28:57.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.698+0000 7f017f59e700 1 -- 172.21.15.60:0/872839211 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f018015a030 con 0x7f0180159bc0 2023-10-06T04:28:57.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.699+0000 7f017f59e700 1 -- 172.21.15.60:0/872839211 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f018005f230 con 0x7f0180159bc0 2023-10-06T04:28:57.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.700+0000 7f016e7fc700 1 -- 172.21.15.60:0/872839211 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0178013790 con 0x7f0180159bc0 2023-10-06T04:28:57.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.701+0000 7f016e7fc700 1 --2- 172.21.15.60:0/872839211 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0160066f30 0x7f01600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:57.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.701+0000 7f016e7fc700 1 -- 172.21.15.60:0/872839211 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f01780848d0 con 0x7f0180159bc0 2023-10-06T04:28:57.707 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.701+0000 7f017e59c700 1 --2- 172.21.15.60:0/872839211 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0160066f30 0x7f01600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:57.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.702+0000 7f017e59c700 1 --2- 172.21.15.60:0/872839211 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0160066f30 0x7f01600693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f018016d080 tx=0x7f0170009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:57.708 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.705+0000 7f016e7fc700 1 -- 172.21.15.60:0/872839211 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0178051610 con 0x7f0180159bc0 2023-10-06T04:28:57.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.908+0000 7f017f59e700 1 -- 172.21.15.60:0/872839211 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f01801543a0 con 0x7f0180159bc0 2023-10-06T04:28:57.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.908+0000 7f016e7fc700 1 -- 172.21.15.60:0/872839211 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0178054c30 con 0x7f0180159bc0 2023-10-06T04:28:57.911 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-06T04:28:57.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.911+0000 7f017f59e700 1 -- 172.21.15.60:0/872839211 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0160066f30 msgr2=0x7f01600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:57.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.911+0000 7f017f59e700 1 --2- 172.21.15.60:0/872839211 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0160066f30 0x7f01600693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f018016d080 tx=0x7f0170009040 comp rx=0 tx=0).stop 2023-10-06T04:28:57.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.911+0000 7f017f59e700 1 -- 172.21.15.60:0/872839211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0180159bc0 msgr2=0x7f01800b3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:57.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.911+0000 7f017f59e700 1 --2- 172.21.15.60:0/872839211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0180159bc0 0x7f01800b3e60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f018006a5d0 tx=0x7f01780013f0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.911+0000 7f017f59e700 1 -- 172.21.15.60:0/872839211 shutdown_connections 2023-10-06T04:28:57.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.911+0000 7f017f59e700 1 --2- 172.21.15.60:0/872839211 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0160066f30 0x7f01600693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.911+0000 7f017f59e700 1 --2- 172.21.15.60:0/872839211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0180159bc0 0x7f01800b3e60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.911+0000 7f017f59e700 1 --2- 172.21.15.60:0/872839211 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0168004810 0x7f01801530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.911+0000 7f017f59e700 1 --2- 172.21.15.60:0/872839211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0180157ac0 0x7f0180158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:57.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.911+0000 7f017f59e700 1 -- 172.21.15.60:0/872839211 >> 172.21.15.60:0/872839211 conn(0x7f0180099520 msgr2=0x7f01800697c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:57.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.911+0000 7f017f59e700 1 -- 172.21.15.60:0/872839211 shutdown_connections 2023-10-06T04:28:57.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:57.911+0000 7f017f59e700 1 -- 172.21.15.60:0/872839211 wait complete. 2023-10-06T04:28:57.931 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:28:58.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.119+0000 7fe97959d700 1 Processor -- start 2023-10-06T04:28:58.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.119+0000 7fe97959d700 1 -- start start 2023-10-06T04:28:58.124 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.120+0000 7fe97959d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9740b2620 0x7fe9740cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:58.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.120+0000 7fe97959d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe9740b29f0 0x7fe9740cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:58.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.120+0000 7fe97959d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9740cc970 con 0x7fe9740ceaa0 2023-10-06T04:28:58.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.120+0000 7fe97959d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9740cbd60 con 0x7fe9740b29f0 2023-10-06T04:28:58.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.120+0000 7fe97959d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9740cc040 con 0x7fe9740b2620 2023-10-06T04:28:58.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.120+0000 7fe9737fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe9740b29f0 0x7fe9740cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:58.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.121+0000 7fe9737fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe9740b29f0 0x7fe9740cd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44770/0 (socket says 172.21.15.60:44770) 2023-10-06T04:28:58.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.121+0000 7fe9737fe700 1 -- 172.21.15.60:0/3119415144 learned_addr learned my addr 172.21.15.60:0/3119415144 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:58.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.121+0000 7fe973fff700 1 --2- 172.21.15.60:0/3119415144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9740b2620 0x7fe9740cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:58.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.121+0000 7fe9737fe700 1 -- 172.21.15.60:0/3119415144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9740b2620 msgr2=0x7fe9740cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:58.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.121+0000 7fe9737fe700 1 --2- 172.21.15.60:0/3119415144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9740b2620 0x7fe9740cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:58.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.121+0000 7fe9737fe700 1 -- 172.21.15.60:0/3119415144 >> v1:172.21.15.135:6789/0 conn(0x7fe9740ceaa0 legacy=0x7fe9740cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:58.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.121+0000 7fe9737fe700 1 -- 172.21.15.60:0/3119415144 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9740cc320 con 0x7fe9740b29f0 2023-10-06T04:28:58.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.121+0000 7fe973fff700 1 --2- 172.21.15.60:0/3119415144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9740b2620 0x7fe9740cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:28:58.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.121+0000 7fe9737fe700 1 --2- 172.21.15.60:0/3119415144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9740b29f0 0x7fe9740cd1f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe9680099b0 tx=0x7fe968009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ebadd2a41327806 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:58.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.121+0000 7fe972ffd700 1 -- 172.21.15.60:0/3119415144 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96800b860 con 0x7fe9740b29f0 2023-10-06T04:28:58.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.122+0000 7fe972ffd700 1 -- 172.21.15.60:0/3119415144 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96800b9c0 con 0x7fe9740b29f0 2023-10-06T04:28:58.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.122+0000 7fe972ffd700 1 -- 172.21.15.60:0/3119415144 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96800bd60 con 0x7fe9740b29f0 2023-10-06T04:28:58.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.122+0000 7fe97959d700 1 -- 172.21.15.60:0/3119415144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9740b29f0 msgr2=0x7fe9740cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:58.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.122+0000 7fe97959d700 1 --2- 172.21.15.60:0/3119415144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9740b29f0 0x7fe9740cd1f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe9680099b0 tx=0x7fe968009250 comp rx=0 tx=0).stop 2023-10-06T04:28:58.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.122+0000 7fe97959d700 1 -- 172.21.15.60:0/3119415144 shutdown_connections 2023-10-06T04:28:58.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.122+0000 7fe97959d700 1 --2- 172.21.15.60:0/3119415144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9740b2620 0x7fe9740cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:58.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.122+0000 7fe97959d700 1 --2- 172.21.15.60:0/3119415144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9740b29f0 0x7fe9740cd1f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:58.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.122+0000 7fe97959d700 1 -- 172.21.15.60:0/3119415144 >> 172.21.15.60:0/3119415144 conn(0x7fe974099520 msgr2=0x7fe97406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:58.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.122+0000 7fe97959d700 1 -- 172.21.15.60:0/3119415144 shutdown_connections 2023-10-06T04:28:58.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.122+0000 7fe97959d700 1 -- 172.21.15.60:0/3119415144 wait complete. 2023-10-06T04:28:58.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.124+0000 7fe97959d700 1 Processor -- start 2023-10-06T04:28:58.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.124+0000 7fe97959d700 1 -- start start 2023-10-06T04:28:58.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.125+0000 7fe97959d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9740b2620 0x7fe974157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:58.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.125+0000 7fe97959d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9740b29f0 0x7fe97415a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:58.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.125+0000 7fe97959d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9740ceaa0 0x7fe97415cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:58.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.125+0000 7fe97959d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97415dbc0 con 0x7fe9740b2620 2023-10-06T04:28:58.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.125+0000 7fe97959d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97415a0d0 con 0x7fe9740b29f0 2023-10-06T04:28:58.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.125+0000 7fe97959d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97415aaa0 con 0x7fe9740ceaa0 2023-10-06T04:28:58.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.125+0000 7fe973fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9740b2620 0x7fe974157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:58.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.125+0000 7fe973fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9740b2620 0x7fe974157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44782/0 (socket says 172.21.15.60:44782) 2023-10-06T04:28:58.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.125+0000 7fe973fff700 1 -- 172.21.15.60:0/1450346046 learned_addr learned my addr 172.21.15.60:0/1450346046 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:58.130 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.125+0000 7fe973fff700 1 -- 172.21.15.60:0/1450346046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9740ceaa0 msgr2=0x7fe97415cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:58.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.125+0000 7fe973fff700 1 --2- 172.21.15.60:0/1450346046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9740ceaa0 0x7fe97415cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:58.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.125+0000 7fe973fff700 1 -- 172.21.15.60:0/1450346046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9740b29f0 msgr2=0x7fe97415a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:58.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.125+0000 7fe973fff700 1 --2- 172.21.15.60:0/1450346046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9740b29f0 0x7fe97415a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:58.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.125+0000 7fe973fff700 1 -- 172.21.15.60:0/1450346046 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9680094f0 con 0x7fe9740b2620 2023-10-06T04:28:58.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.126+0000 7fe973fff700 1 --2- 172.21.15.60:0/1450346046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9740b2620 0x7fe974157d40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe96400d890 tx=0x7fe964008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:58.131 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.126+0000 7fe95bfff700 1 -- 172.21.15.60:0/1450346046 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe964005a00 con 0x7fe9740b2620 2023-10-06T04:28:58.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.126+0000 7fe95bfff700 1 -- 172.21.15.60:0/1450346046 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe964005b60 con 0x7fe9740b2620 2023-10-06T04:28:58.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.126+0000 7fe95bfff700 1 -- 172.21.15.60:0/1450346046 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9640125f0 con 0x7fe9740b2620 2023-10-06T04:28:58.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.126+0000 7fe97959d700 1 -- 172.21.15.60:0/1450346046 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97415d600 con 0x7fe9740b2620 2023-10-06T04:28:58.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.126+0000 7fe97959d700 1 -- 172.21.15.60:0/1450346046 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe974159d60 con 0x7fe9740b2620 2023-10-06T04:28:58.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.127+0000 7fe97959d700 1 -- 172.21.15.60:0/1450346046 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe974159bc0 con 0x7fe9740b2620 2023-10-06T04:28:58.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.128+0000 7fe95bfff700 1 -- 172.21.15.60:0/1450346046 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9640129a0 con 0x7fe9740b2620 2023-10-06T04:28:58.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.129+0000 7fe95bfff700 1 --2- 172.21.15.60:0/1450346046 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe960066f30 0x7fe9600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:58.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.129+0000 7fe95bfff700 1 -- 172.21.15.60:0/1450346046 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fe964084cb0 con 0x7fe9740b2620 2023-10-06T04:28:58.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.129+0000 7fe9737fe700 1 --2- 172.21.15.60:0/1450346046 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe960066f30 0x7fe9600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:58.133 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.130+0000 7fe9737fe700 1 --2- 172.21.15.60:0/1450346046 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe960066f30 0x7fe9600693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe9680099b0 tx=0x7fe968017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:58.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.133+0000 7fe95bfff700 1 -- 172.21.15.60:0/1450346046 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe974159bc0 con 0x7fe9740b2620 2023-10-06T04:28:58.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.338+0000 7fe97959d700 1 -- 172.21.15.60:0/1450346046 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe974159bc0 con 0x7fe9740b2620 2023-10-06T04:28:58.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.338+0000 7fe95bfff700 1 -- 172.21.15.60:0/1450346046 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe974159bc0 con 0x7fe9740b2620 2023-10-06T04:28:58.341 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-06T04:28:58.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.340+0000 7fe97959d700 1 -- 172.21.15.60:0/1450346046 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe960066f30 msgr2=0x7fe9600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:58.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.340+0000 7fe97959d700 1 --2- 172.21.15.60:0/1450346046 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe960066f30 0x7fe9600693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe9680099b0 tx=0x7fe968017000 comp rx=0 tx=0).stop 2023-10-06T04:28:58.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.340+0000 7fe97959d700 1 -- 172.21.15.60:0/1450346046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9740b2620 msgr2=0x7fe974157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:58.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.340+0000 7fe97959d700 1 --2- 172.21.15.60:0/1450346046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9740b2620 0x7fe974157d40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe96400d890 tx=0x7fe964008040 comp rx=0 tx=0).stop 2023-10-06T04:28:58.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.340+0000 7fe97959d700 1 -- 172.21.15.60:0/1450346046 shutdown_connections 2023-10-06T04:28:58.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.340+0000 7fe97959d700 1 --2- 172.21.15.60:0/1450346046 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe960066f30 0x7fe9600693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:58.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.340+0000 7fe97959d700 1 --2- 172.21.15.60:0/1450346046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9740b2620 0x7fe974157d40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:58.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.340+0000 7fe97959d700 1 --2- 172.21.15.60:0/1450346046 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9740ceaa0 0x7fe97415cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:58.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.340+0000 7fe97959d700 1 --2- 172.21.15.60:0/1450346046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9740b29f0 0x7fe97415a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:58.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.340+0000 7fe97959d700 1 -- 172.21.15.60:0/1450346046 >> 172.21.15.60:0/1450346046 conn(0x7fe974099520 msgr2=0x7fe9740ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:58.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.341+0000 7fe97959d700 1 -- 172.21.15.60:0/1450346046 shutdown_connections 2023-10-06T04:28:58.344 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.341+0000 7fe97959d700 1 -- 172.21.15.60:0/1450346046 wait complete. 2023-10-06T04:28:58.416 INFO:tasks.cephfs_test_runner:Starting test: test_acls (tasks.cephfs.test_acls.TestACLs) 2023-10-06T04:28:58.416 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_acls.TestACLs.test_acls' 2023-10-06T04:28:58.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.601+0000 7f138519d700 1 Processor -- start 2023-10-06T04:28:58.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.601+0000 7f138519d700 1 -- start start 2023-10-06T04:28:58.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.603+0000 7f138519d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f138006a590 0x7f13801536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:58.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.603+0000 7f138519d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f138006a960 0x7f1380153c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:58.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.603+0000 7f138519d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13800c9cc0 con 0x7f138006df50 2023-10-06T04:28:58.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.603+0000 7f138519d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006f560 con 0x7f138006a960 2023-10-06T04:28:58.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.603+0000 7f138519d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138006eac0 con 0x7f138006a590 2023-10-06T04:28:58.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.603+0000 7f138499c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f138006df50 0x7f138006e3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34828/0 (socket says 172.21.15.60:34828) 2023-10-06T04:28:58.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.603+0000 7f138499c700 1 -- 172.21.15.60:0/599316696 learned_addr learned my addr 172.21.15.60:0/599316696 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:58.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.603+0000 7f137ffff700 1 --2- 172.21.15.60:0/599316696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f138006a590 0x7f13801536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:58.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.603+0000 7f137f7fe700 1 --2- 172.21.15.60:0/599316696 >> v2:172.21.15.135:3300/0 conn(0x7f138006a960 0x7f1380153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:58.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.603+0000 7f137effd700 1 -- 172.21.15.60:0/599316696 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4204631938 0 0) 0x7f13800c9cc0 con 0x7f138006df50 2023-10-06T04:28:58.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.603+0000 7f137effd700 1 -- 172.21.15.60:0/599316696 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1368003570 con 0x7f138006df50 2023-10-06T04:28:58.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.604+0000 7f137f7fe700 1 -- 172.21.15.60:0/599316696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f138006a590 msgr2=0x7f13801536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:28:58.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.604+0000 7f137effd700 1 -- 172.21.15.60:0/599316696 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2478121583 0 0) 0x7f1368003570 con 0x7f138006df50 2023-10-06T04:28:58.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.604+0000 7f137f7fe700 1 --2- 172.21.15.60:0/599316696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f138006a590 0x7f13801536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:58.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.604+0000 7f137f7fe700 1 -- 172.21.15.60:0/599316696 >> v1:172.21.15.60:6789/0 conn(0x7f138006df50 legacy=0x7f138006e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:58.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.604+0000 7f137f7fe700 1 -- 172.21.15.60:0/599316696 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13800c6710 con 0x7f138006a960 2023-10-06T04:28:58.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.604+0000 7f137ffff700 1 --2- 172.21.15.60:0/599316696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f138006a590 0x7f13801536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:28:58.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.604+0000 7f137f7fe700 1 --2- 172.21.15.60:0/599316696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f138006a960 0x7f1380153c30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1374009910 tx=0x7f13740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cff998a9d74884f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:58.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.604+0000 7f137effd700 1 -- 172.21.15.60:0/599316696 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13780017f0 con 0x7f138006a960 2023-10-06T04:28:58.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.605+0000 7f137effd700 1 -- 172.21.15.60:0/599316696 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1374011420 con 0x7f138006a960 2023-10-06T04:28:58.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.605+0000 7f137effd700 1 -- 172.21.15.60:0/599316696 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740117c0 con 0x7f138006a960 2023-10-06T04:28:58.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.605+0000 7f138519d700 1 -- 172.21.15.60:0/599316696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f138006a960 msgr2=0x7f1380153c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:58.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.605+0000 7f138519d700 1 --2- 172.21.15.60:0/599316696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f138006a960 0x7f1380153c30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1374009910 tx=0x7f13740091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:58.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.605+0000 7f138519d700 1 -- 172.21.15.60:0/599316696 shutdown_connections 2023-10-06T04:28:58.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.605+0000 7f138519d700 1 --2- 172.21.15.60:0/599316696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f138006a590 0x7f13801536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:58.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.605+0000 7f138519d700 1 --2- 172.21.15.60:0/599316696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f138006a960 0x7f1380153c30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:58.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.605+0000 7f138519d700 1 -- 172.21.15.60:0/599316696 >> 172.21.15.60:0/599316696 conn(0x7f1380068080 msgr2=0x7f13800cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:58.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.605+0000 7f138519d700 1 -- 172.21.15.60:0/599316696 shutdown_connections 2023-10-06T04:28:58.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.605+0000 7f138519d700 1 -- 172.21.15.60:0/599316696 wait complete. 2023-10-06T04:28:58.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.607+0000 7f138519d700 1 Processor -- start 2023-10-06T04:28:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.607+0000 7f138519d700 1 -- start start 2023-10-06T04:28:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.608+0000 7f138519d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f138006a590 0x7f13800af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.608+0000 7f138519d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f138006a960 0x7f1380155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.608+0000 7f138519d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f138006df50 0x7f1380155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.608+0000 7f138519d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13800b04c0 con 0x7f138006a590 2023-10-06T04:28:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.608+0000 7f138519d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1380169f00 con 0x7f138006df50 2023-10-06T04:28:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.608+0000 7f138519d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1380169630 con 0x7f138006a960 2023-10-06T04:28:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.608+0000 7f137ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f138006a590 0x7f13800af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.608+0000 7f137ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f138006a590 0x7f13800af7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44784/0 (socket says 172.21.15.60:44784) 2023-10-06T04:28:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.608+0000 7f137ffff700 1 -- 172.21.15.60:0/3959665544 learned_addr learned my addr 172.21.15.60:0/3959665544 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.608+0000 7f137f7fe700 1 --2- 172.21.15.60:0/3959665544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f138006a960 0x7f1380155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.608+0000 7f138499c700 1 --2- 172.21.15.60:0/3959665544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f138006df50 0x7f1380155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.608+0000 7f137ffff700 1 -- 172.21.15.60:0/3959665544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f138006a960 msgr2=0x7f1380155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.608+0000 7f137ffff700 1 --2- 172.21.15.60:0/3959665544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f138006a960 0x7f1380155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.608+0000 7f137ffff700 1 -- 172.21.15.60:0/3959665544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f138006df50 msgr2=0x7f1380155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.608+0000 7f137ffff700 1 --2- 172.21.15.60:0/3959665544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f138006df50 0x7f1380155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.608+0000 7f137ffff700 1 -- 172.21.15.60:0/3959665544 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1370009420 con 0x7f138006a590 2023-10-06T04:28:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.608+0000 7f137f7fe700 1 --2- 172.21.15.60:0/3959665544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f138006a960 0x7f1380155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.608+0000 7f138499c700 1 --2- 172.21.15.60:0/3959665544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f138006df50 0x7f1380155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.609+0000 7f137ffff700 1 --2- 172.21.15.60:0/3959665544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f138006a590 0x7f13800af7b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f137000ec80 tx=0x7f13700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.609+0000 7f1367fff700 1 -- 172.21.15.60:0/3959665544 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137000c9d0 con 0x7f138006a590 2023-10-06T04:28:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.609+0000 7f1367fff700 1 -- 172.21.15.60:0/3959665544 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137000cb30 con 0x7f138006a590 2023-10-06T04:28:58.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.609+0000 7f138519d700 1 -- 172.21.15.60:0/3959665544 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1374009420 con 0x7f138006a590 2023-10-06T04:28:58.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.609+0000 7f1367fff700 1 -- 172.21.15.60:0/3959665544 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137000ceb0 con 0x7f138006a590 2023-10-06T04:28:58.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.609+0000 7f138519d700 1 -- 172.21.15.60:0/3959665544 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13801698b0 con 0x7f138006a590 2023-10-06T04:28:58.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.610+0000 7f138519d700 1 -- 172.21.15.60:0/3959665544 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138016a1e0 con 0x7f138006a590 2023-10-06T04:28:58.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.611+0000 7f1367fff700 1 -- 172.21.15.60:0/3959665544 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1370013680 con 0x7f138006a590 2023-10-06T04:28:58.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.612+0000 7f1367fff700 1 --2- 172.21.15.60:0/3959665544 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f136c066f30 0x7f136c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:58.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.612+0000 7f1367fff700 1 -- 172.21.15.60:0/3959665544 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f1370084f80 con 0x7f138006a590 2023-10-06T04:28:58.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.612+0000 7f137f7fe700 1 --2- 172.21.15.60:0/3959665544 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f136c066f30 0x7f136c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:58.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.613+0000 7f137f7fe700 1 --2- 172.21.15.60:0/3959665544 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f136c066f30 0x7f136c0693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f13800c5f70 tx=0x7f1374016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:58.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.616+0000 7f1367fff700 1 -- 172.21.15.60:0/3959665544 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1370051cc0 con 0x7f138006a590 2023-10-06T04:28:58.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:58.905+0000 7f138519d700 1 -- 172.21.15.60:0/3959665544 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]} v 0) v1 -- 0x7f138005f230 con 0x7f138006a590 2023-10-06T04:28:59.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.391+0000 7f1367fff700 1 -- 172.21.15.60:0/3959665544 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]}]=0 v67) v1 ==== 123+0+0 (secure 0 0 0) 0x7f13700170c0 con 0x7f138006a590 2023-10-06T04:28:59.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.394+0000 7f138519d700 1 -- 172.21.15.60:0/3959665544 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f136c066f30 msgr2=0x7f136c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:59.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.394+0000 7f138519d700 1 --2- 172.21.15.60:0/3959665544 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f136c066f30 0x7f136c0693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f13800c5f70 tx=0x7f1374016000 comp rx=0 tx=0).stop 2023-10-06T04:28:59.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.394+0000 7f138519d700 1 -- 172.21.15.60:0/3959665544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f138006a590 msgr2=0x7f13800af7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:59.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.394+0000 7f138519d700 1 --2- 172.21.15.60:0/3959665544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f138006a590 0x7f13800af7b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f137000ec80 tx=0x7f13700091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:59.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.394+0000 7f138519d700 1 -- 172.21.15.60:0/3959665544 shutdown_connections 2023-10-06T04:28:59.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.394+0000 7f138519d700 1 --2- 172.21.15.60:0/3959665544 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f136c066f30 0x7f136c0693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:59.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.394+0000 7f138519d700 1 --2- 172.21.15.60:0/3959665544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f138006a590 0x7f13800af7b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:59.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.394+0000 7f138519d700 1 --2- 172.21.15.60:0/3959665544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f138006df50 0x7f1380155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:59.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.394+0000 7f138519d700 1 --2- 172.21.15.60:0/3959665544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f138006a960 0x7f1380155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:59.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.394+0000 7f138519d700 1 -- 172.21.15.60:0/3959665544 >> 172.21.15.60:0/3959665544 conn(0x7f1380068080 msgr2=0x7f13800c2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:59.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.394+0000 7f138519d700 1 -- 172.21.15.60:0/3959665544 shutdown_connections 2023-10-06T04:28:59.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.394+0000 7f138519d700 1 -- 172.21.15.60:0/3959665544 wait complete. 2023-10-06T04:28:59.416 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T04:28:59.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.607+0000 7f15b299d700 1 Processor -- start 2023-10-06T04:28:59.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.607+0000 7f15b299d700 1 -- start start 2023-10-06T04:28:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.608+0000 7f15b299d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f15ac0cd3c0 0x7f15ac0ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.608+0000 7f15b299d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ac0cc970 con 0x7f15ac0b29f0 2023-10-06T04:28:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.608+0000 7f15b299d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ac0cbd60 con 0x7f15ac0b2620 2023-10-06T04:28:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.608+0000 7f15b299d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ac0cc040 con 0x7f15ac0cd3c0 2023-10-06T04:28:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.608+0000 7f15b219c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f15ac0b29f0 0x7f15ac0c5350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34836/0 (socket says 172.21.15.60:34836) 2023-10-06T04:28:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.608+0000 7f15b219c700 1 -- 172.21.15.60:0/4179972191 learned_addr learned my addr 172.21.15.60:0/4179972191 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:28:59.611 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.609+0000 7f15b119a700 1 --2- 172.21.15.60:0/4179972191 >> v2:172.21.15.135:3300/0 conn(0x7f15ac0cd3c0 0x7f15ac0ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:59.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.609+0000 7f15b0999700 1 -- 172.21.15.60:0/4179972191 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532417267 0 0) 0x7f15ac0cc970 con 0x7f15ac0b29f0 2023-10-06T04:28:59.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.609+0000 7f15b0999700 1 -- 172.21.15.60:0/4179972191 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1598003570 con 0x7f15ac0b29f0 2023-10-06T04:28:59.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.609+0000 7f15b0999700 1 -- 172.21.15.60:0/4179972191 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071821282 0 0) 0x7f15ac0cbd60 con 0x7f15ac0b2620 2023-10-06T04:28:59.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.609+0000 7f15b0999700 1 -- 172.21.15.60:0/4179972191 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15ac0cc970 con 0x7f15ac0b2620 2023-10-06T04:28:59.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.609+0000 7f15b119a700 1 -- 172.21.15.60:0/4179972191 >> v1:172.21.15.135:6789/0 conn(0x7f15ac0b2620 legacy=0x7f15ac0cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:59.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.609+0000 7f15b119a700 1 -- 172.21.15.60:0/4179972191 >> v1:172.21.15.60:6789/0 conn(0x7f15ac0b29f0 legacy=0x7f15ac0c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:59.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.609+0000 7f15b119a700 1 -- 172.21.15.60:0/4179972191 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac0cc320 con 0x7f15ac0cd3c0 2023-10-06T04:28:59.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.609+0000 7f15b119a700 1 --2- 172.21.15.60:0/4179972191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15ac0cd3c0 0x7f15ac0ceaa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f159c0098e0 tx=0x7f159c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab95ea8d505eb0f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:59.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.610+0000 7f15b0999700 1 -- 172.21.15.60:0/4179972191 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c011630 con 0x7f15ac0cd3c0 2023-10-06T04:28:59.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.610+0000 7f15b0999700 1 -- 172.21.15.60:0/4179972191 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c011790 con 0x7f15ac0cd3c0 2023-10-06T04:28:59.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.610+0000 7f15b0999700 1 -- 172.21.15.60:0/4179972191 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c011b30 con 0x7f15ac0cd3c0 2023-10-06T04:28:59.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.610+0000 7f15b299d700 1 -- 172.21.15.60:0/4179972191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15ac0cd3c0 msgr2=0x7f15ac0ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:59.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.610+0000 7f15b299d700 1 --2- 172.21.15.60:0/4179972191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15ac0cd3c0 0x7f15ac0ceaa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f159c0098e0 tx=0x7f159c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:28:59.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.610+0000 7f15b299d700 1 -- 172.21.15.60:0/4179972191 shutdown_connections 2023-10-06T04:28:59.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.610+0000 7f15b299d700 1 --2- 172.21.15.60:0/4179972191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15ac0cd3c0 0x7f15ac0ceaa0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:59.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.610+0000 7f15b299d700 1 -- 172.21.15.60:0/4179972191 >> 172.21.15.60:0/4179972191 conn(0x7f15ac099520 msgr2=0x7f15ac06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:59.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.610+0000 7f15b299d700 1 -- 172.21.15.60:0/4179972191 shutdown_connections 2023-10-06T04:28:59.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.610+0000 7f15b299d700 1 -- 172.21.15.60:0/4179972191 wait complete. 2023-10-06T04:28:59.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.612+0000 7f15b299d700 1 Processor -- start 2023-10-06T04:28:59.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.612+0000 7f15b299d700 1 -- start start 2023-10-06T04:28:59.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.613+0000 7f15b299d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15ac0b2620 0x7f15ac0ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:59.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.613+0000 7f15b299d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0b29f0 0x7f15ac15c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:59.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.613+0000 7f15b299d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15ac0cd3c0 0x7f15ac15c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.613+0000 7f15b299d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0c7a40 con 0x7f15ac0b29f0 2023-10-06T04:28:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.613+0000 7f15b299d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0ca680 con 0x7f15ac0b2620 2023-10-06T04:28:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.613+0000 7f15b299d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0c9cb0 con 0x7f15ac0cd3c0 2023-10-06T04:28:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.613+0000 7f15b119a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0b29f0 0x7f15ac15c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.613+0000 7f15b119a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0b29f0 0x7f15ac15c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44792/0 (socket says 172.21.15.60:44792) 2023-10-06T04:28:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.613+0000 7f15b119a700 1 -- 172.21.15.60:0/2414657855 learned_addr learned my addr 172.21.15.60:0/2414657855 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:28:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.613+0000 7f15b119a700 1 -- 172.21.15.60:0/2414657855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15ac0cd3c0 msgr2=0x7f15ac15c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.613+0000 7f15b119a700 1 --2- 172.21.15.60:0/2414657855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15ac0cd3c0 0x7f15ac15c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.613+0000 7f15b119a700 1 -- 172.21.15.60:0/2414657855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15ac0b2620 msgr2=0x7f15ac0ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.613+0000 7f15b199b700 1 --2- 172.21.15.60:0/2414657855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15ac0b2620 0x7f15ac0ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:59.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.614+0000 7f15b119a700 1 --2- 172.21.15.60:0/2414657855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15ac0b2620 0x7f15ac0ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:59.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.614+0000 7f15b119a700 1 -- 172.21.15.60:0/2414657855 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c009420 con 0x7f15ac0b29f0 2023-10-06T04:28:59.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.614+0000 7f15b199b700 1 --2- 172.21.15.60:0/2414657855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15ac0b2620 0x7f15ac0ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:28:59.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.614+0000 7f15b119a700 1 --2- 172.21.15.60:0/2414657855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0b29f0 0x7f15ac15c030 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f159c009ed0 tx=0x7f159c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:59.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.614+0000 7f15a1ffb700 1 -- 172.21.15.60:0/2414657855 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c01f070 con 0x7f15ac0b29f0 2023-10-06T04:28:59.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.614+0000 7f15a1ffb700 1 -- 172.21.15.60:0/2414657855 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c011900 con 0x7f15ac0b29f0 2023-10-06T04:28:59.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.614+0000 7f15a1ffb700 1 -- 172.21.15.60:0/2414657855 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c023430 con 0x7f15ac0b29f0 2023-10-06T04:28:59.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.614+0000 7f15b299d700 1 -- 172.21.15.60:0/2414657855 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ac0c8e00 con 0x7f15ac0b29f0 2023-10-06T04:28:59.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.614+0000 7f15b299d700 1 -- 172.21.15.60:0/2414657855 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac0c9380 con 0x7f15ac0b29f0 2023-10-06T04:28:59.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.615+0000 7f15b299d700 1 -- 172.21.15.60:0/2414657855 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac0c9e40 con 0x7f15ac0b29f0 2023-10-06T04:28:59.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.616+0000 7f15a1ffb700 1 -- 172.21.15.60:0/2414657855 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f159c02c3b0 con 0x7f15ac0b29f0 2023-10-06T04:28:59.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.617+0000 7f15a1ffb700 1 --2- 172.21.15.60:0/2414657855 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1590066f30 0x7f15900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:28:59.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.617+0000 7f15a1ffb700 1 -- 172.21.15.60:0/2414657855 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f159c085d20 con 0x7f15ac0b29f0 2023-10-06T04:28:59.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.617+0000 7f15b199b700 1 --2- 172.21.15.60:0/2414657855 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1590066f30 0x7f15900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:28:59.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.618+0000 7f15b199b700 1 --2- 172.21.15.60:0/2414657855 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1590066f30 0x7f15900693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f15a80028c0 tx=0x7f15a8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:28:59.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.621+0000 7f15a1ffb700 1 -- 172.21.15.60:0/2414657855 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f159c052b00 con 0x7f15ac0b29f0 2023-10-06T04:28:59.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.827+0000 7f15b299d700 1 -- 172.21.15.60:0/2414657855 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f15ac05f230 con 0x7f15ac0b29f0 2023-10-06T04:28:59.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.831+0000 7f15a1ffb700 1 -- 172.21.15.60:0/2414657855 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f159c0280c0 con 0x7f15ac0b29f0 2023-10-06T04:28:59.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.833+0000 7f15b299d700 1 -- 172.21.15.60:0/2414657855 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1590066f30 msgr2=0x7f15900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:59.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.833+0000 7f15b299d700 1 --2- 172.21.15.60:0/2414657855 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1590066f30 0x7f15900693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f15a80028c0 tx=0x7f15a8009040 comp rx=0 tx=0).stop 2023-10-06T04:28:59.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.833+0000 7f15b299d700 1 -- 172.21.15.60:0/2414657855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0b29f0 msgr2=0x7f15ac15c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:28:59.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.833+0000 7f15b299d700 1 --2- 172.21.15.60:0/2414657855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0b29f0 0x7f15ac15c030 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f159c009ed0 tx=0x7f159c017000 comp rx=0 tx=0).stop 2023-10-06T04:28:59.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.833+0000 7f15b299d700 1 -- 172.21.15.60:0/2414657855 shutdown_connections 2023-10-06T04:28:59.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.833+0000 7f15b299d700 1 --2- 172.21.15.60:0/2414657855 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1590066f30 0x7f15900693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:59.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.833+0000 7f15b299d700 1 --2- 172.21.15.60:0/2414657855 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f15ac0cd3c0 0x7f15ac15c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:59.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.833+0000 7f15b299d700 1 --2- 172.21.15.60:0/2414657855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15ac0b2620 0x7f15ac0ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:59.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.833+0000 7f15b299d700 1 --2- 172.21.15.60:0/2414657855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15ac0b29f0 0x7f15ac15c030 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:28:59.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.833+0000 7f15b299d700 1 -- 172.21.15.60:0/2414657855 >> 172.21.15.60:0/2414657855 conn(0x7f15ac099520 msgr2=0x7f15ac150da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:28:59.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.833+0000 7f15b299d700 1 -- 172.21.15.60:0/2414657855 shutdown_connections 2023-10-06T04:28:59.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:28:59.834+0000 7f15b299d700 1 -- 172.21.15.60:0/2414657855 wait complete. 2023-10-06T04:28:59.853 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T04:28:59.854 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:28:59.935 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:29:00.021 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T04:29:00.022 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T04:29:00.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:29:00.022 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-06T04:29:00.117 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2023-10-06T04:29:00.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:29:00.118 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T04:29:00.154 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T04:29:00.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:29:00.155 DEBUG:teuthology.orchestra.run.smithi135:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-06T04:29:00.269 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2023-10-06T04:29:00.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:29:00.270 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T04:29:00.324 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-06T04:29:00.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:29:00.325 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-06T04:29:00.403 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2023-10-06T04:29:00.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:29:00.403 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T04:29:00.440 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-06T04:29:00.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:29:00.441 DEBUG:teuthology.orchestra.run.smithi135:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-06T04:29:00.518 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2023-10-06T04:29:00.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:29:00.519 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T04:29:00.555 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T04:29:00.555 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:29:00.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.739+0000 7fc203fff700 1 Processor -- start 2023-10-06T04:29:00.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.739+0000 7fc203fff700 1 -- start start 2023-10-06T04:29:00.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.740+0000 7fc203fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc204161610 0x7fc2040c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:00.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.741+0000 7fc203fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2041619e0 0x7fc204161e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:00.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.741+0000 7fc203fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2040caed0 con 0x7fc2040c6500 2023-10-06T04:29:00.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.741+0000 7fc203fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2040ca2c0 con 0x7fc204161610 2023-10-06T04:29:00.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.741+0000 7fc203fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2040ca5a0 con 0x7fc2041619e0 2023-10-06T04:29:00.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.741+0000 7fc202ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc204161610 0x7fc2040c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:00.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.741+0000 7fc202ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc204161610 0x7fc2040c9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44798/0 (socket says 172.21.15.60:44798) 2023-10-06T04:29:00.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.741+0000 7fc202ffd700 1 -- 172.21.15.60:0/108272421 learned_addr learned my addr 172.21.15.60:0/108272421 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:00.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.741+0000 7fc2027fc700 1 --2- 172.21.15.60:0/108272421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2041619e0 0x7fc204161e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:00.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.741+0000 7fc202ffd700 1 -- 172.21.15.60:0/108272421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2041619e0 msgr2=0x7fc204161e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:00.744 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.741+0000 7fc202ffd700 1 --2- 172.21.15.60:0/108272421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2041619e0 0x7fc204161e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:00.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.741+0000 7fc202ffd700 1 -- 172.21.15.60:0/108272421 >> v1:172.21.15.135:6789/0 conn(0x7fc2040c6500 legacy=0x7fc20415ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:00.745 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.741+0000 7fc202ffd700 1 -- 172.21.15.60:0/108272421 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2040ca880 con 0x7fc204161610 2023-10-06T04:29:00.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.742+0000 7fc202ffd700 1 --2- 172.21.15.60:0/108272421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc204161610 0x7fc2040c9a90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40099b0 tx=0x7fc1f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357805325f5b123e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:00.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.742+0000 7fc201ffb700 1 -- 172.21.15.60:0/108272421 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4009ea0 con 0x7fc204161610 2023-10-06T04:29:00.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.742+0000 7fc201ffb700 1 -- 172.21.15.60:0/108272421 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f400b860 con 0x7fc204161610 2023-10-06T04:29:00.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.742+0000 7fc201ffb700 1 -- 172.21.15.60:0/108272421 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f400bc00 con 0x7fc204161610 2023-10-06T04:29:00.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.742+0000 7fc203fff700 1 -- 172.21.15.60:0/108272421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc204161610 msgr2=0x7fc2040c9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:00.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.742+0000 7fc203fff700 1 --2- 172.21.15.60:0/108272421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc204161610 0x7fc2040c9a90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40099b0 tx=0x7fc1f4009250 comp rx=0 tx=0).stop 2023-10-06T04:29:00.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.743+0000 7fc203fff700 1 -- 172.21.15.60:0/108272421 shutdown_connections 2023-10-06T04:29:00.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.743+0000 7fc203fff700 1 --2- 172.21.15.60:0/108272421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc204161610 0x7fc2040c9a90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:00.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.743+0000 7fc203fff700 1 --2- 172.21.15.60:0/108272421 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2041619e0 0x7fc204161e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:00.747 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.743+0000 7fc203fff700 1 -- 172.21.15.60:0/108272421 >> 172.21.15.60:0/108272421 conn(0x7fc204068080 msgr2=0x7fc2040cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:00.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.743+0000 7fc203fff700 1 -- 172.21.15.60:0/108272421 shutdown_connections 2023-10-06T04:29:00.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.743+0000 7fc203fff700 1 -- 172.21.15.60:0/108272421 wait complete. 2023-10-06T04:29:00.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.744+0000 7fc203fff700 1 Processor -- start 2023-10-06T04:29:00.748 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.744+0000 7fc203fff700 1 -- start start 2023-10-06T04:29:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.745+0000 7fc203fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2040c6500 0x7fc2040b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.745+0000 7fc203fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc204161610 0x7fc2040c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.745+0000 7fc203fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2041619e0 0x7fc2041712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.745+0000 7fc203fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2040c36f0 con 0x7fc2040c6500 2023-10-06T04:29:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.745+0000 7fc203fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2040b1b20 con 0x7fc204161610 2023-10-06T04:29:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.745+0000 7fc203fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2040aacd0 con 0x7fc2041619e0 2023-10-06T04:29:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.745+0000 7fc202ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2040c6500 0x7fc2040b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:00.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.746+0000 7fc202ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2040c6500 0x7fc2040b15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44806/0 (socket says 172.21.15.60:44806) 2023-10-06T04:29:00.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.746+0000 7fc202ffd700 1 -- 172.21.15.60:0/4291720431 learned_addr learned my addr 172.21.15.60:0/4291720431 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:00.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.746+0000 7fc2027fc700 1 --2- 172.21.15.60:0/4291720431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc204161610 0x7fc2040c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:00.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.746+0000 7fc202ffd700 1 -- 172.21.15.60:0/4291720431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2041619e0 msgr2=0x7fc2041712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:00.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.746+0000 7fc202ffd700 1 --2- 172.21.15.60:0/4291720431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2041619e0 0x7fc2041712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:00.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.746+0000 7fc202ffd700 1 -- 172.21.15.60:0/4291720431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc204161610 msgr2=0x7fc2040c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:00.751 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.746+0000 7fc202ffd700 1 --2- 172.21.15.60:0/4291720431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc204161610 0x7fc2040c5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:00.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.746+0000 7fc202ffd700 1 -- 172.21.15.60:0/4291720431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f40094f0 con 0x7fc2040c6500 2023-10-06T04:29:00.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.746+0000 7fc202ffd700 1 --2- 172.21.15.60:0/4291720431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2040c6500 0x7fc2040b15e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc20406c8c0 tx=0x7fc1f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:00.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.746+0000 7fc1eaffd700 1 -- 172.21.15.60:0/4291720431 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f400b9d0 con 0x7fc2040c6500 2023-10-06T04:29:00.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.746+0000 7fc1eaffd700 1 -- 172.21.15.60:0/4291720431 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f400bb50 con 0x7fc2040c6500 2023-10-06T04:29:00.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.746+0000 7fc203fff700 1 -- 172.21.15.60:0/4291720431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2040aafb0 con 0x7fc2040c6500 2023-10-06T04:29:00.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.746+0000 7fc1eaffd700 1 -- 172.21.15.60:0/4291720431 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4025670 con 0x7fc2040c6500 2023-10-06T04:29:00.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.747+0000 7fc203fff700 1 -- 172.21.15.60:0/4291720431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2040c3380 con 0x7fc2040c6500 2023-10-06T04:29:00.752 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.747+0000 7fc203fff700 1 -- 172.21.15.60:0/4291720431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc20405f230 con 0x7fc2040c6500 2023-10-06T04:29:00.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.748+0000 7fc1eaffd700 1 -- 172.21.15.60:0/4291720431 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc1f4023070 con 0x7fc2040c6500 2023-10-06T04:29:00.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.749+0000 7fc1eaffd700 1 --2- 172.21.15.60:0/4291720431 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc1f0066f30 0x7fc1f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:00.753 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.749+0000 7fc1eaffd700 1 -- 172.21.15.60:0/4291720431 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fc1f40860d0 con 0x7fc2040c6500 2023-10-06T04:29:00.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.749+0000 7fc2027fc700 1 --2- 172.21.15.60:0/4291720431 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc1f0066f30 0x7fc1f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:00.754 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.750+0000 7fc2027fc700 1 --2- 172.21.15.60:0/4291720431 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc1f0066f30 0x7fc1f00693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80093f0 tx=0x7fc1f8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:00.756 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.754+0000 7fc1eaffd700 1 -- 172.21.15.60:0/4291720431 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1f4052e10 con 0x7fc2040c6500 2023-10-06T04:29:00.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.997+0000 7fc203fff700 1 -- 172.21.15.60:0/4291720431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2040cc460 con 0x7fc2040c6500 2023-10-06T04:29:01.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:00.998+0000 7fc1eaffd700 1 -- 172.21.15.60:0/4291720431 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7fc1f4056430 con 0x7fc2040c6500 2023-10-06T04:29:01.000 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:01.001 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3950892589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3950892589},{"type":"v1","addr":"172.21.15.60:6837","nonce":3950892589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1381681252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1381681252},{"type":"v1","addr":"172.21.15.135:6834","nonce":1381681252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1306947344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1306947344},{"type":"v1","addr":"172.21.15.135:6835","nonce":1306947344}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:28:06.242656+0000","modified":"2023-10-06T04:28:23.340411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/1424722915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1424722915},{"type":"v1","addr":"172.21.15.60:6836","nonce":1424722915}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:29:01.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.000+0000 7fc203fff700 1 -- 172.21.15.60:0/4291720431 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc1f0066f30 msgr2=0x7fc1f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:01.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.000+0000 7fc203fff700 1 --2- 172.21.15.60:0/4291720431 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc1f0066f30 0x7fc1f00693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80093f0 tx=0x7fc1f8008040 comp rx=0 tx=0).stop 2023-10-06T04:29:01.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.000+0000 7fc203fff700 1 -- 172.21.15.60:0/4291720431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2040c6500 msgr2=0x7fc2040b15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:01.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.000+0000 7fc203fff700 1 --2- 172.21.15.60:0/4291720431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2040c6500 0x7fc2040b15e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc20406c8c0 tx=0x7fc1f4017000 comp rx=0 tx=0).stop 2023-10-06T04:29:01.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.000+0000 7fc203fff700 1 -- 172.21.15.60:0/4291720431 shutdown_connections 2023-10-06T04:29:01.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.000+0000 7fc203fff700 1 --2- 172.21.15.60:0/4291720431 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc1f0066f30 0x7fc1f00693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.000+0000 7fc203fff700 1 --2- 172.21.15.60:0/4291720431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2040c6500 0x7fc2040b15e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.000+0000 7fc203fff700 1 --2- 172.21.15.60:0/4291720431 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc2041619e0 0x7fc2041712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.000+0000 7fc203fff700 1 --2- 172.21.15.60:0/4291720431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc204161610 0x7fc2040c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.000+0000 7fc203fff700 1 -- 172.21.15.60:0/4291720431 >> 172.21.15.60:0/4291720431 conn(0x7fc204068080 msgr2=0x7fc204157960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:01.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.001+0000 7fc203fff700 1 -- 172.21.15.60:0/4291720431 shutdown_connections 2023-10-06T04:29:01.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.001+0000 7fc203fff700 1 -- 172.21.15.60:0/4291720431 wait complete. 2023-10-06T04:29:01.005 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 9 2023-10-06T04:29:01.021 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:29:01.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.206+0000 7f0048d9d700 1 Processor -- start 2023-10-06T04:29:01.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.206+0000 7f0048d9d700 1 -- start start 2023-10-06T04:29:01.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.207+0000 7f0048d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0044159440 0x7f00440b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.207+0000 7f0048d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f00440b35d0 0x7f00440cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.207+0000 7f0048d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f00440cc170 0x7f00440b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.207+0000 7f0048d9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00440cb7a0 con 0x7f00440b35d0 2023-10-06T04:29:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.207+0000 7f0048d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00440b0860 con 0x7f00440cc170 2023-10-06T04:29:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.207+0000 7f0048d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00440cb150 con 0x7f0044159440 2023-10-06T04:29:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.207+0000 7f0042ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f00440b35d0 0x7f00440cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.207+0000 7f0042ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f00440b35d0 0x7f00440cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44818/0 (socket says 172.21.15.60:44818) 2023-10-06T04:29:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.207+0000 7f0042ffd700 1 -- 172.21.15.60:0/3319798578 learned_addr learned my addr 172.21.15.60:0/3319798578 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.208+0000 7f00437fe700 1 --2- 172.21.15.60:0/3319798578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0044159440 0x7f00440b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.208+0000 7f0043fff700 1 --2- 172.21.15.60:0/3319798578 >> v2:172.21.15.135:3300/0 conn(0x7f00440cc170 0x7f00440b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.208+0000 7f0042ffd700 1 -- 172.21.15.60:0/3319798578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0044159440 msgr2=0x7f00440b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.208+0000 7f0042ffd700 1 --2- 172.21.15.60:0/3319798578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0044159440 0x7f00440b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.208+0000 7f0042ffd700 1 -- 172.21.15.60:0/3319798578 >> v2:172.21.15.135:3300/0 conn(0x7f00440cc170 msgr2=0x7f00440b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.208+0000 7f0042ffd700 1 --2- 172.21.15.60:0/3319798578 >> v2:172.21.15.135:3300/0 conn(0x7f00440cc170 0x7f00440b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.208+0000 7f0042ffd700 1 -- 172.21.15.60:0/3319798578 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00440cb430 con 0x7f00440b35d0 2023-10-06T04:29:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.208+0000 7f0043fff700 1 --2- 172.21.15.60:0/3319798578 >> v2:172.21.15.135:3300/0 conn(0x7f00440cc170 0x7f00440b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.208+0000 7f0042ffd700 1 --2- 172.21.15.60:0/3319798578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00440b35d0 0x7f00440cbc30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f004415cef0 tx=0x7f0038009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b2bfe67fe0199d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.208+0000 7f00427fc700 1 -- 172.21.15.60:0/3319798578 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038009e70 con 0x7f00440b35d0 2023-10-06T04:29:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.208+0000 7f00427fc700 1 -- 172.21.15.60:0/3319798578 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003800b860 con 0x7f00440b35d0 2023-10-06T04:29:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.208+0000 7f00427fc700 1 -- 172.21.15.60:0/3319798578 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003800bc00 con 0x7f00440b35d0 2023-10-06T04:29:01.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.209+0000 7f0048d9d700 1 -- 172.21.15.60:0/3319798578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00440b35d0 msgr2=0x7f00440cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:01.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.209+0000 7f0048d9d700 1 --2- 172.21.15.60:0/3319798578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00440b35d0 0x7f00440cbc30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f004415cef0 tx=0x7f0038009250 comp rx=0 tx=0).stop 2023-10-06T04:29:01.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.209+0000 7f0048d9d700 1 -- 172.21.15.60:0/3319798578 shutdown_connections 2023-10-06T04:29:01.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.209+0000 7f0048d9d700 1 --2- 172.21.15.60:0/3319798578 >> v2:172.21.15.135:3300/0 conn(0x7f00440cc170 0x7f00440b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.209+0000 7f0048d9d700 1 --2- 172.21.15.60:0/3319798578 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0044159440 0x7f00440b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.209+0000 7f0048d9d700 1 --2- 172.21.15.60:0/3319798578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00440b35d0 0x7f00440cbc30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.209+0000 7f0048d9d700 1 -- 172.21.15.60:0/3319798578 >> 172.21.15.60:0/3319798578 conn(0x7f004406ece0 msgr2=0x7f004406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:01.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.209+0000 7f0048d9d700 1 -- 172.21.15.60:0/3319798578 shutdown_connections 2023-10-06T04:29:01.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.209+0000 7f0048d9d700 1 -- 172.21.15.60:0/3319798578 wait complete. 2023-10-06T04:29:01.216 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.210+0000 7f0048d9d700 1 Processor -- start 2023-10-06T04:29:01.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.211+0000 7f0048d9d700 1 -- start start 2023-10-06T04:29:01.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.211+0000 7f0048d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00440b35d0 0x7f0044154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:01.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.211+0000 7f0048d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00440cc170 0x7f00440cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:01.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.212+0000 7f0048d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0044159440 0x7f00440c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:01.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.212+0000 7f0048d9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004415d2d0 con 0x7f00440cc170 2023-10-06T04:29:01.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.212+0000 7f0048d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00440cea00 con 0x7f0044159440 2023-10-06T04:29:01.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.212+0000 7f0048d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00440cece0 con 0x7f00440b35d0 2023-10-06T04:29:01.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.212+0000 7f0042ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00440cc170 0x7f00440cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:01.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.212+0000 7f0042ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00440cc170 0x7f00440cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44828/0 (socket says 172.21.15.60:44828) 2023-10-06T04:29:01.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.212+0000 7f0042ffd700 1 -- 172.21.15.60:0/2081565260 learned_addr learned my addr 172.21.15.60:0/2081565260 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:01.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.212+0000 7f0043fff700 1 --2- 172.21.15.60:0/2081565260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0044159440 0x7f00440c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:01.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.212+0000 7f00437fe700 1 --2- 172.21.15.60:0/2081565260 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00440b35d0 0x7f0044154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:01.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.212+0000 7f0042ffd700 1 -- 172.21.15.60:0/2081565260 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00440b35d0 msgr2=0x7f0044154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:01.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.212+0000 7f0042ffd700 1 --2- 172.21.15.60:0/2081565260 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00440b35d0 0x7f0044154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.212+0000 7f0042ffd700 1 -- 172.21.15.60:0/2081565260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0044159440 msgr2=0x7f00440c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:01.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.212+0000 7f0042ffd700 1 --2- 172.21.15.60:0/2081565260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0044159440 0x7f00440c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.212+0000 7f0042ffd700 1 -- 172.21.15.60:0/2081565260 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00380094f0 con 0x7f00440cc170 2023-10-06T04:29:01.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.212+0000 7f00437fe700 1 --2- 172.21.15.60:0/2081565260 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00440b35d0 0x7f0044154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:01.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.212+0000 7f0042ffd700 1 --2- 172.21.15.60:0/2081565260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00440cc170 0x7f00440cfb30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0038009290 tx=0x7f0038017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:01.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.213+0000 7f002b7fe700 1 -- 172.21.15.60:0/2081565260 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003800bbe0 con 0x7f00440cc170 2023-10-06T04:29:01.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.213+0000 7f002b7fe700 1 -- 172.21.15.60:0/2081565260 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003801f070 con 0x7f00440cc170 2023-10-06T04:29:01.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.213+0000 7f002b7fe700 1 -- 172.21.15.60:0/2081565260 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00380266b0 con 0x7f00440cc170 2023-10-06T04:29:01.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.213+0000 7f0048d9d700 1 -- 172.21.15.60:0/2081565260 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00440cf050 con 0x7f00440cc170 2023-10-06T04:29:01.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.213+0000 7f0048d9d700 1 -- 172.21.15.60:0/2081565260 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00440cf610 con 0x7f00440cc170 2023-10-06T04:29:01.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.214+0000 7f0048d9d700 1 -- 172.21.15.60:0/2081565260 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00440cf850 con 0x7f00440cc170 2023-10-06T04:29:01.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.215+0000 7f002b7fe700 1 -- 172.21.15.60:0/2081565260 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f003801a430 con 0x7f00440cc170 2023-10-06T04:29:01.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.216+0000 7f002b7fe700 1 --2- 172.21.15.60:0/2081565260 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0030066f30 0x7f00300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:01.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.216+0000 7f002b7fe700 1 -- 172.21.15.60:0/2081565260 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f0038021070 con 0x7f00440cc170 2023-10-06T04:29:01.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.216+0000 7f00437fe700 1 --2- 172.21.15.60:0/2081565260 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0030066f30 0x7f00300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:01.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.217+0000 7f00437fe700 1 --2- 172.21.15.60:0/2081565260 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0030066f30 0x7f00300693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0034006f00 tx=0x7f0034008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:01.222 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.220+0000 7f002b7fe700 1 -- 172.21.15.60:0/2081565260 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00440cf850 con 0x7f00440cc170 2023-10-06T04:29:01.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.427+0000 7f0048d9d700 1 -- 172.21.15.60:0/2081565260 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00440cf850 con 0x7f00440cc170 2023-10-06T04:29:01.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.428+0000 7f002b7fe700 1 -- 172.21.15.60:0/2081565260 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18802 (secure 0 0 0) 0x7f00440cf850 con 0x7f00440cc170 2023-10-06T04:29:01.430 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:01.431 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":27,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:28:54.367692+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:28:04.355358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:28:05.208550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:28:08.791979+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.1a","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:29:01.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.430+0000 7f0048d9d700 1 -- 172.21.15.60:0/2081565260 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0030066f30 msgr2=0x7f00300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:01.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.430+0000 7f0048d9d700 1 --2- 172.21.15.60:0/2081565260 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0030066f30 0x7f00300693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0034006f00 tx=0x7f0034008040 comp rx=0 tx=0).stop 2023-10-06T04:29:01.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.430+0000 7f0048d9d700 1 -- 172.21.15.60:0/2081565260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00440cc170 msgr2=0x7f00440cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:01.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.430+0000 7f0048d9d700 1 --2- 172.21.15.60:0/2081565260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00440cc170 0x7f00440cfb30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0038009290 tx=0x7f0038017000 comp rx=0 tx=0).stop 2023-10-06T04:29:01.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.430+0000 7f0048d9d700 1 -- 172.21.15.60:0/2081565260 shutdown_connections 2023-10-06T04:29:01.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.430+0000 7f0048d9d700 1 --2- 172.21.15.60:0/2081565260 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0030066f30 0x7f00300693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.430+0000 7f0048d9d700 1 --2- 172.21.15.60:0/2081565260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0044159440 0x7f00440c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.430+0000 7f0048d9d700 1 --2- 172.21.15.60:0/2081565260 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f00440b35d0 0x7f0044154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.430+0000 7f0048d9d700 1 --2- 172.21.15.60:0/2081565260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00440cc170 0x7f00440cfb30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.430+0000 7f0048d9d700 1 -- 172.21.15.60:0/2081565260 >> 172.21.15.60:0/2081565260 conn(0x7f004406ece0 msgr2=0x7f0044156910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:01.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.430+0000 7f0048d9d700 1 -- 172.21.15.60:0/2081565260 shutdown_connections 2023-10-06T04:29:01.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.430+0000 7f0048d9d700 1 -- 172.21.15.60:0/2081565260 wait complete. 2023-10-06T04:29:01.450 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:27:58.899938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:27:59.373527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:28:04.355358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:28:05.208550+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T04:28:08.791979+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:29:01.451 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:29:01.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.639+0000 7f6ece19d700 1 Processor -- start 2023-10-06T04:29:01.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.639+0000 7f6ece19d700 1 -- start start 2023-10-06T04:29:01.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.640+0000 7f6ece19d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6ec80cd3c0 0x7f6ec80ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:01.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.640+0000 7f6ece19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80b29f0 0x7f6ec80cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:01.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.640+0000 7f6ece19d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec80cc970 con 0x7f6ec80b2620 2023-10-06T04:29:01.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.640+0000 7f6ece19d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec80cf520 con 0x7f6ec80cd3c0 2023-10-06T04:29:01.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.640+0000 7f6ece19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80cbd60 con 0x7f6ec80b29f0 2023-10-06T04:29:01.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.641+0000 7f6ecc99a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6ec80cd3c0 0x7f6ec80ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:01.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.641+0000 7f6ecc99a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6ec80cd3c0 0x7f6ec80ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44842/0 (socket says 172.21.15.60:44842) 2023-10-06T04:29:01.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.641+0000 7f6ecc99a700 1 -- 172.21.15.60:0/1385475991 learned_addr learned my addr 172.21.15.60:0/1385475991 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.641+0000 7f6ecd99c700 1 --2- 172.21.15.60:0/1385475991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80b29f0 0x7f6ec80cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.641+0000 7f6ecc99a700 1 -- 172.21.15.60:0/1385475991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80b29f0 msgr2=0x7f6ec80cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.641+0000 7f6ecc99a700 1 --2- 172.21.15.60:0/1385475991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80b29f0 0x7f6ec80cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.641+0000 7f6ebffff700 1 -- 172.21.15.60:0/1385475991 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776736528 0 0) 0x7f6ec80cc970 con 0x7f6ec80b2620 2023-10-06T04:29:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.641+0000 7f6ecc99a700 1 -- 172.21.15.60:0/1385475991 >> v1:172.21.15.60:6789/0 conn(0x7f6ec80b2620 legacy=0x7f6ec80cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.641+0000 7f6ecc99a700 1 -- 172.21.15.60:0/1385475991 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec80cc040 con 0x7f6ec80cd3c0 2023-10-06T04:29:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.641+0000 7f6ecd99c700 1 --2- 172.21.15.60:0/1385475991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80b29f0 0x7f6ec80cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.641+0000 7f6ecc99a700 1 --2- 172.21.15.60:0/1385475991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec80cd3c0 0x7f6ec80ceaa0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80099b0 tx=0x7f6eb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722746ca189591ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.642+0000 7f6ebffff700 1 -- 172.21.15.60:0/1385475991 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb800b860 con 0x7f6ec80cd3c0 2023-10-06T04:29:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.642+0000 7f6ebffff700 1 -- 172.21.15.60:0/1385475991 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb800b9c0 con 0x7f6ec80cd3c0 2023-10-06T04:29:01.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.642+0000 7f6ebffff700 1 -- 172.21.15.60:0/1385475991 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb800bd60 con 0x7f6ec80cd3c0 2023-10-06T04:29:01.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.642+0000 7f6ece19d700 1 -- 172.21.15.60:0/1385475991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec80cd3c0 msgr2=0x7f6ec80ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:01.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.642+0000 7f6ece19d700 1 --2- 172.21.15.60:0/1385475991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec80cd3c0 0x7f6ec80ceaa0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80099b0 tx=0x7f6eb8009250 comp rx=0 tx=0).stop 2023-10-06T04:29:01.646 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.642+0000 7f6ece19d700 1 -- 172.21.15.60:0/1385475991 shutdown_connections 2023-10-06T04:29:01.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.642+0000 7f6ece19d700 1 --2- 172.21.15.60:0/1385475991 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80b29f0 0x7f6ec80cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.642+0000 7f6ece19d700 1 --2- 172.21.15.60:0/1385475991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec80cd3c0 0x7f6ec80ceaa0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.642+0000 7f6ece19d700 1 -- 172.21.15.60:0/1385475991 >> 172.21.15.60:0/1385475991 conn(0x7f6ec8099520 msgr2=0x7f6ec806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:01.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.642+0000 7f6ece19d700 1 -- 172.21.15.60:0/1385475991 shutdown_connections 2023-10-06T04:29:01.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.642+0000 7f6ece19d700 1 -- 172.21.15.60:0/1385475991 wait complete. 2023-10-06T04:29:01.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.644+0000 7f6ece19d700 1 Processor -- start 2023-10-06T04:29:01.647 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.644+0000 7f6ece19d700 1 -- start start 2023-10-06T04:29:01.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.645+0000 7f6ece19d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec80b2620 0x7f6ec8153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:01.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.645+0000 7f6ece19d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ec80b29f0 0x7f6ec80b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:01.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.645+0000 7f6ece19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80cd3c0 0x7f6ec8157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:01.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.645+0000 7f6ece19d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec8159df0 con 0x7f6ec80b2620 2023-10-06T04:29:01.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.645+0000 7f6ece19d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80b4160 con 0x7f6ec80b29f0 2023-10-06T04:29:01.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.645+0000 7f6ece19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec815ac50 con 0x7f6ec80cd3c0 2023-10-06T04:29:01.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.645+0000 7f6ecd19b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec80b2620 0x7f6ec8153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:01.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.645+0000 7f6ecd19b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec80b2620 0x7f6ec8153240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44846/0 (socket says 172.21.15.60:44846) 2023-10-06T04:29:01.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.645+0000 7f6ecd19b700 1 -- 172.21.15.60:0/513158671 learned_addr learned my addr 172.21.15.60:0/513158671 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:01.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.645+0000 7f6ecc99a700 1 --2- 172.21.15.60:0/513158671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ec80b29f0 0x7f6ec80b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:01.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.645+0000 7f6ecd99c700 1 --2- 172.21.15.60:0/513158671 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80cd3c0 0x7f6ec8157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:01.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.646+0000 7f6ecd19b700 1 -- 172.21.15.60:0/513158671 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80cd3c0 msgr2=0x7f6ec8157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:01.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.646+0000 7f6ecd19b700 1 --2- 172.21.15.60:0/513158671 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80cd3c0 0x7f6ec8157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.646+0000 7f6ecd19b700 1 -- 172.21.15.60:0/513158671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ec80b29f0 msgr2=0x7f6ec80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:01.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.646+0000 7f6ecd19b700 1 --2- 172.21.15.60:0/513158671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ec80b29f0 0x7f6ec80b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.646+0000 7f6ecd19b700 1 -- 172.21.15.60:0/513158671 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb80094f0 con 0x7f6ec80b2620 2023-10-06T04:29:01.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.646+0000 7f6ecd99c700 1 --2- 172.21.15.60:0/513158671 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80cd3c0 0x7f6ec8157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:01.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.646+0000 7f6ecd19b700 1 --2- 172.21.15.60:0/513158671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec80b2620 0x7f6ec8153240 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400c590 tx=0x7f6ec4001050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:01.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.646+0000 7f6ebd7fa700 1 -- 172.21.15.60:0/513158671 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec400e4a0 con 0x7f6ec80b2620 2023-10-06T04:29:01.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.646+0000 7f6ebd7fa700 1 -- 172.21.15.60:0/513158671 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec400e620 con 0x7f6ec80b2620 2023-10-06T04:29:01.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.646+0000 7f6ebd7fa700 1 -- 172.21.15.60:0/513158671 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec400e9e0 con 0x7f6ec80b2620 2023-10-06T04:29:01.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.646+0000 7f6ece19d700 1 -- 172.21.15.60:0/513158671 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec80b38c0 con 0x7f6ec80b2620 2023-10-06T04:29:01.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.646+0000 7f6ece19d700 1 -- 172.21.15.60:0/513158671 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec80b3e80 con 0x7f6ec80b2620 2023-10-06T04:29:01.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.647+0000 7f6ece19d700 1 -- 172.21.15.60:0/513158671 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec805f230 con 0x7f6ec80b2620 2023-10-06T04:29:01.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.648+0000 7f6ebd7fa700 1 -- 172.21.15.60:0/513158671 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ec401b3b0 con 0x7f6ec80b2620 2023-10-06T04:29:01.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.649+0000 7f6ebd7fa700 1 --2- 172.21.15.60:0/513158671 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6eac066f30 0x7f6eac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:01.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.649+0000 7f6ebd7fa700 1 -- 172.21.15.60:0/513158671 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f6ec4084090 con 0x7f6ec80b2620 2023-10-06T04:29:01.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.649+0000 7f6ecc99a700 1 --2- 172.21.15.60:0/513158671 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6eac066f30 0x7f6eac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:01.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.650+0000 7f6ecc99a700 1 --2- 172.21.15.60:0/513158671 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6eac066f30 0x7f6eac0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80099b0 tx=0x7f6eb8017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:01.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.653+0000 7f6ebd7fa700 1 -- 172.21.15.60:0/513158671 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ec4050dd0 con 0x7f6ec80b2620 2023-10-06T04:29:01.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.859+0000 7f6ece19d700 1 -- 172.21.15.60:0/513158671 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6ec80cc320 con 0x7f6ec80b2620 2023-10-06T04:29:01.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.859+0000 7f6ebd7fa700 1 -- 172.21.15.60:0/513158671 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6ec4017020 con 0x7f6ec80b2620 2023-10-06T04:29:01.862 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-10-06T04:29:01.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.862+0000 7f6ece19d700 1 -- 172.21.15.60:0/513158671 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6eac066f30 msgr2=0x7f6eac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:01.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.862+0000 7f6ece19d700 1 --2- 172.21.15.60:0/513158671 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6eac066f30 0x7f6eac0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80099b0 tx=0x7f6eb8017000 comp rx=0 tx=0).stop 2023-10-06T04:29:01.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.862+0000 7f6ece19d700 1 -- 172.21.15.60:0/513158671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec80b2620 msgr2=0x7f6ec8153240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:01.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.862+0000 7f6ece19d700 1 --2- 172.21.15.60:0/513158671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec80b2620 0x7f6ec8153240 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400c590 tx=0x7f6ec4001050 comp rx=0 tx=0).stop 2023-10-06T04:29:01.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.862+0000 7f6ece19d700 1 -- 172.21.15.60:0/513158671 shutdown_connections 2023-10-06T04:29:01.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.862+0000 7f6ece19d700 1 --2- 172.21.15.60:0/513158671 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6eac066f30 0x7f6eac0693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.862+0000 7f6ece19d700 1 --2- 172.21.15.60:0/513158671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ec80b2620 0x7f6ec8153240 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.862+0000 7f6ece19d700 1 --2- 172.21.15.60:0/513158671 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6ec80cd3c0 0x7f6ec8157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.862+0000 7f6ece19d700 1 --2- 172.21.15.60:0/513158671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ec80b29f0 0x7f6ec80b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:01.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.862+0000 7f6ece19d700 1 -- 172.21.15.60:0/513158671 >> 172.21.15.60:0/513158671 conn(0x7f6ec8099520 msgr2=0x7f6ec81575e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:01.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.862+0000 7f6ece19d700 1 -- 172.21.15.60:0/513158671 shutdown_connections 2023-10-06T04:29:01.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:01.862+0000 7f6ece19d700 1 -- 172.21.15.60:0/513158671 wait complete. 2023-10-06T04:29:01.882 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:29:02.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.068+0000 7f70fd99d700 1 Processor -- start 2023-10-06T04:29:02.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.068+0000 7f70fd99d700 1 -- start start 2023-10-06T04:29:02.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.069+0000 7f70fd99d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f70f8154a90 0x7f70f80b1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:02.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.069+0000 7f70fd99d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f70f8154e60 0x7f70f80adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:02.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.069+0000 7f70fd99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70f80adfe0 0x7f70f815ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:02.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.069+0000 7f70fd99d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f80ae460 con 0x7f70f8154a90 2023-10-06T04:29:02.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.069+0000 7f70fd99d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f806ef10 con 0x7f70f8154e60 2023-10-06T04:29:02.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.069+0000 7f70fd99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f806e300 con 0x7f70f80adfe0 2023-10-06T04:29:02.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.070+0000 7f70fc99b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f70f8154a90 0x7f70f80b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:02.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.070+0000 7f70fc99b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f70f8154a90 0x7f70f80b1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44856/0 (socket says 172.21.15.60:44856) 2023-10-06T04:29:02.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.070+0000 7f70fc99b700 1 -- 172.21.15.60:0/857886500 learned_addr learned my addr 172.21.15.60:0/857886500 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:02.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.070+0000 7f70f7fff700 1 --2- 172.21.15.60:0/857886500 >> v2:172.21.15.135:3300/0 conn(0x7f70f8154e60 0x7f70f80adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:02.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.070+0000 7f70fd19c700 1 --2- 172.21.15.60:0/857886500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70f80adfe0 0x7f70f815ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:02.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.070+0000 7f70fc99b700 1 -- 172.21.15.60:0/857886500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70f80adfe0 msgr2=0x7f70f815ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:02.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.070+0000 7f70fc99b700 1 --2- 172.21.15.60:0/857886500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70f80adfe0 0x7f70f815ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.070+0000 7f70fc99b700 1 -- 172.21.15.60:0/857886500 >> v2:172.21.15.135:3300/0 conn(0x7f70f8154e60 msgr2=0x7f70f80adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:02.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.070+0000 7f70fc99b700 1 --2- 172.21.15.60:0/857886500 >> v2:172.21.15.135:3300/0 conn(0x7f70f8154e60 0x7f70f80adaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.070+0000 7f70fc99b700 1 -- 172.21.15.60:0/857886500 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f806e5e0 con 0x7f70f8154a90 2023-10-06T04:29:02.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.070+0000 7f70fd19c700 1 --2- 172.21.15.60:0/857886500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70f80adfe0 0x7f70f815ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:02.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.071+0000 7f70fc99b700 1 --2- 172.21.15.60:0/857886500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f8154a90 0x7f70f80b1590 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f70f80ad040 tx=0x7f70ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cda59c3b30eb4e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:02.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.071+0000 7f70f77fe700 1 -- 172.21.15.60:0/857886500 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec00b860 con 0x7f70f8154a90 2023-10-06T04:29:02.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.071+0000 7f70f77fe700 1 -- 172.21.15.60:0/857886500 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec00b9c0 con 0x7f70f8154a90 2023-10-06T04:29:02.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.071+0000 7f70f77fe700 1 -- 172.21.15.60:0/857886500 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec00bd60 con 0x7f70f8154a90 2023-10-06T04:29:02.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.071+0000 7f70fd99d700 1 -- 172.21.15.60:0/857886500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f8154a90 msgr2=0x7f70f80b1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:02.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.071+0000 7f70fd99d700 1 --2- 172.21.15.60:0/857886500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f8154a90 0x7f70f80b1590 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f70f80ad040 tx=0x7f70ec009250 comp rx=0 tx=0).stop 2023-10-06T04:29:02.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.071+0000 7f70fd99d700 1 -- 172.21.15.60:0/857886500 shutdown_connections 2023-10-06T04:29:02.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.071+0000 7f70fd99d700 1 --2- 172.21.15.60:0/857886500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70f80adfe0 0x7f70f815ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.071+0000 7f70fd99d700 1 --2- 172.21.15.60:0/857886500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f8154a90 0x7f70f80b1590 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.071+0000 7f70fd99d700 1 --2- 172.21.15.60:0/857886500 >> v2:172.21.15.135:3300/0 conn(0x7f70f8154e60 0x7f70f80adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.071+0000 7f70fd99d700 1 -- 172.21.15.60:0/857886500 >> 172.21.15.60:0/857886500 conn(0x7f70f80cbed0 msgr2=0x7f70f80cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:02.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.072+0000 7f70fd99d700 1 -- 172.21.15.60:0/857886500 shutdown_connections 2023-10-06T04:29:02.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.072+0000 7f70fd99d700 1 -- 172.21.15.60:0/857886500 wait complete. 2023-10-06T04:29:02.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.073+0000 7f70fd99d700 1 Processor -- start 2023-10-06T04:29:02.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.073+0000 7f70fd99d700 1 -- start start 2023-10-06T04:29:02.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.074+0000 7f70fd99d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f80adfe0 0x7f70f8150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:02.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.074+0000 7f70fd99d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f8154a90 0x7f70f815e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:02.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.074+0000 7f70fd99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70f8154e60 0x7f70f815ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:02.080 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.074+0000 7f70fd99d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f815cd90 con 0x7f70f80adfe0 2023-10-06T04:29:02.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.074+0000 7f70fd99d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f815c900 con 0x7f70f8154a90 2023-10-06T04:29:02.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.074+0000 7f70fd99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f815c010 con 0x7f70f8154e60 2023-10-06T04:29:02.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.074+0000 7f70fc99b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f80adfe0 0x7f70f8150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:02.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.074+0000 7f70fc99b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f80adfe0 0x7f70f8150680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44858/0 (socket says 172.21.15.60:44858) 2023-10-06T04:29:02.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.074+0000 7f70fc99b700 1 -- 172.21.15.60:0/1563494228 learned_addr learned my addr 172.21.15.60:0/1563494228 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:02.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.074+0000 7f70f7fff700 1 --2- 172.21.15.60:0/1563494228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f8154a90 0x7f70f815e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:02.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.074+0000 7f70fd19c700 1 --2- 172.21.15.60:0/1563494228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70f8154e60 0x7f70f815ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:02.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.075+0000 7f70fc99b700 1 -- 172.21.15.60:0/1563494228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70f8154e60 msgr2=0x7f70f815ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:02.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.075+0000 7f70fc99b700 1 --2- 172.21.15.60:0/1563494228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70f8154e60 0x7f70f815ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.075+0000 7f70fc99b700 1 -- 172.21.15.60:0/1563494228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f8154a90 msgr2=0x7f70f815e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:02.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.075+0000 7f70fc99b700 1 --2- 172.21.15.60:0/1563494228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f8154a90 0x7f70f815e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.075+0000 7f70fc99b700 1 -- 172.21.15.60:0/1563494228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec0094f0 con 0x7f70f80adfe0 2023-10-06T04:29:02.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.075+0000 7f70fc99b700 1 --2- 172.21.15.60:0/1563494228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f80adfe0 0x7f70f8150680 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f70f806cdb0 tx=0x7f70ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:02.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.075+0000 7f70f4ff9700 1 -- 172.21.15.60:0/1563494228 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec011dc0 con 0x7f70f80adfe0 2023-10-06T04:29:02.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.075+0000 7f70f4ff9700 1 -- 172.21.15.60:0/1563494228 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec024440 con 0x7f70f80adfe0 2023-10-06T04:29:02.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.075+0000 7f70f4ff9700 1 -- 172.21.15.60:0/1563494228 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec024800 con 0x7f70f80adfe0 2023-10-06T04:29:02.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.075+0000 7f70fd99d700 1 -- 172.21.15.60:0/1563494228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f80c2800 con 0x7f70f80adfe0 2023-10-06T04:29:02.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.076+0000 7f70fd99d700 1 -- 172.21.15.60:0/1563494228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f815db80 con 0x7f70f80adfe0 2023-10-06T04:29:02.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.076+0000 7f70fd99d700 1 -- 172.21.15.60:0/1563494228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f805f230 con 0x7f70f80adfe0 2023-10-06T04:29:02.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.077+0000 7f70f4ff9700 1 -- 172.21.15.60:0/1563494228 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f70ec01a420 con 0x7f70f80adfe0 2023-10-06T04:29:02.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.078+0000 7f70f4ff9700 1 --2- 172.21.15.60:0/1563494228 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f70dc066f30 0x7f70dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:02.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.078+0000 7f70f4ff9700 1 -- 172.21.15.60:0/1563494228 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f70ec0868d0 con 0x7f70f80adfe0 2023-10-06T04:29:02.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.078+0000 7f70f7fff700 1 --2- 172.21.15.60:0/1563494228 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f70dc066f30 0x7f70dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:02.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.079+0000 7f70f7fff700 1 --2- 172.21.15.60:0/1563494228 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f70dc066f30 0x7f70dc0693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f70f815e280 tx=0x7f70e4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:02.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.082+0000 7f70f4ff9700 1 -- 172.21.15.60:0/1563494228 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70ec053610 con 0x7f70f80adfe0 2023-10-06T04:29:02.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.284+0000 7f70fd99d700 1 -- 172.21.15.60:0/1563494228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f70f806e8c0 con 0x7f70f80adfe0 2023-10-06T04:29:02.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.284+0000 7f70f4ff9700 1 -- 172.21.15.60:0/1563494228 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f70ec056c30 con 0x7f70f80adfe0 2023-10-06T04:29:02.287 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-06T04:29:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.286+0000 7f70fd99d700 1 -- 172.21.15.60:0/1563494228 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f70dc066f30 msgr2=0x7f70dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.286+0000 7f70fd99d700 1 --2- 172.21.15.60:0/1563494228 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f70dc066f30 0x7f70dc0693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f70f815e280 tx=0x7f70e4008040 comp rx=0 tx=0).stop 2023-10-06T04:29:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.286+0000 7f70fd99d700 1 -- 172.21.15.60:0/1563494228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f80adfe0 msgr2=0x7f70f8150680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.286+0000 7f70fd99d700 1 --2- 172.21.15.60:0/1563494228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f80adfe0 0x7f70f8150680 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f70f806cdb0 tx=0x7f70ec017000 comp rx=0 tx=0).stop 2023-10-06T04:29:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.286+0000 7f70fd99d700 1 -- 172.21.15.60:0/1563494228 shutdown_connections 2023-10-06T04:29:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.286+0000 7f70fd99d700 1 --2- 172.21.15.60:0/1563494228 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f70dc066f30 0x7f70dc0693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.286+0000 7f70fd99d700 1 --2- 172.21.15.60:0/1563494228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70f80adfe0 0x7f70f8150680 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.286+0000 7f70fd99d700 1 --2- 172.21.15.60:0/1563494228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f70f8154e60 0x7f70f815ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.286+0000 7f70fd99d700 1 --2- 172.21.15.60:0/1563494228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f8154a90 0x7f70f815e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.286+0000 7f70fd99d700 1 -- 172.21.15.60:0/1563494228 >> 172.21.15.60:0/1563494228 conn(0x7f70f80cbed0 msgr2=0x7f70f80ad290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:02.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.287+0000 7f70fd99d700 1 -- 172.21.15.60:0/1563494228 shutdown_connections 2023-10-06T04:29:02.290 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.287+0000 7f70fd99d700 1 -- 172.21.15.60:0/1563494228 wait complete. 2023-10-06T04:29:02.306 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:29:02.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.497+0000 7f1486fff700 1 Processor -- start 2023-10-06T04:29:02.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.497+0000 7f1486fff700 1 -- start start 2023-10-06T04:29:02.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.498+0000 7f1486fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f14800c7ac0 0x7f14800c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:02.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.498+0000 7f1486fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f148006e340 0x7f148015a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:02.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.498+0000 7f1486fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148006e7c0 con 0x7f148013f6f0 2023-10-06T04:29:02.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.498+0000 7f1486fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148015ade0 con 0x7f14800c7ac0 2023-10-06T04:29:02.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.498+0000 7f1486fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148006ea20 con 0x7f148006e340 2023-10-06T04:29:02.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.498+0000 7f1484d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f14800c7ac0 0x7f14800c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:02.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.498+0000 7f1484d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f14800c7ac0 0x7f14800c7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44866/0 (socket says 172.21.15.60:44866) 2023-10-06T04:29:02.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.498+0000 7f1484d9b700 1 -- 172.21.15.60:0/2862436362 learned_addr learned my addr 172.21.15.60:0/2862436362 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:02.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.499+0000 7f147ffff700 1 --2- 172.21.15.60:0/2862436362 >> v2:172.21.15.135:3300/0 conn(0x7f148006e340 0x7f148015a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:02.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.499+0000 7f1484d9b700 1 -- 172.21.15.60:0/2862436362 >> v2:172.21.15.135:3300/0 conn(0x7f148006e340 msgr2=0x7f148015a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:02.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.499+0000 7f1484d9b700 1 --2- 172.21.15.60:0/2862436362 >> v2:172.21.15.135:3300/0 conn(0x7f148006e340 0x7f148015a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.499+0000 7f1484d9b700 1 -- 172.21.15.60:0/2862436362 >> v1:172.21.15.135:6789/0 conn(0x7f148013f6f0 legacy=0x7f14800c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:02.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.499+0000 7f1484d9b700 1 -- 172.21.15.60:0/2862436362 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148006ed00 con 0x7f14800c7ac0 2023-10-06T04:29:02.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.499+0000 7f147ffff700 1 --2- 172.21.15.60:0/2862436362 >> v2:172.21.15.135:3300/0 conn(0x7f148006e340 0x7f148015a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:02.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.499+0000 7f1484d9b700 1 --2- 172.21.15.60:0/2862436362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14800c7ac0 0x7f14800c7e90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f148006dc80 tx=0x7f1474009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f93e1726d5729a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:02.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.499+0000 7f147f7fe700 1 -- 172.21.15.60:0/2862436362 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147400b820 con 0x7f14800c7ac0 2023-10-06T04:29:02.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.499+0000 7f147f7fe700 1 -- 172.21.15.60:0/2862436362 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147400b980 con 0x7f14800c7ac0 2023-10-06T04:29:02.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.499+0000 7f147f7fe700 1 -- 172.21.15.60:0/2862436362 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147400bd20 con 0x7f14800c7ac0 2023-10-06T04:29:02.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.500+0000 7f1486fff700 1 -- 172.21.15.60:0/2862436362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14800c7ac0 msgr2=0x7f14800c7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:02.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.500+0000 7f1486fff700 1 --2- 172.21.15.60:0/2862436362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14800c7ac0 0x7f14800c7e90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f148006dc80 tx=0x7f1474009250 comp rx=0 tx=0).stop 2023-10-06T04:29:02.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.500+0000 7f1486fff700 1 -- 172.21.15.60:0/2862436362 shutdown_connections 2023-10-06T04:29:02.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.500+0000 7f1486fff700 1 --2- 172.21.15.60:0/2862436362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14800c7ac0 0x7f14800c7e90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.500+0000 7f1486fff700 1 --2- 172.21.15.60:0/2862436362 >> v2:172.21.15.135:3300/0 conn(0x7f148006e340 0x7f148015a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.500+0000 7f1486fff700 1 -- 172.21.15.60:0/2862436362 >> 172.21.15.60:0/2862436362 conn(0x7f14800cc0a0 msgr2=0x7f14800cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:02.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.500+0000 7f1486fff700 1 -- 172.21.15.60:0/2862436362 shutdown_connections 2023-10-06T04:29:02.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.500+0000 7f1486fff700 1 -- 172.21.15.60:0/2862436362 wait complete. 2023-10-06T04:29:02.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.501+0000 7f1486fff700 1 Processor -- start 2023-10-06T04:29:02.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.502+0000 7f1486fff700 1 -- start start 2023-10-06T04:29:02.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.503+0000 7f1486fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f148006e340 0x7f14800c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:02.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.503+0000 7f1486fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14800c7ac0 0x7f1480157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:02.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.503+0000 7f1486fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f148013f6f0 0x7f14800c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:02.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.503+0000 7f1486fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14800ae0f0 con 0x7f148006e340 2023-10-06T04:29:02.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.503+0000 7f1486fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14800ae3d0 con 0x7f14800c7ac0 2023-10-06T04:29:02.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.503+0000 7f1486fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14800c5cb0 con 0x7f148013f6f0 2023-10-06T04:29:02.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.503+0000 7f1484d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f148006e340 0x7f14800c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:02.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.503+0000 7f1484d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f148006e340 0x7f14800c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44876/0 (socket says 172.21.15.60:44876) 2023-10-06T04:29:02.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.503+0000 7f1484d9b700 1 -- 172.21.15.60:0/558625403 learned_addr learned my addr 172.21.15.60:0/558625403 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:02.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.503+0000 7f1484d9b700 1 -- 172.21.15.60:0/558625403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f148013f6f0 msgr2=0x7f14800c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:02.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.503+0000 7f1484d9b700 1 --2- 172.21.15.60:0/558625403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f148013f6f0 0x7f14800c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.503+0000 7f1484d9b700 1 -- 172.21.15.60:0/558625403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14800c7ac0 msgr2=0x7f1480157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:02.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.503+0000 7f1484d9b700 1 --2- 172.21.15.60:0/558625403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14800c7ac0 0x7f1480157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.503+0000 7f1484d9b700 1 -- 172.21.15.60:0/558625403 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14740094f0 con 0x7f148006e340 2023-10-06T04:29:02.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.504+0000 7f1484d9b700 1 --2- 172.21.15.60:0/558625403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f148006e340 0x7f14800c7110 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f14740030c0 tx=0x7f1474016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:02.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.504+0000 7f147cff9700 1 -- 172.21.15.60:0/558625403 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474011e60 con 0x7f148006e340 2023-10-06T04:29:02.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.504+0000 7f147cff9700 1 -- 172.21.15.60:0/558625403 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1474020070 con 0x7f148006e340 2023-10-06T04:29:02.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.504+0000 7f1486fff700 1 -- 172.21.15.60:0/558625403 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14800c5f90 con 0x7f148006e340 2023-10-06T04:29:02.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.504+0000 7f147cff9700 1 -- 172.21.15.60:0/558625403 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147401b6a0 con 0x7f148006e340 2023-10-06T04:29:02.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.504+0000 7f1486fff700 1 -- 172.21.15.60:0/558625403 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14800a98a0 con 0x7f148006e340 2023-10-06T04:29:02.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.505+0000 7f1486fff700 1 -- 172.21.15.60:0/558625403 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14800ae230 con 0x7f148006e340 2023-10-06T04:29:02.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.506+0000 7f147cff9700 1 -- 172.21.15.60:0/558625403 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1474022030 con 0x7f148006e340 2023-10-06T04:29:02.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.506+0000 7f147cff9700 1 --2- 172.21.15.60:0/558625403 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1464066f30 0x7f14640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:02.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.507+0000 7f147cff9700 1 -- 172.21.15.60:0/558625403 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f14740869e0 con 0x7f148006e340 2023-10-06T04:29:02.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.507+0000 7f147ffff700 1 --2- 172.21.15.60:0/558625403 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1464066f30 0x7f14640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:02.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.507+0000 7f147ffff700 1 --2- 172.21.15.60:0/558625403 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1464066f30 0x7f14640693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f146c006fd0 tx=0x7f146c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:02.513 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.511+0000 7f147cff9700 1 -- 172.21.15.60:0/558625403 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14800ae230 con 0x7f148006e340 2023-10-06T04:29:02.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.713+0000 7f1486fff700 1 -- 172.21.15.60:0/558625403 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f14800c64d0 con 0x7f148006e340 2023-10-06T04:29:02.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.713+0000 7f147cff9700 1 -- 172.21.15.60:0/558625403 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f14800c64d0 con 0x7f148006e340 2023-10-06T04:29:02.716 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-06T04:29:02.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.715+0000 7f1486fff700 1 -- 172.21.15.60:0/558625403 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1464066f30 msgr2=0x7f14640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:02.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.715+0000 7f1486fff700 1 --2- 172.21.15.60:0/558625403 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1464066f30 0x7f14640693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f146c006fd0 tx=0x7f146c008040 comp rx=0 tx=0).stop 2023-10-06T04:29:02.718 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.715+0000 7f1486fff700 1 -- 172.21.15.60:0/558625403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f148006e340 msgr2=0x7f14800c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:02.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.715+0000 7f1486fff700 1 --2- 172.21.15.60:0/558625403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f148006e340 0x7f14800c7110 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f14740030c0 tx=0x7f1474016000 comp rx=0 tx=0).stop 2023-10-06T04:29:02.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.715+0000 7f1486fff700 1 -- 172.21.15.60:0/558625403 shutdown_connections 2023-10-06T04:29:02.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.715+0000 7f1486fff700 1 --2- 172.21.15.60:0/558625403 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1464066f30 0x7f14640693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.715+0000 7f1486fff700 1 --2- 172.21.15.60:0/558625403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f148006e340 0x7f14800c7110 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.715+0000 7f1486fff700 1 --2- 172.21.15.60:0/558625403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f148013f6f0 0x7f14800c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.715+0000 7f1486fff700 1 --2- 172.21.15.60:0/558625403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14800c7ac0 0x7f1480157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.716+0000 7f1486fff700 1 -- 172.21.15.60:0/558625403 >> 172.21.15.60:0/558625403 conn(0x7f14800cc0a0 msgr2=0x7f14801586f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:02.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.716+0000 7f1486fff700 1 -- 172.21.15.60:0/558625403 shutdown_connections 2023-10-06T04:29:02.719 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.716+0000 7f1486fff700 1 -- 172.21.15.60:0/558625403 wait complete. 2023-10-06T04:29:02.737 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:29:02.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.924+0000 7f640679d700 1 Processor -- start 2023-10-06T04:29:02.927 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.925+0000 7f640679d700 1 -- start start 2023-10-06T04:29:02.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.926+0000 7f640679d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f64001560f0 0x7f6400159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:02.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.926+0000 7f640679d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f640006e160 0x7f640006e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:02.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.926+0000 7f640679d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640006eb00 con 0x7f64000ae0b0 2023-10-06T04:29:02.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.926+0000 7f640679d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64000acad0 con 0x7f64001560f0 2023-10-06T04:29:02.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.926+0000 7f640679d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64001564c0 con 0x7f640006e160 2023-10-06T04:29:02.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.926+0000 7f640579b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f64001560f0 0x7f6400159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:02.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.926+0000 7f640579b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f64001560f0 0x7f6400159c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52700/0 (socket says 172.21.15.60:52700) 2023-10-06T04:29:02.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.926+0000 7f640579b700 1 -- 172.21.15.60:0/2770410605 learned_addr learned my addr 172.21.15.60:0/2770410605 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:02.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.926+0000 7f6404f9a700 1 --1- 172.21.15.60:0/2770410605 >> v1:172.21.15.60:6789/0 conn(0x7f64000ae0b0 0x7f64000c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33062/0 (socket says 172.21.15.60:33062) 2023-10-06T04:29:02.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.926+0000 7f6405f9c700 1 --2- 172.21.15.60:0/2770410605 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f640006e160 0x7f640006e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:02.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.927+0000 7f640579b700 1 -- 172.21.15.60:0/2770410605 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f640006e160 msgr2=0x7f640006e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:02.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.927+0000 7f640579b700 1 --2- 172.21.15.60:0/2770410605 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f640006e160 0x7f640006e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.927+0000 7f640579b700 1 -- 172.21.15.60:0/2770410605 >> v1:172.21.15.60:6789/0 conn(0x7f64000ae0b0 legacy=0x7f64000c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:02.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.927+0000 7f640579b700 1 -- 172.21.15.60:0/2770410605 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640015a2d0 con 0x7f64001560f0 2023-10-06T04:29:02.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.927+0000 7f63f7fff700 1 -- 172.21.15.60:0/2770410605 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190960322 0 0) 0x7f63f0001110 con 0x7f64000ae0b0 2023-10-06T04:29:02.930 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.927+0000 7f640579b700 1 --2- 172.21.15.60:0/2770410605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64001560f0 0x7f6400159c60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0099b0 tx=0x7f63fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a72dabceb5a35d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:02.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.927+0000 7f63f7fff700 1 -- 172.21.15.60:0/2770410605 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63fc00b860 con 0x7f64001560f0 2023-10-06T04:29:02.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.927+0000 7f63f7fff700 1 -- 172.21.15.60:0/2770410605 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63fc00b9c0 con 0x7f64001560f0 2023-10-06T04:29:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.927+0000 7f63f7fff700 1 -- 172.21.15.60:0/2770410605 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63fc00bd60 con 0x7f64001560f0 2023-10-06T04:29:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.928+0000 7f640679d700 1 -- 172.21.15.60:0/2770410605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64001560f0 msgr2=0x7f6400159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.928+0000 7f640679d700 1 --2- 172.21.15.60:0/2770410605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64001560f0 0x7f6400159c60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0099b0 tx=0x7f63fc009250 comp rx=0 tx=0).stop 2023-10-06T04:29:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.928+0000 7f640679d700 1 -- 172.21.15.60:0/2770410605 shutdown_connections 2023-10-06T04:29:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.928+0000 7f640679d700 1 --2- 172.21.15.60:0/2770410605 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f640006e160 0x7f640006e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.928+0000 7f640679d700 1 --2- 172.21.15.60:0/2770410605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64001560f0 0x7f6400159c60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.928+0000 7f640679d700 1 -- 172.21.15.60:0/2770410605 >> 172.21.15.60:0/2770410605 conn(0x7f64000cbed0 msgr2=0x7f64000cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.928+0000 7f640679d700 1 -- 172.21.15.60:0/2770410605 shutdown_connections 2023-10-06T04:29:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.928+0000 7f640679d700 1 -- 172.21.15.60:0/2770410605 wait complete. 2023-10-06T04:29:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.929+0000 7f640679d700 1 Processor -- start 2023-10-06T04:29:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.929+0000 7f640679d700 1 -- start start 2023-10-06T04:29:02.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.930+0000 7f640679d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f640006e160 0x7f6400159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:02.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.930+0000 7f640679d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64000ae0b0 0x7f64000c1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:02.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.930+0000 7f640679d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64001560f0 0x7f64000c2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:02.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.930+0000 7f640679d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64000c1bc0 con 0x7f64001560f0 2023-10-06T04:29:02.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.930+0000 7f640679d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6400156690 con 0x7f64000ae0b0 2023-10-06T04:29:02.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.930+0000 7f640679d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64001568e0 con 0x7f640006e160 2023-10-06T04:29:02.934 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.930+0000 7f6405f9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64001560f0 0x7f64000c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.931+0000 7f6405f9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64001560f0 0x7f64000c2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52708/0 (socket says 172.21.15.60:52708) 2023-10-06T04:29:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.931+0000 7f6405f9c700 1 -- 172.21.15.60:0/627819620 learned_addr learned my addr 172.21.15.60:0/627819620 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.931+0000 7f6405f9c700 1 -- 172.21.15.60:0/627819620 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f640006e160 msgr2=0x7f6400159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.931+0000 7f6405f9c700 1 --2- 172.21.15.60:0/627819620 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f640006e160 0x7f6400159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.931+0000 7f6405f9c700 1 -- 172.21.15.60:0/627819620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64000ae0b0 msgr2=0x7f64000c1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.931+0000 7f6404f9a700 1 --2- 172.21.15.60:0/627819620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64000ae0b0 0x7f64000c1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.931+0000 7f6405f9c700 1 --2- 172.21.15.60:0/627819620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64000ae0b0 0x7f64000c1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.931+0000 7f6405f9c700 1 -- 172.21.15.60:0/627819620 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc0094f0 con 0x7f64001560f0 2023-10-06T04:29:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.931+0000 7f6404f9a700 1 --2- 172.21.15.60:0/627819620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64000ae0b0 0x7f64000c1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.931+0000 7f6405f9c700 1 --2- 172.21.15.60:0/627819620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64001560f0 0x7f64000c2870 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009fa0 tx=0x7f63f8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:02.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.931+0000 7f63f57fa700 1 -- 172.21.15.60:0/627819620 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f800ed20 con 0x7f64001560f0 2023-10-06T04:29:02.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.931+0000 7f63f57fa700 1 -- 172.21.15.60:0/627819620 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f800ee80 con 0x7f64001560f0 2023-10-06T04:29:02.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.931+0000 7f640679d700 1 -- 172.21.15.60:0/627819620 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6400156bc0 con 0x7f64001560f0 2023-10-06T04:29:02.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.931+0000 7f63f57fa700 1 -- 172.21.15.60:0/627819620 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f8014670 con 0x7f64001560f0 2023-10-06T04:29:02.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.932+0000 7f640679d700 1 -- 172.21.15.60:0/627819620 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6400157180 con 0x7f64001560f0 2023-10-06T04:29:02.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.932+0000 7f640679d700 1 -- 172.21.15.60:0/627819620 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f640005f230 con 0x7f64001560f0 2023-10-06T04:29:02.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.933+0000 7f63f57fa700 1 -- 172.21.15.60:0/627819620 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63f80149e0 con 0x7f64001560f0 2023-10-06T04:29:02.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.934+0000 7f63f57fa700 1 --2- 172.21.15.60:0/627819620 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f63e4066f30 0x7f63e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:02.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.934+0000 7f63f57fa700 1 -- 172.21.15.60:0/627819620 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f63f8085200 con 0x7f64001560f0 2023-10-06T04:29:02.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.934+0000 7f640579b700 1 --2- 172.21.15.60:0/627819620 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f63e4066f30 0x7f63e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:02.937 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.935+0000 7f640579b700 1 --2- 172.21.15.60:0/627819620 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f63e4066f30 0x7f63e40693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0099b0 tx=0x7f63fc017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:02.938+0000 7f63f57fa700 1 -- 172.21.15.60:0/627819620 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63f8051f40 con 0x7f64001560f0 2023-10-06T04:29:03.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.141+0000 7f640679d700 1 -- 172.21.15.60:0/627819620 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f640015a5b0 con 0x7f64001560f0 2023-10-06T04:29:03.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.142+0000 7f63f57fa700 1 -- 172.21.15.60:0/627819620 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f63f8055560 con 0x7f64001560f0 2023-10-06T04:29:03.144 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-06T04:29:03.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.144+0000 7f640679d700 1 -- 172.21.15.60:0/627819620 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f63e4066f30 msgr2=0x7f63e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:03.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.144+0000 7f640679d700 1 --2- 172.21.15.60:0/627819620 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f63e4066f30 0x7f63e40693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0099b0 tx=0x7f63fc017000 comp rx=0 tx=0).stop 2023-10-06T04:29:03.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.144+0000 7f640679d700 1 -- 172.21.15.60:0/627819620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64001560f0 msgr2=0x7f64000c2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:03.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.144+0000 7f640679d700 1 --2- 172.21.15.60:0/627819620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64001560f0 0x7f64000c2870 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009fa0 tx=0x7f63f8009900 comp rx=0 tx=0).stop 2023-10-06T04:29:03.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.144+0000 7f640679d700 1 -- 172.21.15.60:0/627819620 shutdown_connections 2023-10-06T04:29:03.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.144+0000 7f640679d700 1 --2- 172.21.15.60:0/627819620 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f63e4066f30 0x7f63e40693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.144+0000 7f640679d700 1 --2- 172.21.15.60:0/627819620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64001560f0 0x7f64000c2870 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.144+0000 7f640679d700 1 --2- 172.21.15.60:0/627819620 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f640006e160 0x7f6400159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.144+0000 7f640679d700 1 --2- 172.21.15.60:0/627819620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64000ae0b0 0x7f64000c1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.144+0000 7f640679d700 1 -- 172.21.15.60:0/627819620 >> 172.21.15.60:0/627819620 conn(0x7f64000cbed0 msgr2=0x7f6400153130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:03.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.144+0000 7f640679d700 1 -- 172.21.15.60:0/627819620 shutdown_connections 2023-10-06T04:29:03.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.144+0000 7f640679d700 1 -- 172.21.15.60:0/627819620 wait complete. 2023-10-06T04:29:03.164 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T04:29:03.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.353+0000 7f5d0939d700 1 Processor -- start 2023-10-06T04:29:03.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.353+0000 7f5d0939d700 1 -- start start 2023-10-06T04:29:03.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.355+0000 7f5d0939d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5d041560f0 0x7f5d04159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:03.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.355+0000 7f5d0939d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5d040ae0b0 0x7f5d040c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:03.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.355+0000 7f5d0939d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d040c8f30 0x7f5d0406e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:03.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.355+0000 7f5d0939d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d040acad0 con 0x7f5d040ae0b0 2023-10-06T04:29:03.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.355+0000 7f5d0939d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d041564c0 con 0x7f5d041560f0 2023-10-06T04:29:03.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.355+0000 7f5d0939d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0415a2d0 con 0x7f5d040c8f30 2023-10-06T04:29:03.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.355+0000 7f5d037fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5d040ae0b0 0x7f5d040c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.355+0000 7f5d037fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5d040ae0b0 0x7f5d040c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52720/0 (socket says 172.21.15.60:52720) 2023-10-06T04:29:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.355+0000 7f5d037fe700 1 -- 172.21.15.60:0/1034322594 learned_addr learned my addr 172.21.15.60:0/1034322594 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.355+0000 7f5d03fff700 1 --2- 172.21.15.60:0/1034322594 >> v2:172.21.15.135:3300/0 conn(0x7f5d041560f0 0x7f5d04159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.355+0000 7f5d08b9c700 1 --2- 172.21.15.60:0/1034322594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d040c8f30 0x7f5d0406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.355+0000 7f5d037fe700 1 -- 172.21.15.60:0/1034322594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d040c8f30 msgr2=0x7f5d0406e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.355+0000 7f5d037fe700 1 --2- 172.21.15.60:0/1034322594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d040c8f30 0x7f5d0406e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.355+0000 7f5d037fe700 1 -- 172.21.15.60:0/1034322594 >> v2:172.21.15.135:3300/0 conn(0x7f5d041560f0 msgr2=0x7f5d04159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.355+0000 7f5d037fe700 1 --2- 172.21.15.60:0/1034322594 >> v2:172.21.15.135:3300/0 conn(0x7f5d041560f0 0x7f5d04159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.355+0000 7f5d037fe700 1 -- 172.21.15.60:0/1034322594 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0415a5b0 con 0x7f5d040ae0b0 2023-10-06T04:29:03.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.355+0000 7f5d03fff700 1 --2- 172.21.15.60:0/1034322594 >> v2:172.21.15.135:3300/0 conn(0x7f5d041560f0 0x7f5d04159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:03.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.356+0000 7f5d037fe700 1 --2- 172.21.15.60:0/1034322594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d040ae0b0 0x7f5d040c89f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5d040ccfe0 tx=0x7f5cf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72a92129b11701a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:03.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.356+0000 7f5d02ffd700 1 -- 172.21.15.60:0/1034322594 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf800b860 con 0x7f5d040ae0b0 2023-10-06T04:29:03.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.356+0000 7f5d02ffd700 1 -- 172.21.15.60:0/1034322594 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf800b9c0 con 0x7f5d040ae0b0 2023-10-06T04:29:03.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.356+0000 7f5d02ffd700 1 -- 172.21.15.60:0/1034322594 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf800bd60 con 0x7f5d040ae0b0 2023-10-06T04:29:03.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.356+0000 7f5d0939d700 1 -- 172.21.15.60:0/1034322594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d040ae0b0 msgr2=0x7f5d040c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:03.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.356+0000 7f5d0939d700 1 --2- 172.21.15.60:0/1034322594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d040ae0b0 0x7f5d040c89f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5d040ccfe0 tx=0x7f5cf8009250 comp rx=0 tx=0).stop 2023-10-06T04:29:03.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.357+0000 7f5d0939d700 1 -- 172.21.15.60:0/1034322594 shutdown_connections 2023-10-06T04:29:03.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.357+0000 7f5d0939d700 1 --2- 172.21.15.60:0/1034322594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d040c8f30 0x7f5d0406e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.357+0000 7f5d0939d700 1 --2- 172.21.15.60:0/1034322594 >> v2:172.21.15.135:3300/0 conn(0x7f5d041560f0 0x7f5d04159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.357+0000 7f5d0939d700 1 --2- 172.21.15.60:0/1034322594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d040ae0b0 0x7f5d040c89f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.357+0000 7f5d0939d700 1 -- 172.21.15.60:0/1034322594 >> 172.21.15.60:0/1034322594 conn(0x7f5d040cbed0 msgr2=0x7f5d040cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:03.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.357+0000 7f5d0939d700 1 -- 172.21.15.60:0/1034322594 shutdown_connections 2023-10-06T04:29:03.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.357+0000 7f5d0939d700 1 -- 172.21.15.60:0/1034322594 wait complete. 2023-10-06T04:29:03.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.358+0000 7f5d0939d700 1 Processor -- start 2023-10-06T04:29:03.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.358+0000 7f5d0939d700 1 -- start start 2023-10-06T04:29:03.364 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.359+0000 7f5d0939d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d040ae0b0 0x7f5d040c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:03.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.359+0000 7f5d0939d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d040c8f30 0x7f5d040c5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:03.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.359+0000 7f5d0939d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d041560f0 0x7f5d040acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:03.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.359+0000 7f5d0939d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d040c7bc0 con 0x7f5d041560f0 2023-10-06T04:29:03.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.359+0000 7f5d0939d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d040c96f0 con 0x7f5d040c8f30 2023-10-06T04:29:03.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.359+0000 7f5d0939d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d040c99d0 con 0x7f5d040ae0b0 2023-10-06T04:29:03.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.359+0000 7f5d08b9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d041560f0 0x7f5d040acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:03.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.359+0000 7f5d08b9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d041560f0 0x7f5d040acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52732/0 (socket says 172.21.15.60:52732) 2023-10-06T04:29:03.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.359+0000 7f5d08b9c700 1 -- 172.21.15.60:0/2298029457 learned_addr learned my addr 172.21.15.60:0/2298029457 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:03.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.359+0000 7f5d03fff700 1 --2- 172.21.15.60:0/2298029457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d040ae0b0 0x7f5d040c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:03.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.359+0000 7f5d037fe700 1 --2- 172.21.15.60:0/2298029457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d040c8f30 0x7f5d040c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:03.365 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.360+0000 7f5d08b9c700 1 -- 172.21.15.60:0/2298029457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d040ae0b0 msgr2=0x7f5d040c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:03.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.360+0000 7f5d08b9c700 1 --2- 172.21.15.60:0/2298029457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d040ae0b0 0x7f5d040c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.360+0000 7f5d08b9c700 1 -- 172.21.15.60:0/2298029457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d040c8f30 msgr2=0x7f5d040c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:03.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.360+0000 7f5d08b9c700 1 --2- 172.21.15.60:0/2298029457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d040c8f30 0x7f5d040c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.360+0000 7f5d08b9c700 1 -- 172.21.15.60:0/2298029457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf80094f0 con 0x7f5d041560f0 2023-10-06T04:29:03.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.360+0000 7f5d08b9c700 1 --2- 172.21.15.60:0/2298029457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d041560f0 0x7f5d040acc80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc007f20 tx=0x7f5cfc0098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:03.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.360+0000 7f5cebfff700 1 -- 172.21.15.60:0/2298029457 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc00eb90 con 0x7f5d041560f0 2023-10-06T04:29:03.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.360+0000 7f5cebfff700 1 -- 172.21.15.60:0/2298029457 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc00ed10 con 0x7f5d041560f0 2023-10-06T04:29:03.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.360+0000 7f5cebfff700 1 -- 172.21.15.60:0/2298029457 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc014670 con 0x7f5d041560f0 2023-10-06T04:29:03.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.360+0000 7f5d0939d700 1 -- 172.21.15.60:0/2298029457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d040c9cb0 con 0x7f5d041560f0 2023-10-06T04:29:03.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.360+0000 7f5d0939d700 1 -- 172.21.15.60:0/2298029457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d040ca270 con 0x7f5d041560f0 2023-10-06T04:29:03.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.361+0000 7f5d0939d700 1 -- 172.21.15.60:0/2298029457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d040ca460 con 0x7f5d041560f0 2023-10-06T04:29:03.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.362+0000 7f5cebfff700 1 -- 172.21.15.60:0/2298029457 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5cfc014a60 con 0x7f5d041560f0 2023-10-06T04:29:03.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.364+0000 7f5cebfff700 1 --2- 172.21.15.60:0/2298029457 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5cf0066f30 0x7f5cf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:03.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.364+0000 7f5cebfff700 1 -- 172.21.15.60:0/2298029457 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f5cfc085050 con 0x7f5d041560f0 2023-10-06T04:29:03.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.364+0000 7f5d03fff700 1 --2- 172.21.15.60:0/2298029457 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5cf0066f30 0x7f5cf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:03.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.364+0000 7f5d03fff700 1 --2- 172.21.15.60:0/2298029457 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5cf0066f30 0x7f5cf00693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4006f00 tx=0x7f5cf4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:03.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.368+0000 7f5cebfff700 1 -- 172.21.15.60:0/2298029457 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5cfc051d90 con 0x7f5d041560f0 2023-10-06T04:29:03.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.571+0000 7f5d0939d700 1 -- 172.21.15.60:0/2298029457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5d0405f230 con 0x7f5d041560f0 2023-10-06T04:29:03.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.572+0000 7f5cebfff700 1 -- 172.21.15.60:0/2298029457 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5cfc0553b0 con 0x7f5d041560f0 2023-10-06T04:29:03.574 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-06T04:29:03.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.574+0000 7f5d0939d700 1 -- 172.21.15.60:0/2298029457 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5cf0066f30 msgr2=0x7f5cf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:03.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.574+0000 7f5d0939d700 1 --2- 172.21.15.60:0/2298029457 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5cf0066f30 0x7f5cf00693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4006f00 tx=0x7f5cf4008040 comp rx=0 tx=0).stop 2023-10-06T04:29:03.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.574+0000 7f5d0939d700 1 -- 172.21.15.60:0/2298029457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d041560f0 msgr2=0x7f5d040acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:03.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.574+0000 7f5d0939d700 1 --2- 172.21.15.60:0/2298029457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d041560f0 0x7f5d040acc80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc007f20 tx=0x7f5cfc0098a0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.574+0000 7f5d0939d700 1 -- 172.21.15.60:0/2298029457 shutdown_connections 2023-10-06T04:29:03.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.574+0000 7f5d0939d700 1 --2- 172.21.15.60:0/2298029457 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5cf0066f30 0x7f5cf00693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.574+0000 7f5d0939d700 1 --2- 172.21.15.60:0/2298029457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d041560f0 0x7f5d040acc80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.574+0000 7f5d0939d700 1 --2- 172.21.15.60:0/2298029457 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d040ae0b0 0x7f5d040c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.574+0000 7f5d0939d700 1 --2- 172.21.15.60:0/2298029457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d040c8f30 0x7f5d040c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.574+0000 7f5d0939d700 1 -- 172.21.15.60:0/2298029457 >> 172.21.15.60:0/2298029457 conn(0x7f5d040cbed0 msgr2=0x7f5d041509f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:03.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.574+0000 7f5d0939d700 1 -- 172.21.15.60:0/2298029457 shutdown_connections 2023-10-06T04:29:03.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.574+0000 7f5d0939d700 1 -- 172.21.15.60:0/2298029457 wait complete. 2023-10-06T04:29:03.594 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:29:03.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.778+0000 7ff03579d700 1 Processor -- start 2023-10-06T04:29:03.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.779+0000 7ff03579d700 1 -- start start 2023-10-06T04:29:03.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.780+0000 7ff03579d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff03015dc60 0x7ff030158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:03.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.780+0000 7ff03579d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff0300cb180 0x7ff030159430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:03.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.780+0000 7ff03579d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0300cdc20 con 0x7ff0300cadb0 2023-10-06T04:29:03.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.780+0000 7ff03579d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff030159970 con 0x7ff03015dc60 2023-10-06T04:29:03.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.780+0000 7ff03579d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0300cd010 con 0x7ff0300cb180 2023-10-06T04:29:03.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.780+0000 7ff02f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff03015dc60 0x7ff030158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:03.783 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.780+0000 7ff02f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff03015dc60 0x7ff030158ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52736/0 (socket says 172.21.15.60:52736) 2023-10-06T04:29:03.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.780+0000 7ff02f7fe700 1 -- 172.21.15.60:0/2672985148 learned_addr learned my addr 172.21.15.60:0/2672985148 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:03.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.780+0000 7ff034f9c700 1 --2- 172.21.15.60:0/2672985148 >> v2:172.21.15.135:3300/0 conn(0x7ff0300cb180 0x7ff030159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:03.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.781+0000 7ff02f7fe700 1 -- 172.21.15.60:0/2672985148 >> v2:172.21.15.135:3300/0 conn(0x7ff0300cb180 msgr2=0x7ff030159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:03.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.781+0000 7ff02f7fe700 1 --2- 172.21.15.60:0/2672985148 >> v2:172.21.15.135:3300/0 conn(0x7ff0300cb180 0x7ff030159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.781+0000 7ff02f7fe700 1 -- 172.21.15.60:0/2672985148 >> v1:172.21.15.135:6789/0 conn(0x7ff0300cadb0 legacy=0x7ff0300cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:03.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.781+0000 7ff02f7fe700 1 -- 172.21.15.60:0/2672985148 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0300cd2f0 con 0x7ff03015dc60 2023-10-06T04:29:03.784 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.781+0000 7ff02f7fe700 1 --2- 172.21.15.60:0/2672985148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff03015dc60 0x7ff030158ef0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff0300cdb90 tx=0x7ff024009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bae50c773d49a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:03.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.781+0000 7ff02effd700 1 -- 172.21.15.60:0/2672985148 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff024009e70 con 0x7ff03015dc60 2023-10-06T04:29:03.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.781+0000 7ff02effd700 1 -- 172.21.15.60:0/2672985148 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02400b860 con 0x7ff03015dc60 2023-10-06T04:29:03.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.781+0000 7ff02effd700 1 -- 172.21.15.60:0/2672985148 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02400bc00 con 0x7ff03015dc60 2023-10-06T04:29:03.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.782+0000 7ff03579d700 1 -- 172.21.15.60:0/2672985148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff03015dc60 msgr2=0x7ff030158ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:03.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.782+0000 7ff03579d700 1 --2- 172.21.15.60:0/2672985148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff03015dc60 0x7ff030158ef0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff0300cdb90 tx=0x7ff024009250 comp rx=0 tx=0).stop 2023-10-06T04:29:03.785 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.782+0000 7ff03579d700 1 -- 172.21.15.60:0/2672985148 shutdown_connections 2023-10-06T04:29:03.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.782+0000 7ff03579d700 1 --2- 172.21.15.60:0/2672985148 >> v2:172.21.15.135:3300/0 conn(0x7ff0300cb180 0x7ff030159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.782+0000 7ff03579d700 1 --2- 172.21.15.60:0/2672985148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff03015dc60 0x7ff030158ef0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.782+0000 7ff03579d700 1 -- 172.21.15.60:0/2672985148 >> 172.21.15.60:0/2672985148 conn(0x7ff030087fc0 msgr2=0x7ff030097430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:03.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.782+0000 7ff03579d700 1 -- 172.21.15.60:0/2672985148 shutdown_connections 2023-10-06T04:29:03.786 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.782+0000 7ff03579d700 1 -- 172.21.15.60:0/2672985148 wait complete. 2023-10-06T04:29:03.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.783+0000 7ff03579d700 1 Processor -- start 2023-10-06T04:29:03.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.783+0000 7ff03579d700 1 -- start start 2023-10-06T04:29:03.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.784+0000 7ff03579d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0300cadb0 0x7ff0300980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:03.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.784+0000 7ff03579d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0300cb180 0x7ff03009a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:03.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.784+0000 7ff03579d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03015dc60 0x7ff03006b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:03.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.784+0000 7ff03579d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03009b220 con 0x7ff0300cadb0 2023-10-06T04:29:03.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.784+0000 7ff03579d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03009b500 con 0x7ff03015dc60 2023-10-06T04:29:03.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.784+0000 7ff03579d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03009b7e0 con 0x7ff0300cb180 2023-10-06T04:29:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.785+0000 7ff02ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0300cadb0 0x7ff0300980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.785+0000 7ff02ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0300cadb0 0x7ff0300980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52750/0 (socket says 172.21.15.60:52750) 2023-10-06T04:29:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.785+0000 7ff02ffff700 1 -- 172.21.15.60:0/3672760989 learned_addr learned my addr 172.21.15.60:0/3672760989 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.785+0000 7ff02ffff700 1 -- 172.21.15.60:0/3672760989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0300cb180 msgr2=0x7ff03009a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.785+0000 7ff02ffff700 1 --2- 172.21.15.60:0/3672760989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0300cb180 0x7ff03009a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.785+0000 7ff034f9c700 1 --2- 172.21.15.60:0/3672760989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03015dc60 0x7ff03006b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.785+0000 7ff02ffff700 1 -- 172.21.15.60:0/3672760989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03015dc60 msgr2=0x7ff03006b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.785+0000 7ff02ffff700 1 --2- 172.21.15.60:0/3672760989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03015dc60 0x7ff03006b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.785+0000 7ff02ffff700 1 -- 172.21.15.60:0/3672760989 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0240094f0 con 0x7ff0300cadb0 2023-10-06T04:29:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.785+0000 7ff02ffff700 1 --2- 172.21.15.60:0/3672760989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0300cadb0 0x7ff0300980e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff02000c7c0 tx=0x7ff020007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.785+0000 7ff017fff700 1 -- 172.21.15.60:0/3672760989 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020011590 con 0x7ff0300cadb0 2023-10-06T04:29:03.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.786+0000 7ff017fff700 1 -- 172.21.15.60:0/3672760989 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff020011710 con 0x7ff0300cadb0 2023-10-06T04:29:03.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.786+0000 7ff017fff700 1 -- 172.21.15.60:0/3672760989 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020011ad0 con 0x7ff0300cadb0 2023-10-06T04:29:03.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.786+0000 7ff03579d700 1 -- 172.21.15.60:0/3672760989 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03009bac0 con 0x7ff0300cadb0 2023-10-06T04:29:03.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.786+0000 7ff03579d700 1 -- 172.21.15.60:0/3672760989 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03006bd20 con 0x7ff0300cadb0 2023-10-06T04:29:03.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.787+0000 7ff03579d700 1 -- 172.21.15.60:0/3672760989 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff03005f230 con 0x7ff0300cadb0 2023-10-06T04:29:03.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.788+0000 7ff017fff700 1 -- 172.21.15.60:0/3672760989 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff02001b3b0 con 0x7ff0300cadb0 2023-10-06T04:29:03.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.788+0000 7ff017fff700 1 --2- 172.21.15.60:0/3672760989 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff01c066f30 0x7ff01c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:03.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.789+0000 7ff017fff700 1 -- 172.21.15.60:0/3672760989 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7ff020083ed0 con 0x7ff0300cadb0 2023-10-06T04:29:03.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.789+0000 7ff02f7fe700 1 --2- 172.21.15.60:0/3672760989 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff01c066f30 0x7ff01c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:03.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.789+0000 7ff02f7fe700 1 --2- 172.21.15.60:0/3672760989 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff01c066f30 0x7ff01c0693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff0300cdb90 tx=0x7ff024017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:03.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:03.793+0000 7ff017fff700 1 -- 172.21.15.60:0/3672760989 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff020050d60 con 0x7ff0300cadb0 2023-10-06T04:29:04.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.040+0000 7ff03579d700 1 -- 172.21.15.60:0/3672760989 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0300cd5d0 con 0x7ff0300cadb0 2023-10-06T04:29:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.041+0000 7ff017fff700 1 -- 172.21.15.60:0/3672760989 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7ff020017070 con 0x7ff0300cadb0 2023-10-06T04:29:04.043 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:04.043 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3950892589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3950892589},{"type":"v1","addr":"172.21.15.60:6837","nonce":3950892589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1381681252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1381681252},{"type":"v1","addr":"172.21.15.135:6834","nonce":1381681252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1306947344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1306947344},{"type":"v1","addr":"172.21.15.135:6835","nonce":1306947344}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:28:06.242656+0000","modified":"2023-10-06T04:28:23.340411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/1424722915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1424722915},{"type":"v1","addr":"172.21.15.60:6836","nonce":1424722915}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:29:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.043+0000 7ff03579d700 1 -- 172.21.15.60:0/3672760989 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff01c066f30 msgr2=0x7ff01c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.043+0000 7ff03579d700 1 --2- 172.21.15.60:0/3672760989 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff01c066f30 0x7ff01c0693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff0300cdb90 tx=0x7ff024017000 comp rx=0 tx=0).stop 2023-10-06T04:29:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.043+0000 7ff03579d700 1 -- 172.21.15.60:0/3672760989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0300cadb0 msgr2=0x7ff0300980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.043+0000 7ff03579d700 1 --2- 172.21.15.60:0/3672760989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0300cadb0 0x7ff0300980e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff02000c7c0 tx=0x7ff020007f70 comp rx=0 tx=0).stop 2023-10-06T04:29:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.043+0000 7ff03579d700 1 -- 172.21.15.60:0/3672760989 shutdown_connections 2023-10-06T04:29:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.043+0000 7ff03579d700 1 --2- 172.21.15.60:0/3672760989 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff01c066f30 0x7ff01c0693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.043+0000 7ff03579d700 1 --2- 172.21.15.60:0/3672760989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0300cadb0 0x7ff0300980e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.043+0000 7ff03579d700 1 --2- 172.21.15.60:0/3672760989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03015dc60 0x7ff03006b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.043+0000 7ff03579d700 1 --2- 172.21.15.60:0/3672760989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff0300cb180 0x7ff03009a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.043+0000 7ff03579d700 1 -- 172.21.15.60:0/3672760989 >> 172.21.15.60:0/3672760989 conn(0x7ff030087fc0 msgr2=0x7ff030157e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:04.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.043+0000 7ff03579d700 1 -- 172.21.15.60:0/3672760989 shutdown_connections 2023-10-06T04:29:04.047 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.043+0000 7ff03579d700 1 -- 172.21.15.60:0/3672760989 wait complete. 2023-10-06T04:29:04.047 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 9 2023-10-06T04:29:04.063 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:29:04.250 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.248+0000 7f07b3fff700 1 Processor -- start 2023-10-06T04:29:04.251 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.248+0000 7f07b3fff700 1 -- start start 2023-10-06T04:29:04.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.249+0000 7f07b3fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b4157140 0x7f07b40acd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:04.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.249+0000 7f07b3fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f07b40af500 0x7f07b40aae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:04.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.249+0000 7f07b3fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b40ad6d0 con 0x7f07b40ad260 2023-10-06T04:29:04.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.249+0000 7f07b3fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b415afa0 con 0x7f07b40af500 2023-10-06T04:29:04.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.250+0000 7f07b3fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b415b280 con 0x7f07b4157140 2023-10-06T04:29:04.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.250+0000 7f07b27fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f07b40ad260 0x7f07b40aedf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33072/0 (socket says 172.21.15.60:33072) 2023-10-06T04:29:04.252 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.250+0000 7f07b27fc700 1 -- 172.21.15.60:0/176791556 learned_addr learned my addr 172.21.15.60:0/176791556 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:29:04.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.250+0000 7f07b1ffb700 1 -- 172.21.15.60:0/176791556 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102706936 0 0) 0x7f07b40ad6d0 con 0x7f07b40ad260 2023-10-06T04:29:04.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.250+0000 7f07b2ffd700 1 --2- 172.21.15.60:0/176791556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b4157140 0x7f07b40acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:04.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.250+0000 7f07b1ffb700 1 -- 172.21.15.60:0/176791556 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f079c003570 con 0x7f07b40ad260 2023-10-06T04:29:04.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.250+0000 7f07b37fe700 1 --2- 172.21.15.60:0/176791556 >> v2:172.21.15.135:3300/0 conn(0x7f07b40af500 0x7f07b40aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:04.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.250+0000 7f07b1ffb700 1 -- 172.21.15.60:0/176791556 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1842814613 0 0) 0x7f079c003570 con 0x7f07b40ad260 2023-10-06T04:29:04.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.250+0000 7f07b1ffb700 1 -- 172.21.15.60:0/176791556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b4157140 msgr2=0x7f07b40acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:04.255 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b1ffb700 1 --2- 172.21.15.60:0/176791556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b4157140 0x7f07b40acd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b1ffb700 1 -- 172.21.15.60:0/176791556 >> v2:172.21.15.135:3300/0 conn(0x7f07b40af500 msgr2=0x7f07b40aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b1ffb700 1 --2- 172.21.15.60:0/176791556 >> v2:172.21.15.135:3300/0 conn(0x7f07b40af500 0x7f07b40aae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b1ffb700 1 -- 172.21.15.60:0/176791556 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b40af940 con 0x7f07b40ad260 2023-10-06T04:29:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b1ffb700 1 -- 172.21.15.60:0/176791556 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7f07a8001470 con 0x7f07b40ad260 2023-10-06T04:29:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b1ffb700 1 -- 172.21.15.60:0/176791556 >> v1:172.21.15.60:6789/0 conn(0x7f07b40ad260 legacy=0x7f07b40aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b1ffb700 1 --2- 172.21.15.60:0/176791556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f079c003ae0 0x7f079c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b1ffb700 1 --2- 172.21.15.60:0/176791556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f079c004810 0x7f079c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b1ffb700 1 --2- 172.21.15.60:0/176791556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b4157140 0x7f079c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b1ffb700 1 -- 172.21.15.60:0/176791556 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b415afa0 con 0x7f079c003ae0 2023-10-06T04:29:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b1ffb700 1 -- 172.21.15.60:0/176791556 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b415b280 con 0x7f079c004810 2023-10-06T04:29:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b1ffb700 1 -- 172.21.15.60:0/176791556 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079c00bb10 con 0x7f07b4157140 2023-10-06T04:29:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b2ffd700 1 --2- 172.21.15.60:0/176791556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f079c003ae0 0x7f079c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b27fc700 1 --2- 172.21.15.60:0/176791556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f079c004810 0x7f079c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b37fe700 1 --2- 172.21.15.60:0/176791556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b4157140 0x7f079c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b2ffd700 1 -- 172.21.15.60:0/176791556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b4157140 msgr2=0x7f079c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b2ffd700 1 --2- 172.21.15.60:0/176791556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b4157140 0x7f079c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b2ffd700 1 -- 172.21.15.60:0/176791556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f079c004810 msgr2=0x7f079c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b2ffd700 1 --2- 172.21.15.60:0/176791556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f079c004810 0x7f079c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b2ffd700 1 -- 172.21.15.60:0/176791556 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079c003570 con 0x7f079c003ae0 2023-10-06T04:29:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b37fe700 1 --2- 172.21.15.60:0/176791556 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b4157140 0x7f079c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.251+0000 7f07b27fc700 1 --2- 172.21.15.60:0/176791556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f079c004810 0x7f079c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.252+0000 7f07b2ffd700 1 --2- 172.21.15.60:0/176791556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f079c003ae0 0x7f079c003ef0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f07a4009c00 tx=0x7f07a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac7d1629deaaa57 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.252+0000 7f07b1ffb700 1 -- 172.21.15.60:0/176791556 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a400e710 con 0x7f079c003ae0 2023-10-06T04:29:04.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.252+0000 7f07b1ffb700 1 -- 172.21.15.60:0/176791556 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a400e870 con 0x7f079c003ae0 2023-10-06T04:29:04.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.252+0000 7f07b1ffb700 1 -- 172.21.15.60:0/176791556 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a400ec30 con 0x7f079c003ae0 2023-10-06T04:29:04.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.252+0000 7f07b3fff700 1 -- 172.21.15.60:0/176791556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f079c003ae0 msgr2=0x7f079c003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:04.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.252+0000 7f07b3fff700 1 --2- 172.21.15.60:0/176791556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f079c003ae0 0x7f079c003ef0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f07a4009c00 tx=0x7f07a40091a0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.252+0000 7f07b37fe700 1 -- 172.21.15.60:0/176791556 reap_dead start 2023-10-06T04:29:04.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.252+0000 7f07b3fff700 1 -- 172.21.15.60:0/176791556 shutdown_connections 2023-10-06T04:29:04.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.252+0000 7f07b3fff700 1 -- 172.21.15.60:0/176791556 >> 172.21.15.60:0/176791556 conn(0x7f07b4097410 msgr2=0x7f07b4067d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:04.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.253+0000 7f07b3fff700 1 -- 172.21.15.60:0/176791556 shutdown_connections 2023-10-06T04:29:04.258 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.253+0000 7f07b3fff700 1 -- 172.21.15.60:0/176791556 wait complete. 2023-10-06T04:29:04.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.254+0000 7f07b3fff700 1 Processor -- start 2023-10-06T04:29:04.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.254+0000 7f07b3fff700 1 -- start start 2023-10-06T04:29:04.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.255+0000 7f07b3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f079c003ae0 0x7f07b4159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:04.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.255+0000 7f07b3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07b40b3a90 0x7f07b4152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:04.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.255+0000 7f07b3fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b40c9330 0x7f07b40c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:04.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.255+0000 7f07b3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b40c9d10 con 0x7f079c003ae0 2023-10-06T04:29:04.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.255+0000 7f07b3fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b415a260 con 0x7f07b40b3a90 2023-10-06T04:29:04.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.255+0000 7f07b3fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b4153500 con 0x7f07b40c9330 2023-10-06T04:29:04.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.255+0000 7f07b2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f079c003ae0 0x7f07b4159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:04.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.255+0000 7f07b2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f079c003ae0 0x7f07b4159b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52764/0 (socket says 172.21.15.60:52764) 2023-10-06T04:29:04.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.255+0000 7f07b2ffd700 1 -- 172.21.15.60:0/3982969389 learned_addr learned my addr 172.21.15.60:0/3982969389 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:04.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.255+0000 7f07b27fc700 1 --2- 172.21.15.60:0/3982969389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07b40b3a90 0x7f07b4152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:04.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.255+0000 7f07b37fe700 1 --2- 172.21.15.60:0/3982969389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b40c9330 0x7f07b40c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.255+0000 7f07b2ffd700 1 -- 172.21.15.60:0/3982969389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b40c9330 msgr2=0x7f07b40c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.256+0000 7f07b2ffd700 1 --2- 172.21.15.60:0/3982969389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b40c9330 0x7f07b40c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.256+0000 7f07b2ffd700 1 -- 172.21.15.60:0/3982969389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07b40b3a90 msgr2=0x7f07b4152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.256+0000 7f07b2ffd700 1 --2- 172.21.15.60:0/3982969389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07b40b3a90 0x7f07b4152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.256+0000 7f07b2ffd700 1 -- 172.21.15.60:0/3982969389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b41525a0 con 0x7f079c003ae0 2023-10-06T04:29:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.256+0000 7f07b37fe700 1 --2- 172.21.15.60:0/3982969389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b40c9330 0x7f07b40c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.256+0000 7f07b27fc700 1 --2- 172.21.15.60:0/3982969389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07b40b3a90 0x7f07b4152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.256+0000 7f07b2ffd700 1 --2- 172.21.15.60:0/3982969389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f079c003ae0 0x7f07b4159b80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f07a400e4b0 tx=0x7f07a401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.256+0000 7f079affd700 1 -- 172.21.15.60:0/3982969389 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4022070 con 0x7f079c003ae0 2023-10-06T04:29:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.256+0000 7f079affd700 1 -- 172.21.15.60:0/3982969389 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a400e9e0 con 0x7f079c003ae0 2023-10-06T04:29:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.256+0000 7f079affd700 1 -- 172.21.15.60:0/3982969389 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4027470 con 0x7f079c003ae0 2023-10-06T04:29:04.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.256+0000 7f07b3fff700 1 -- 172.21.15.60:0/3982969389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b40b2f60 con 0x7f079c003ae0 2023-10-06T04:29:04.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.256+0000 7f07b3fff700 1 -- 172.21.15.60:0/3982969389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b40b3200 con 0x7f079c003ae0 2023-10-06T04:29:04.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.257+0000 7f07b3fff700 1 -- 172.21.15.60:0/3982969389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b405f230 con 0x7f079c003ae0 2023-10-06T04:29:04.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.258+0000 7f079affd700 1 -- 172.21.15.60:0/3982969389 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07a401c450 con 0x7f079c003ae0 2023-10-06T04:29:04.263 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.259+0000 7f079affd700 1 --2- 172.21.15.60:0/3982969389 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f07a0066f30 0x7f07a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:04.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.259+0000 7f079affd700 1 -- 172.21.15.60:0/3982969389 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f07a40865c0 con 0x7f079c003ae0 2023-10-06T04:29:04.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.259+0000 7f07b27fc700 1 --2- 172.21.15.60:0/3982969389 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f07a0066f30 0x7f07a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:04.264 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.260+0000 7f07b27fc700 1 --2- 172.21.15.60:0/3982969389 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f07a0066f30 0x7f07a00693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f07a8001ed0 tx=0x7f07a8000f60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:04.265 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.263+0000 7f079affd700 1 -- 172.21.15.60:0/3982969389 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07a4053300 con 0x7f079c003ae0 2023-10-06T04:29:04.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.470+0000 7f07b3fff700 1 -- 172.21.15.60:0/3982969389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07b4069490 con 0x7f079c003ae0 2023-10-06T04:29:04.473 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.471+0000 7f079affd700 1 -- 172.21.15.60:0/3982969389 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18802 (secure 0 0 0) 0x7f07a4056920 con 0x7f079c003ae0 2023-10-06T04:29:04.474 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:04.474 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":27,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:28:54.367692+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:28:04.355358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:28:05.208550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:28:08.791979+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.1a","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:29:04.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.473+0000 7f07b3fff700 1 -- 172.21.15.60:0/3982969389 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f07a0066f30 msgr2=0x7f07a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:04.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.473+0000 7f07b3fff700 1 --2- 172.21.15.60:0/3982969389 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f07a0066f30 0x7f07a00693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f07a8001ed0 tx=0x7f07a8000f60 comp rx=0 tx=0).stop 2023-10-06T04:29:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.473+0000 7f07b3fff700 1 -- 172.21.15.60:0/3982969389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f079c003ae0 msgr2=0x7f07b4159b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.473+0000 7f07b3fff700 1 --2- 172.21.15.60:0/3982969389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f079c003ae0 0x7f07b4159b80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f07a400e4b0 tx=0x7f07a401a000 comp rx=0 tx=0).stop 2023-10-06T04:29:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.473+0000 7f07b3fff700 1 -- 172.21.15.60:0/3982969389 shutdown_connections 2023-10-06T04:29:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.473+0000 7f07b3fff700 1 --2- 172.21.15.60:0/3982969389 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f07a0066f30 0x7f07a00693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.473+0000 7f07b3fff700 1 --2- 172.21.15.60:0/3982969389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f079c003ae0 0x7f07b4159b80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.473+0000 7f07b3fff700 1 --2- 172.21.15.60:0/3982969389 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f07b40c9330 0x7f07b40c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.473+0000 7f07b3fff700 1 --2- 172.21.15.60:0/3982969389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07b40b3a90 0x7f07b4152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.473+0000 7f07b3fff700 1 -- 172.21.15.60:0/3982969389 >> 172.21.15.60:0/3982969389 conn(0x7f07b4097410 msgr2=0x7f07b40ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:04.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.473+0000 7f07b3fff700 1 -- 172.21.15.60:0/3982969389 shutdown_connections 2023-10-06T04:29:04.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.473+0000 7f07b3fff700 1 -- 172.21.15.60:0/3982969389 wait complete. 2023-10-06T04:29:04.493 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:29:04.494 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:29:04.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.679+0000 7fd463fff700 1 Processor -- start 2023-10-06T04:29:04.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.679+0000 7fd463fff700 1 -- start start 2023-10-06T04:29:04.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.680+0000 7fd463fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd4640cbc30 0x7fd4640cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:04.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.680+0000 7fd463fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4640cb7a0 con 0x7fd4640b2100 2023-10-06T04:29:04.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.680+0000 7fd463fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4640b0860 con 0x7fd464159440 2023-10-06T04:29:04.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.680+0000 7fd463fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4640cb150 con 0x7fd4640cbc30 2023-10-06T04:29:04.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.681+0000 7fd4637fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd4640b2100 0x7fd4640b2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33076/0 (socket says 172.21.15.60:33076) 2023-10-06T04:29:04.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.681+0000 7fd4637fe700 1 -- 172.21.15.60:0/1467080397 learned_addr learned my addr 172.21.15.60:0/1467080397 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:29:04.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.681+0000 7fd4627fc700 1 --2- 172.21.15.60:0/1467080397 >> v2:172.21.15.135:3300/0 conn(0x7fd4640cbc30 0x7fd4640cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:04.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.681+0000 7fd461ffb700 1 -- 172.21.15.60:0/1467080397 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3618468278 0 0) 0x7fd4640cb7a0 con 0x7fd4640b2100 2023-10-06T04:29:04.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.681+0000 7fd461ffb700 1 -- 172.21.15.60:0/1467080397 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd44c003570 con 0x7fd4640b2100 2023-10-06T04:29:04.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.681+0000 7fd461ffb700 1 -- 172.21.15.60:0/1467080397 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055109223 0 0) 0x7fd4640b0860 con 0x7fd464159440 2023-10-06T04:29:04.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.681+0000 7fd461ffb700 1 -- 172.21.15.60:0/1467080397 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4640cb7a0 con 0x7fd464159440 2023-10-06T04:29:04.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.681+0000 7fd4627fc700 1 -- 172.21.15.60:0/1467080397 >> v1:172.21.15.135:6789/0 conn(0x7fd464159440 legacy=0x7fd4640b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:04.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.681+0000 7fd4627fc700 1 -- 172.21.15.60:0/1467080397 >> v1:172.21.15.60:6789/0 conn(0x7fd4640b2100 legacy=0x7fd4640b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:04.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.681+0000 7fd4627fc700 1 -- 172.21.15.60:0/1467080397 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4640cb430 con 0x7fd4640cbc30 2023-10-06T04:29:04.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.682+0000 7fd4627fc700 1 --2- 172.21.15.60:0/1467080397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4640cbc30 0x7fd4640cc080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd4580098e0 tx=0x7fd4580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2785e1ceef40dead server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:04.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.682+0000 7fd461ffb700 1 -- 172.21.15.60:0/1467080397 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458011630 con 0x7fd4640cbc30 2023-10-06T04:29:04.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.682+0000 7fd461ffb700 1 -- 172.21.15.60:0/1467080397 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd458011790 con 0x7fd4640cbc30 2023-10-06T04:29:04.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.682+0000 7fd461ffb700 1 -- 172.21.15.60:0/1467080397 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458011b30 con 0x7fd4640cbc30 2023-10-06T04:29:04.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.682+0000 7fd463fff700 1 -- 172.21.15.60:0/1467080397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4640cbc30 msgr2=0x7fd4640cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:04.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.682+0000 7fd463fff700 1 --2- 172.21.15.60:0/1467080397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4640cbc30 0x7fd4640cc080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd4580098e0 tx=0x7fd4580091a0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.682+0000 7fd463fff700 1 -- 172.21.15.60:0/1467080397 shutdown_connections 2023-10-06T04:29:04.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.682+0000 7fd463fff700 1 --2- 172.21.15.60:0/1467080397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4640cbc30 0x7fd4640cc080 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.683+0000 7fd463fff700 1 -- 172.21.15.60:0/1467080397 >> 172.21.15.60:0/1467080397 conn(0x7fd46406ece0 msgr2=0x7fd46406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:04.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.683+0000 7fd463fff700 1 -- 172.21.15.60:0/1467080397 shutdown_connections 2023-10-06T04:29:04.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.683+0000 7fd463fff700 1 -- 172.21.15.60:0/1467080397 wait complete. 2023-10-06T04:29:04.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.684+0000 7fd463fff700 1 Processor -- start 2023-10-06T04:29:04.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.684+0000 7fd463fff700 1 -- start start 2023-10-06T04:29:04.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.685+0000 7fd463fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4640b2100 0x7fd464153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:04.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.685+0000 7fd463fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4640cbc30 0x7fd4640d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:04.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.685+0000 7fd463fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd464159440 0x7fd4640d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:04.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.685+0000 7fd463fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46416a8e0 con 0x7fd4640cbc30 2023-10-06T04:29:04.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.685+0000 7fd463fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4640ce190 con 0x7fd4640b2100 2023-10-06T04:29:04.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.685+0000 7fd463fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4640cde90 con 0x7fd464159440 2023-10-06T04:29:04.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.685+0000 7fd4627fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4640cbc30 0x7fd4640d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:04.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.685+0000 7fd4627fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4640cbc30 0x7fd4640d01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52778/0 (socket says 172.21.15.60:52778) 2023-10-06T04:29:04.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.685+0000 7fd4627fc700 1 -- 172.21.15.60:0/1036649947 learned_addr learned my addr 172.21.15.60:0/1036649947 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:04.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.685+0000 7fd462ffd700 1 --2- 172.21.15.60:0/1036649947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4640b2100 0x7fd464153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:04.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.685+0000 7fd4637fe700 1 --2- 172.21.15.60:0/1036649947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd464159440 0x7fd4640d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:04.690 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.686+0000 7fd4627fc700 1 -- 172.21.15.60:0/1036649947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd464159440 msgr2=0x7fd4640d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:04.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.686+0000 7fd4627fc700 1 --2- 172.21.15.60:0/1036649947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd464159440 0x7fd4640d06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.686+0000 7fd4627fc700 1 -- 172.21.15.60:0/1036649947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4640b2100 msgr2=0x7fd464153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:04.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.686+0000 7fd4627fc700 1 --2- 172.21.15.60:0/1036649947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4640b2100 0x7fd464153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.686+0000 7fd4627fc700 1 -- 172.21.15.60:0/1036649947 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd458009420 con 0x7fd4640cbc30 2023-10-06T04:29:04.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.686+0000 7fd4637fe700 1 --2- 172.21.15.60:0/1036649947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd464159440 0x7fd4640d06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:04.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.686+0000 7fd4627fc700 1 --2- 172.21.15.60:0/1036649947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4640cbc30 0x7fd4640d01a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd458009ed0 tx=0x7fd458017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:04.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.686+0000 7fd44affd700 1 -- 172.21.15.60:0/1036649947 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45801f070 con 0x7fd4640cbc30 2023-10-06T04:29:04.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.686+0000 7fd44affd700 1 -- 172.21.15.60:0/1036649947 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd458011900 con 0x7fd4640cbc30 2023-10-06T04:29:04.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.686+0000 7fd44affd700 1 -- 172.21.15.60:0/1036649947 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458023430 con 0x7fd4640cbc30 2023-10-06T04:29:04.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.686+0000 7fd463fff700 1 -- 172.21.15.60:0/1036649947 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4640c9430 con 0x7fd4640cbc30 2023-10-06T04:29:04.691 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.687+0000 7fd463fff700 1 -- 172.21.15.60:0/1036649947 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4640c99f0 con 0x7fd4640cbc30 2023-10-06T04:29:04.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.687+0000 7fd463fff700 1 -- 172.21.15.60:0/1036649947 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46405f230 con 0x7fd4640cbc30 2023-10-06T04:29:04.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.688+0000 7fd44affd700 1 -- 172.21.15.60:0/1036649947 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd45802c3b0 con 0x7fd4640cbc30 2023-10-06T04:29:04.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.689+0000 7fd44affd700 1 --2- 172.21.15.60:0/1036649947 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd450066f30 0x7fd4500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:04.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.690+0000 7fd44affd700 1 -- 172.21.15.60:0/1036649947 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fd458085da0 con 0x7fd4640cbc30 2023-10-06T04:29:04.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.690+0000 7fd462ffd700 1 --2- 172.21.15.60:0/1036649947 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd450066f30 0x7fd4500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:04.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.690+0000 7fd462ffd700 1 --2- 172.21.15.60:0/1036649947 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd450066f30 0x7fd4500693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd454007fd0 tx=0x7fd454007d10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:04.696 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.693+0000 7fd44affd700 1 -- 172.21.15.60:0/1036649947 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd458052ae0 con 0x7fd4640cbc30 2023-10-06T04:29:04.940 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.938+0000 7fd463fff700 1 -- 172.21.15.60:0/1036649947 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4640ce2d0 con 0x7fd4640cbc30 2023-10-06T04:29:04.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.939+0000 7fd44affd700 1 -- 172.21.15.60:0/1036649947 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7fd458028090 con 0x7fd4640cbc30 2023-10-06T04:29:04.941 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:04.941 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3950892589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3950892589},{"type":"v1","addr":"172.21.15.60:6837","nonce":3950892589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1381681252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1381681252},{"type":"v1","addr":"172.21.15.135:6834","nonce":1381681252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1306947344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1306947344},{"type":"v1","addr":"172.21.15.135:6835","nonce":1306947344}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:28:06.242656+0000","modified":"2023-10-06T04:28:23.340411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/1424722915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1424722915},{"type":"v1","addr":"172.21.15.60:6836","nonce":1424722915}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:29:04.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.941+0000 7fd463fff700 1 -- 172.21.15.60:0/1036649947 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd450066f30 msgr2=0x7fd4500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:04.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.941+0000 7fd463fff700 1 --2- 172.21.15.60:0/1036649947 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd450066f30 0x7fd4500693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd454007fd0 tx=0x7fd454007d10 comp rx=0 tx=0).stop 2023-10-06T04:29:04.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.941+0000 7fd463fff700 1 -- 172.21.15.60:0/1036649947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4640cbc30 msgr2=0x7fd4640d01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:04.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.941+0000 7fd463fff700 1 --2- 172.21.15.60:0/1036649947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4640cbc30 0x7fd4640d01a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd458009ed0 tx=0x7fd458017000 comp rx=0 tx=0).stop 2023-10-06T04:29:04.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.941+0000 7fd463fff700 1 -- 172.21.15.60:0/1036649947 shutdown_connections 2023-10-06T04:29:04.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.941+0000 7fd463fff700 1 --2- 172.21.15.60:0/1036649947 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd450066f30 0x7fd4500693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.941+0000 7fd463fff700 1 --2- 172.21.15.60:0/1036649947 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd464159440 0x7fd4640d06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.941+0000 7fd463fff700 1 --2- 172.21.15.60:0/1036649947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4640b2100 0x7fd464153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.941+0000 7fd463fff700 1 --2- 172.21.15.60:0/1036649947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4640cbc30 0x7fd4640d01a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:04.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.941+0000 7fd463fff700 1 -- 172.21.15.60:0/1036649947 >> 172.21.15.60:0/1036649947 conn(0x7fd46406ece0 msgr2=0x7fd4640cd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:04.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.942+0000 7fd463fff700 1 -- 172.21.15.60:0/1036649947 shutdown_connections 2023-10-06T04:29:04.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:04.942+0000 7fd463fff700 1 -- 172.21.15.60:0/1036649947 wait complete. 2023-10-06T04:29:04.945 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 9 2023-10-06T04:29:04.961 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:29:05.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.146+0000 7f78f759d700 1 Processor -- start 2023-10-06T04:29:05.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.146+0000 7f78f759d700 1 -- start start 2023-10-06T04:29:05.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.147+0000 7f78f759d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78f0159390 0x7f78f00ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:05.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.147+0000 7f78f759d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f78f00ab410 0x7f78f00aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:05.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.147+0000 7f78f759d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f00686c0 con 0x7f78f0159760 2023-10-06T04:29:05.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.147+0000 7f78f759d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f0068c80 con 0x7f78f0159390 2023-10-06T04:29:05.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.147+0000 7f78f759d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f00ace20 con 0x7f78f00ab410 2023-10-06T04:29:05.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.147+0000 7f78f659b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78f0159390 0x7f78f00ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:05.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.148+0000 7f78f659b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78f0159390 0x7f78f00ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52780/0 (socket says 172.21.15.60:52780) 2023-10-06T04:29:05.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.148+0000 7f78f659b700 1 -- 172.21.15.60:0/1445692913 learned_addr learned my addr 172.21.15.60:0/1445692913 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:05.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.148+0000 7f78f6d9c700 1 --2- 172.21.15.60:0/1445692913 >> v2:172.21.15.135:3300/0 conn(0x7f78f00ab410 0x7f78f00aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:05.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.148+0000 7f78f659b700 1 -- 172.21.15.60:0/1445692913 >> v2:172.21.15.135:3300/0 conn(0x7f78f00ab410 msgr2=0x7f78f00aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:05.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.148+0000 7f78f659b700 1 --2- 172.21.15.60:0/1445692913 >> v2:172.21.15.135:3300/0 conn(0x7f78f00ab410 0x7f78f00aeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:05.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.148+0000 7f78f659b700 1 -- 172.21.15.60:0/1445692913 >> v1:172.21.15.135:6789/0 conn(0x7f78f0159760 legacy=0x7f78f00aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:05.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.148+0000 7f78f659b700 1 -- 172.21.15.60:0/1445692913 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f00ad0f0 con 0x7f78f0159390 2023-10-06T04:29:05.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.148+0000 7f78f659b700 1 --2- 172.21.15.60:0/1445692913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78f0159390 0x7f78f00ac8e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f78f006b320 tx=0x7f78ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7a4c6fa47a38f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:05.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.148+0000 7f78f5599700 1 -- 172.21.15.60:0/1445692913 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec009e70 con 0x7f78f0159390 2023-10-06T04:29:05.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.149+0000 7f78f5599700 1 -- 172.21.15.60:0/1445692913 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec00b860 con 0x7f78f0159390 2023-10-06T04:29:05.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.149+0000 7f78f5599700 1 -- 172.21.15.60:0/1445692913 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec00bc00 con 0x7f78f0159390 2023-10-06T04:29:05.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.149+0000 7f78f759d700 1 -- 172.21.15.60:0/1445692913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78f0159390 msgr2=0x7f78f00ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:05.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.149+0000 7f78f759d700 1 --2- 172.21.15.60:0/1445692913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78f0159390 0x7f78f00ac8e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f78f006b320 tx=0x7f78ec009250 comp rx=0 tx=0).stop 2023-10-06T04:29:05.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.149+0000 7f78f759d700 1 -- 172.21.15.60:0/1445692913 shutdown_connections 2023-10-06T04:29:05.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.149+0000 7f78f759d700 1 --2- 172.21.15.60:0/1445692913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78f0159390 0x7f78f00ac8e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:05.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.149+0000 7f78f759d700 1 --2- 172.21.15.60:0/1445692913 >> v2:172.21.15.135:3300/0 conn(0x7f78f00ab410 0x7f78f00aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:05.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.149+0000 7f78f759d700 1 -- 172.21.15.60:0/1445692913 >> 172.21.15.60:0/1445692913 conn(0x7f78f0097410 msgr2=0x7f78f0067d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:05.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.149+0000 7f78f759d700 1 -- 172.21.15.60:0/1445692913 shutdown_connections 2023-10-06T04:29:05.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.149+0000 7f78f759d700 1 -- 172.21.15.60:0/1445692913 wait complete. 2023-10-06T04:29:05.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.151+0000 7f78f759d700 1 Processor -- start 2023-10-06T04:29:05.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.151+0000 7f78f759d700 1 -- start start 2023-10-06T04:29:05.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.152+0000 7f78f759d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78f00ab410 0x7f78f00b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:05.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.152+0000 7f78f759d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78f0159390 0x7f78f0153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:05.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.152+0000 7f78f759d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78f0159760 0x7f78f00b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:05.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.152+0000 7f78f759d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f00b3630 con 0x7f78f0159760 2023-10-06T04:29:05.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.152+0000 7f78f759d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f00b11f0 con 0x7f78f00ab410 2023-10-06T04:29:05.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.152+0000 7f78f759d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f0159f70 con 0x7f78f0159390 2023-10-06T04:29:05.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.152+0000 7f78f6d9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78f0159760 0x7f78f00b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:05.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.152+0000 7f78f6d9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78f0159760 0x7f78f00b13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52790/0 (socket says 172.21.15.60:52790) 2023-10-06T04:29:05.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.152+0000 7f78f6d9c700 1 -- 172.21.15.60:0/2266937804 learned_addr learned my addr 172.21.15.60:0/2266937804 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:05.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.152+0000 7f78f659b700 1 --2- 172.21.15.60:0/2266937804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78f00ab410 0x7f78f00b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:05.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.152+0000 7f78f5d9a700 1 --2- 172.21.15.60:0/2266937804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78f0159390 0x7f78f0153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:05.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.153+0000 7f78f6d9c700 1 -- 172.21.15.60:0/2266937804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78f0159390 msgr2=0x7f78f0153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:05.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.153+0000 7f78f6d9c700 1 --2- 172.21.15.60:0/2266937804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78f0159390 0x7f78f0153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:05.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.153+0000 7f78f6d9c700 1 -- 172.21.15.60:0/2266937804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78f00ab410 msgr2=0x7f78f00b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:05.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.153+0000 7f78f6d9c700 1 --2- 172.21.15.60:0/2266937804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78f00ab410 0x7f78f00b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:05.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.153+0000 7f78f6d9c700 1 -- 172.21.15.60:0/2266937804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec0094f0 con 0x7f78f0159760 2023-10-06T04:29:05.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.153+0000 7f78f6d9c700 1 --2- 172.21.15.60:0/2266937804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78f0159760 0x7f78f00b13c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f78e8009ef0 tx=0x7f78e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:05.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.153+0000 7f78e67fc700 1 -- 172.21.15.60:0/2266937804 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e800cb70 con 0x7f78f0159760 2023-10-06T04:29:05.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.153+0000 7f78e67fc700 1 -- 172.21.15.60:0/2266937804 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e800f040 con 0x7f78f0159760 2023-10-06T04:29:05.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.153+0000 7f78e67fc700 1 -- 172.21.15.60:0/2266937804 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e8014480 con 0x7f78f0159760 2023-10-06T04:29:05.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.153+0000 7f78f759d700 1 -- 172.21.15.60:0/2266937804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f00b3820 con 0x7f78f0159760 2023-10-06T04:29:05.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.153+0000 7f78f759d700 1 -- 172.21.15.60:0/2266937804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f00b3de0 con 0x7f78f0159760 2023-10-06T04:29:05.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.154+0000 7f78f759d700 1 -- 172.21.15.60:0/2266937804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f015a120 con 0x7f78f0159760 2023-10-06T04:29:05.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.155+0000 7f78e67fc700 1 -- 172.21.15.60:0/2266937804 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f78e8014830 con 0x7f78f0159760 2023-10-06T04:29:05.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.156+0000 7f78e67fc700 1 --2- 172.21.15.60:0/2266937804 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f78d4066f30 0x7f78d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:05.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.156+0000 7f78e67fc700 1 -- 172.21.15.60:0/2266937804 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f78e8085680 con 0x7f78f0159760 2023-10-06T04:29:05.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.156+0000 7f78f659b700 1 --2- 172.21.15.60:0/2266937804 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f78d4066f30 0x7f78d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:05.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.157+0000 7f78f659b700 1 --2- 172.21.15.60:0/2266937804 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f78d4066f30 0x7f78d40693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f78f006b320 tx=0x7f78ec017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:05.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.160+0000 7f78e67fc700 1 -- 172.21.15.60:0/2266937804 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78f015a120 con 0x7f78f0159760 2023-10-06T04:29:05.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.410+0000 7f78f759d700 1 -- 172.21.15.60:0/2266937804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78f015a0e0 con 0x7f78f0159760 2023-10-06T04:29:05.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.411+0000 7f78e67fc700 1 -- 172.21.15.60:0/2266937804 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f78e80523c0 con 0x7f78f0159760 2023-10-06T04:29:05.414 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:05.414 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3950892589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3950892589},{"type":"v1","addr":"172.21.15.60:6837","nonce":3950892589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1381681252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1381681252},{"type":"v1","addr":"172.21.15.135:6834","nonce":1381681252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1306947344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":1306947344},{"type":"v1","addr":"172.21.15.135:6835","nonce":1306947344}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:28:06.242656+0000","modified":"2023-10-06T04:28:23.340411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6836/1424722915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1424722915},{"type":"v1","addr":"172.21.15.60:6836","nonce":1424722915}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T04:29:05.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.414+0000 7f78f759d700 1 -- 172.21.15.60:0/2266937804 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f78d4066f30 msgr2=0x7f78d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:05.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.414+0000 7f78f759d700 1 --2- 172.21.15.60:0/2266937804 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f78d4066f30 0x7f78d40693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f78f006b320 tx=0x7f78ec017000 comp rx=0 tx=0).stop 2023-10-06T04:29:05.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.414+0000 7f78f759d700 1 -- 172.21.15.60:0/2266937804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78f0159760 msgr2=0x7f78f00b13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:05.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.414+0000 7f78f759d700 1 --2- 172.21.15.60:0/2266937804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78f0159760 0x7f78f00b13c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f78e8009ef0 tx=0x7f78e800b040 comp rx=0 tx=0).stop 2023-10-06T04:29:05.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.414+0000 7f78f759d700 1 -- 172.21.15.60:0/2266937804 shutdown_connections 2023-10-06T04:29:05.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.414+0000 7f78f759d700 1 --2- 172.21.15.60:0/2266937804 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f78d4066f30 0x7f78d40693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:05.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.414+0000 7f78f759d700 1 --2- 172.21.15.60:0/2266937804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78f0159760 0x7f78f00b13c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:05.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.414+0000 7f78f759d700 1 --2- 172.21.15.60:0/2266937804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78f00ab410 0x7f78f00b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:05.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.414+0000 7f78f759d700 1 --2- 172.21.15.60:0/2266937804 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f78f0159390 0x7f78f0153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:05.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.414+0000 7f78f759d700 1 -- 172.21.15.60:0/2266937804 >> 172.21.15.60:0/2266937804 conn(0x7f78f0097410 msgr2=0x7f78f006c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:05.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.414+0000 7f78f759d700 1 -- 172.21.15.60:0/2266937804 shutdown_connections 2023-10-06T04:29:05.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.414+0000 7f78f759d700 1 -- 172.21.15.60:0/2266937804 wait complete. 2023-10-06T04:29:05.419 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 9 2023-10-06T04:29:05.435 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:29:05.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.620+0000 7fc3fadff700 1 Processor -- start 2023-10-06T04:29:05.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.620+0000 7fc3fadff700 1 -- start start 2023-10-06T04:29:05.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.621+0000 7fc3fadff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3f4069ab0 0x7fc3f40ada60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:05.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.621+0000 7fc3fadff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc3f406d350 0x7fc3f406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:05.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.621+0000 7fc3fadff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f406e6d0 con 0x7fc3f40696e0 2023-10-06T04:29:05.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.621+0000 7fc3fadff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f40cd000 con 0x7fc3f406d350 2023-10-06T04:29:05.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.621+0000 7fc3fadff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f4069f20 con 0x7fc3f4069ab0 2023-10-06T04:29:05.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.621+0000 7fc3f939c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc3f406d350 0x7fc3f406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:05.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.621+0000 7fc3f939c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc3f406d350 0x7fc3f406eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52792/0 (socket says 172.21.15.60:52792) 2023-10-06T04:29:05.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.622+0000 7fc3f939c700 1 -- 172.21.15.60:0/3229767414 learned_addr learned my addr 172.21.15.60:0/3229767414 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:05.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.622+0000 7fc3f3fff700 1 --2- 172.21.15.60:0/3229767414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3f4069ab0 0x7fc3f40ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:05.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.622+0000 7fc3f939c700 1 -- 172.21.15.60:0/3229767414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3f4069ab0 msgr2=0x7fc3f40ada60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:05.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.622+0000 7fc3f939c700 1 --2- 172.21.15.60:0/3229767414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3f4069ab0 0x7fc3f40ada60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:05.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.622+0000 7fc3f939c700 1 -- 172.21.15.60:0/3229767414 >> v1:172.21.15.135:6789/0 conn(0x7fc3f40696e0 legacy=0x7fc3f40aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:05.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.622+0000 7fc3f939c700 1 -- 172.21.15.60:0/3229767414 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f406dac0 con 0x7fc3f406d350 2023-10-06T04:29:05.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.622+0000 7fc3f939c700 1 --2- 172.21.15.60:0/3229767414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3f406d350 0x7fc3f406eb60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec009f50 tx=0x7fc3ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ee7347d1efbd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:05.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.622+0000 7fc3f37fe700 1 -- 172.21.15.60:0/3229767414 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec00e070 con 0x7fc3f406d350 2023-10-06T04:29:05.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.622+0000 7fc3f37fe700 1 -- 172.21.15.60:0/3229767414 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ec00ba70 con 0x7fc3f406d350 2023-10-06T04:29:05.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.622+0000 7fc3f37fe700 1 -- 172.21.15.60:0/3229767414 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec0092e0 con 0x7fc3f406d350 2023-10-06T04:29:05.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.623+0000 7fc3fadff700 1 -- 172.21.15.60:0/3229767414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3f406d350 msgr2=0x7fc3f406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:05.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.623+0000 7fc3fadff700 1 --2- 172.21.15.60:0/3229767414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3f406d350 0x7fc3f406eb60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec009f50 tx=0x7fc3ec009840 comp rx=0 tx=0).stop 2023-10-06T04:29:05.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.623+0000 7fc3fadff700 1 -- 172.21.15.60:0/3229767414 shutdown_connections 2023-10-06T04:29:05.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.623+0000 7fc3fadff700 1 --2- 172.21.15.60:0/3229767414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3f406d350 0x7fc3f406eb60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:05.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.623+0000 7fc3fadff700 1 --2- 172.21.15.60:0/3229767414 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3f4069ab0 0x7fc3f40ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:05.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.623+0000 7fc3fadff700 1 -- 172.21.15.60:0/3229767414 >> 172.21.15.60:0/3229767414 conn(0x7fc3f4068080 msgr2=0x7fc3f40cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:05.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.623+0000 7fc3fadff700 1 -- 172.21.15.60:0/3229767414 shutdown_connections 2023-10-06T04:29:05.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.623+0000 7fc3fadff700 1 -- 172.21.15.60:0/3229767414 wait complete. 2023-10-06T04:29:05.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.625+0000 7fc3fadff700 1 Processor -- start 2023-10-06T04:29:05.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.625+0000 7fc3fadff700 1 -- start start 2023-10-06T04:29:05.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.626+0000 7fc3fadff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3f40696e0 0x7fc3f416b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:05.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.626+0000 7fc3fadff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3f4069ab0 0x7fc3f416cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:05.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.626+0000 7fc3fadff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3f406d350 0x7fc3f40c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:05.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.626+0000 7fc3fadff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f4152fe0 con 0x7fc3f406d350 2023-10-06T04:29:05.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.626+0000 7fc3fadff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f4153280 con 0x7fc3f40696e0 2023-10-06T04:29:05.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.626+0000 7fc3fadff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f4153560 con 0x7fc3f4069ab0 2023-10-06T04:29:05.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.626+0000 7fc3f939c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3f406d350 0x7fc3f40c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:05.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.626+0000 7fc3f939c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3f406d350 0x7fc3f40c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52806/0 (socket says 172.21.15.60:52806) 2023-10-06T04:29:05.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.626+0000 7fc3f939c700 1 -- 172.21.15.60:0/1675437165 learned_addr learned my addr 172.21.15.60:0/1675437165 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:05.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.626+0000 7fc3f3fff700 1 --2- 172.21.15.60:0/1675437165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3f4069ab0 0x7fc3f416cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:05.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.626+0000 7fc3f8b9b700 1 --2- 172.21.15.60:0/1675437165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3f40696e0 0x7fc3f416b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:05.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.626+0000 7fc3f939c700 1 -- 172.21.15.60:0/1675437165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3f4069ab0 msgr2=0x7fc3f416cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:05.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.626+0000 7fc3f939c700 1 --2- 172.21.15.60:0/1675437165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3f4069ab0 0x7fc3f416cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:05.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.626+0000 7fc3f939c700 1 -- 172.21.15.60:0/1675437165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3f40696e0 msgr2=0x7fc3f416b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:05.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.626+0000 7fc3f939c700 1 --2- 172.21.15.60:0/1675437165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3f40696e0 0x7fc3f416b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:05.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.626+0000 7fc3f939c700 1 -- 172.21.15.60:0/1675437165 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec009ae0 con 0x7fc3f406d350 2023-10-06T04:29:05.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.626+0000 7fc3f3fff700 1 --2- 172.21.15.60:0/1675437165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3f4069ab0 0x7fc3f416cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:05.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.627+0000 7fc3f939c700 1 --2- 172.21.15.60:0/1675437165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3f406d350 0x7fc3f40c84e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec009880 tx=0x7fc3ec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:05.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.627+0000 7fc3f0ff9700 1 -- 172.21.15.60:0/1675437165 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec008d90 con 0x7fc3f406d350 2023-10-06T04:29:05.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.627+0000 7fc3f0ff9700 1 -- 172.21.15.60:0/1675437165 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ec026460 con 0x7fc3f406d350 2023-10-06T04:29:05.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.627+0000 7fc3f0ff9700 1 -- 172.21.15.60:0/1675437165 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec026800 con 0x7fc3f406d350 2023-10-06T04:29:05.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.627+0000 7fc3fadff700 1 -- 172.21.15.60:0/1675437165 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f4153840 con 0x7fc3f406d350 2023-10-06T04:29:05.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.627+0000 7fc3fadff700 1 -- 172.21.15.60:0/1675437165 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f416d190 con 0x7fc3f406d350 2023-10-06T04:29:05.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.628+0000 7fc3fadff700 1 -- 172.21.15.60:0/1675437165 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f4153d60 con 0x7fc3f406d350 2023-10-06T04:29:05.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.629+0000 7fc3f0ff9700 1 -- 172.21.15.60:0/1675437165 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc3ec003040 con 0x7fc3f406d350 2023-10-06T04:29:05.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.630+0000 7fc3f0ff9700 1 --2- 172.21.15.60:0/1675437165 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc3d8066f30 0x7fc3d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:05.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.630+0000 7fc3f0ff9700 1 -- 172.21.15.60:0/1675437165 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fc3ec086440 con 0x7fc3f406d350 2023-10-06T04:29:05.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.630+0000 7fc3f8b9b700 1 --2- 172.21.15.60:0/1675437165 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc3d8066f30 0x7fc3d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:05.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.631+0000 7fc3f8b9b700 1 --2- 172.21.15.60:0/1675437165 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc3d8066f30 0x7fc3d80693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80039e0 tx=0x7fc3e8007ec0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:05.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.634+0000 7fc3f0ff9700 1 -- 172.21.15.60:0/1675437165 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3ec053180 con 0x7fc3f406d350 2023-10-06T04:29:05.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.838+0000 7fc3fadff700 1 -- 172.21.15.60:0/1675437165 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3f4064a90 con 0x7fc3f406d350 2023-10-06T04:29:05.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.839+0000 7fc3f0ff9700 1 -- 172.21.15.60:0/1675437165 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18802 (secure 0 0 0) 0x7fc3ec0567a0 con 0x7fc3f406d350 2023-10-06T04:29:05.841 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:05.841 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":27,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:28:54.367692+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:28:04.355358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T04:28:05.208550+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T04:28:08.791979+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.1a","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:29:05.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.841+0000 7fc3fadff700 1 -- 172.21.15.60:0/1675437165 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc3d8066f30 msgr2=0x7fc3d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:05.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.841+0000 7fc3fadff700 1 --2- 172.21.15.60:0/1675437165 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc3d8066f30 0x7fc3d80693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80039e0 tx=0x7fc3e8007ec0 comp rx=0 tx=0).stop 2023-10-06T04:29:05.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.841+0000 7fc3fadff700 1 -- 172.21.15.60:0/1675437165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3f406d350 msgr2=0x7fc3f40c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:05.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.841+0000 7fc3fadff700 1 --2- 172.21.15.60:0/1675437165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3f406d350 0x7fc3f40c84e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec009880 tx=0x7fc3ec018000 comp rx=0 tx=0).stop 2023-10-06T04:29:05.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.841+0000 7fc3fadff700 1 -- 172.21.15.60:0/1675437165 shutdown_connections 2023-10-06T04:29:05.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.841+0000 7fc3fadff700 1 --2- 172.21.15.60:0/1675437165 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc3d8066f30 0x7fc3d80693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:05.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.841+0000 7fc3fadff700 1 --2- 172.21.15.60:0/1675437165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3f406d350 0x7fc3f40c84e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:05.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.841+0000 7fc3fadff700 1 --2- 172.21.15.60:0/1675437165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3f40696e0 0x7fc3f416b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:05.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.841+0000 7fc3fadff700 1 --2- 172.21.15.60:0/1675437165 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3f4069ab0 0x7fc3f416cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:05.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.841+0000 7fc3fadff700 1 -- 172.21.15.60:0/1675437165 >> 172.21.15.60:0/1675437165 conn(0x7fc3f4068080 msgr2=0x7fc3f40c5630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:05.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.841+0000 7fc3fadff700 1 -- 172.21.15.60:0/1675437165 shutdown_connections 2023-10-06T04:29:05.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:05.841+0000 7fc3fadff700 1 -- 172.21.15.60:0/1675437165 wait complete. 2023-10-06T04:29:05.864 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T04:29:06.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.049+0000 7ff2d759e700 1 Processor -- start 2023-10-06T04:29:06.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.049+0000 7ff2d759e700 1 -- start start 2023-10-06T04:29:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.051+0000 7ff2d759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2d806a590 0x7ff2d81536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.051+0000 7ff2d759e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d80c9cc0 con 0x7ff2d806a960 2023-10-06T04:29:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.051+0000 7ff2d759e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d80c6710 con 0x7ff2d806e660 2023-10-06T04:29:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.051+0000 7ff2d759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d806f560 con 0x7ff2d806a590 2023-10-06T04:29:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.051+0000 7ff2d5d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff2d806a960 0x7ff2d806df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33090/0 (socket says 172.21.15.60:33090) 2023-10-06T04:29:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.051+0000 7ff2d5d9b700 1 -- 172.21.15.60:0/1777855815 learned_addr learned my addr 172.21.15.60:0/1777855815 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:29:06.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.051+0000 7ff2d659c700 1 --2- 172.21.15.60:0/1777855815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2d806a590 0x7ff2d81536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:06.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.051+0000 7ff2d559a700 1 -- 172.21.15.60:0/1777855815 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503320510 0 0) 0x7ff2d80c9cc0 con 0x7ff2d806a960 2023-10-06T04:29:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.051+0000 7ff2d559a700 1 -- 172.21.15.60:0/1777855815 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2c0003570 con 0x7ff2d806a960 2023-10-06T04:29:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d559a700 1 -- 172.21.15.60:0/1777855815 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450587619 0 0) 0x7ff2d80c6710 con 0x7ff2d806e660 2023-10-06T04:29:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d559a700 1 -- 172.21.15.60:0/1777855815 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2d80c9cc0 con 0x7ff2d806e660 2023-10-06T04:29:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d559a700 1 -- 172.21.15.60:0/1777855815 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3831438363 0 0) 0x7ff2c0003570 con 0x7ff2d806a960 2023-10-06T04:29:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d559a700 1 -- 172.21.15.60:0/1777855815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2d806a590 msgr2=0x7ff2d81536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d559a700 1 --2- 172.21.15.60:0/1777855815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2d806a590 0x7ff2d81536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d559a700 1 -- 172.21.15.60:0/1777855815 >> v1:172.21.15.135:6789/0 conn(0x7ff2d806e660 legacy=0x7ff2d80ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d559a700 1 -- 172.21.15.60:0/1777855815 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d806ecc0 con 0x7ff2d806a960 2023-10-06T04:29:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d559a700 1 -- 172.21.15.60:0/1777855815 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7ff2cc001470 con 0x7ff2d806a960 2023-10-06T04:29:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d659c700 1 --2- 172.21.15.60:0/1777855815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2d806a590 0x7ff2d81536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:29:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d559a700 1 -- 172.21.15.60:0/1777855815 >> v1:172.21.15.60:6789/0 conn(0x7ff2d806a960 legacy=0x7ff2d806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d559a700 1 --2- 172.21.15.60:0/1777855815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2c0003c20 0x7ff2c0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d559a700 1 --2- 172.21.15.60:0/1777855815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2d806a590 0x7ff2c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d559a700 1 --2- 172.21.15.60:0/1777855815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2c0004d50 0x7ff2c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d559a700 1 -- 172.21.15.60:0/1777855815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d806f560 con 0x7ff2c0003c20 2023-10-06T04:29:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d559a700 1 -- 172.21.15.60:0/1777855815 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c000bb70 con 0x7ff2c0004d50 2023-10-06T04:29:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d559a700 1 -- 172.21.15.60:0/1777855815 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c000bd30 con 0x7ff2d806a590 2023-10-06T04:29:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d659c700 1 --2- 172.21.15.60:0/1777855815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2c0003c20 0x7ff2c0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d5d9b700 1 --2- 172.21.15.60:0/1777855815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2d806a590 0x7ff2c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d6d9d700 1 --2- 172.21.15.60:0/1777855815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2c0004d50 0x7ff2c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d659c700 1 -- 172.21.15.60:0/1777855815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2d806a590 msgr2=0x7ff2c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.052+0000 7ff2d659c700 1 --2- 172.21.15.60:0/1777855815 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2d806a590 0x7ff2c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.053+0000 7ff2d659c700 1 -- 172.21.15.60:0/1777855815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2c0004d50 msgr2=0x7ff2c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.053+0000 7ff2d659c700 1 --2- 172.21.15.60:0/1777855815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2c0004d50 0x7ff2c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.053+0000 7ff2d659c700 1 -- 172.21.15.60:0/1777855815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c8009420 con 0x7ff2c0003c20 2023-10-06T04:29:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.053+0000 7ff2d659c700 1 --2- 172.21.15.60:0/1777855815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2c0003c20 0x7ff2c0004010 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8009df0 tx=0x7ff2c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170b5fc7fb4d611a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.053+0000 7ff2d559a700 1 -- 172.21.15.60:0/1777855815 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8009740 con 0x7ff2c0003c20 2023-10-06T04:29:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.053+0000 7ff2d559a700 1 -- 172.21.15.60:0/1777855815 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c800e920 con 0x7ff2c0003c20 2023-10-06T04:29:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.053+0000 7ff2d559a700 1 -- 172.21.15.60:0/1777855815 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c800ece0 con 0x7ff2c0003c20 2023-10-06T04:29:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.053+0000 7ff2d759e700 1 -- 172.21.15.60:0/1777855815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2c0003c20 msgr2=0x7ff2c0004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.053+0000 7ff2d759e700 1 --2- 172.21.15.60:0/1777855815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2c0003c20 0x7ff2c0004010 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8009df0 tx=0x7ff2c80091a0 comp rx=0 tx=0).stop 2023-10-06T04:29:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.053+0000 7ff2d6d9d700 1 -- 172.21.15.60:0/1777855815 reap_dead start 2023-10-06T04:29:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.054+0000 7ff2d759e700 1 -- 172.21.15.60:0/1777855815 shutdown_connections 2023-10-06T04:29:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.054+0000 7ff2d759e700 1 -- 172.21.15.60:0/1777855815 >> 172.21.15.60:0/1777855815 conn(0x7ff2d8068080 msgr2=0x7ff2d80cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.054+0000 7ff2d759e700 1 -- 172.21.15.60:0/1777855815 shutdown_connections 2023-10-06T04:29:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.054+0000 7ff2d759e700 1 -- 172.21.15.60:0/1777855815 wait complete. 2023-10-06T04:29:06.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.055+0000 7ff2d759e700 1 Processor -- start 2023-10-06T04:29:06.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.055+0000 7ff2d759e700 1 -- start start 2023-10-06T04:29:06.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.056+0000 7ff2d759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2c0003c20 0x7ff2d8155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:06.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.056+0000 7ff2d759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2d81534c0 0x7ff2d8130650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:06.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.056+0000 7ff2d759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2d8130b90 0x7ff2d8156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:06.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.056+0000 7ff2d759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d8156ac0 con 0x7ff2c0003c20 2023-10-06T04:29:06.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.056+0000 7ff2d759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d8131010 con 0x7ff2d8130b90 2023-10-06T04:29:06.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.056+0000 7ff2d759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d80b09f0 con 0x7ff2d81534c0 2023-10-06T04:29:06.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.056+0000 7ff2d659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2c0003c20 0x7ff2d8155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:06.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.056+0000 7ff2d659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2c0003c20 0x7ff2d8155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52824/0 (socket says 172.21.15.60:52824) 2023-10-06T04:29:06.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.056+0000 7ff2d659c700 1 -- 172.21.15.60:0/3527397419 learned_addr learned my addr 172.21.15.60:0/3527397419 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:06.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.056+0000 7ff2d6d9d700 1 --2- 172.21.15.60:0/3527397419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2d8130b90 0x7ff2d8156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:06.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.056+0000 7ff2d5d9b700 1 --2- 172.21.15.60:0/3527397419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2d81534c0 0x7ff2d8130650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:06.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.057+0000 7ff2d659c700 1 -- 172.21.15.60:0/3527397419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2d81534c0 msgr2=0x7ff2d8130650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:06.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.057+0000 7ff2d659c700 1 --2- 172.21.15.60:0/3527397419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2d81534c0 0x7ff2d8130650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:06.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.057+0000 7ff2d659c700 1 -- 172.21.15.60:0/3527397419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2d8130b90 msgr2=0x7ff2d8156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:06.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.057+0000 7ff2d659c700 1 --2- 172.21.15.60:0/3527397419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2d8130b90 0x7ff2d8156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:06.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.057+0000 7ff2d659c700 1 -- 172.21.15.60:0/3527397419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d80b0cd0 con 0x7ff2c0003c20 2023-10-06T04:29:06.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.057+0000 7ff2d6d9d700 1 --2- 172.21.15.60:0/3527397419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2d8130b90 0x7ff2d8156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:06.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.057+0000 7ff2d5d9b700 1 --2- 172.21.15.60:0/3527397419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2d81534c0 0x7ff2d8130650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:06.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.057+0000 7ff2d659c700 1 --2- 172.21.15.60:0/3527397419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2c0003c20 0x7ff2d8155100 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000bb40 tx=0x7ff2c801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:06.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.057+0000 7ff2c67fc700 1 -- 172.21.15.60:0/3527397419 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8022070 con 0x7ff2c0003c20 2023-10-06T04:29:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.057+0000 7ff2c67fc700 1 -- 172.21.15.60:0/3527397419 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c8009740 con 0x7ff2c0003c20 2023-10-06T04:29:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.057+0000 7ff2c67fc700 1 -- 172.21.15.60:0/3527397419 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c801c450 con 0x7ff2c0003c20 2023-10-06T04:29:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.057+0000 7ff2d759e700 1 -- 172.21.15.60:0/3527397419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d80b0fb0 con 0x7ff2c0003c20 2023-10-06T04:29:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.057+0000 7ff2d759e700 1 -- 172.21.15.60:0/3527397419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d8143430 con 0x7ff2c0003c20 2023-10-06T04:29:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.059+0000 7ff2d759e700 1 -- 172.21.15.60:0/3527397419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d805f230 con 0x7ff2c0003c20 2023-10-06T04:29:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.059+0000 7ff2c67fc700 1 -- 172.21.15.60:0/3527397419 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2c8026070 con 0x7ff2c0003c20 2023-10-06T04:29:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.060+0000 7ff2c67fc700 1 --2- 172.21.15.60:0/3527397419 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff2b8066f30 0x7ff2b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.060+0000 7ff2c67fc700 1 -- 172.21.15.60:0/3527397419 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6867+0+0 (secure 0 0 0) 0x7ff2c80862c0 con 0x7ff2c0003c20 2023-10-06T04:29:06.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.061+0000 7ff2d5d9b700 1 --2- 172.21.15.60:0/3527397419 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff2b8066f30 0x7ff2b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:06.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.061+0000 7ff2d5d9b700 1 --2- 172.21.15.60:0/3527397419 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff2b8066f30 0x7ff2b80693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc001ed0 tx=0x7ff2cc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:06.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.065+0000 7ff2c67fc700 1 -- 172.21.15.60:0/3527397419 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2c8053130 con 0x7ff2c0003c20 2023-10-06T04:29:06.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.311+0000 7ff2d759e700 1 -- 172.21.15.60:0/3527397419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff2d80b1a90 con 0x7ff2c0003c20 2023-10-06T04:29:06.313 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-06T04:29:06.311+0000 7f7860df1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T04:29:06.318 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.316+0000 7ff2c67fc700 1 -- 172.21.15.60:0/3527397419 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff2c80566d0 con 0x7ff2c0003c20 2023-10-06T04:29:06.322 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.319+0000 7ff2d759e700 1 -- 172.21.15.60:0/3527397419 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff2b8066f30 msgr2=0x7ff2b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:06.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.319+0000 7ff2d759e700 1 --2- 172.21.15.60:0/3527397419 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff2b8066f30 0x7ff2b80693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc001ed0 tx=0x7ff2cc009040 comp rx=0 tx=0).stop 2023-10-06T04:29:06.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.319+0000 7ff2d759e700 1 -- 172.21.15.60:0/3527397419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2c0003c20 msgr2=0x7ff2d8155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:06.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.319+0000 7ff2d759e700 1 --2- 172.21.15.60:0/3527397419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2c0003c20 0x7ff2d8155100 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000bb40 tx=0x7ff2c801a000 comp rx=0 tx=0).stop 2023-10-06T04:29:06.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.320+0000 7ff2d759e700 1 -- 172.21.15.60:0/3527397419 shutdown_connections 2023-10-06T04:29:06.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.320+0000 7ff2d759e700 1 --2- 172.21.15.60:0/3527397419 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff2b8066f30 0x7ff2b80693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:06.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.320+0000 7ff2d759e700 1 --2- 172.21.15.60:0/3527397419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2c0003c20 0x7ff2d8155100 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:06.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.320+0000 7ff2d759e700 1 --2- 172.21.15.60:0/3527397419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2d8130b90 0x7ff2d8156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:06.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.320+0000 7ff2d759e700 1 --2- 172.21.15.60:0/3527397419 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff2d81534c0 0x7ff2d8130650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:06.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.320+0000 7ff2d759e700 1 -- 172.21.15.60:0/3527397419 >> 172.21.15.60:0/3527397419 conn(0x7ff2d8068080 msgr2=0x7ff2d80cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:06.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.320+0000 7ff2d759e700 1 -- 172.21.15.60:0/3527397419 shutdown_connections 2023-10-06T04:29:06.323 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.320+0000 7ff2d759e700 1 -- 172.21.15.60:0/3527397419 wait complete. 2023-10-06T04:29:06.324 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T04:29:06.327 INFO:tasks.ceph.mds.c.smithi060.stderr: -4277> 2023-10-06T04:28:10.363+0000 7fbec93f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:29:06.340 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T04:29:06.378 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-10-06T04:29:06.537 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.535+0000 7fa86eb9d700 1 Processor -- start 2023-10-06T04:29:06.538 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.535+0000 7fa86eb9d700 1 -- start start 2023-10-06T04:29:06.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.536+0000 7fa86eb9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa86806e160 0x7fa86806e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:06.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.536+0000 7fa86eb9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8680acad0 con 0x7fa8681560f0 2023-10-06T04:29:06.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.536+0000 7fa86eb9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa86806eac0 con 0x7fa868159c60 2023-10-06T04:29:06.539 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.536+0000 7fa86eb9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa86815a0e0 con 0x7fa86806e160 2023-10-06T04:29:06.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.537+0000 7fa86db9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa8681560f0 0x7fa8680ae0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33098/0 (socket says 172.21.15.60:33098) 2023-10-06T04:29:06.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.537+0000 7fa86db9b700 1 -- 172.21.15.60:0/2293227680 learned_addr learned my addr 172.21.15.60:0/2293227680 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:29:06.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.537+0000 7fa86e39c700 1 --2- 172.21.15.60:0/2293227680 >> v2:172.21.15.135:3300/0 conn(0x7fa86806e160 0x7fa86806e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:06.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.537+0000 7fa86cb99700 1 -- 172.21.15.60:0/2293227680 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299768645 0 0) 0x7fa8680acad0 con 0x7fa8681560f0 2023-10-06T04:29:06.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.537+0000 7fa86cb99700 1 -- 172.21.15.60:0/2293227680 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa854003570 con 0x7fa8681560f0 2023-10-06T04:29:06.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.537+0000 7fa86e39c700 1 -- 172.21.15.60:0/2293227680 >> v1:172.21.15.135:6789/0 conn(0x7fa868159c60 legacy=0x7fa8680c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:06.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.538+0000 7fa86cb99700 1 -- 172.21.15.60:0/2293227680 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249086931 0 0) 0x7fa86806eac0 con 0x7fa868159c60 2023-10-06T04:29:06.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.538+0000 7fa86e39c700 1 -- 172.21.15.60:0/2293227680 >> v1:172.21.15.60:6789/0 conn(0x7fa8681560f0 legacy=0x7fa8680ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:06.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.538+0000 7fa86e39c700 1 -- 172.21.15.60:0/2293227680 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8681564c0 con 0x7fa86806e160 2023-10-06T04:29:06.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.538+0000 7fa86e39c700 1 --2- 172.21.15.60:0/2293227680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa86806e160 0x7fa86806e580 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa860009e60 tx=0x7fa860009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=727035c0fff30a6b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:06.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.538+0000 7fa86cb99700 1 -- 172.21.15.60:0/2293227680 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86000e070 con 0x7fa86806e160 2023-10-06T04:29:06.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.538+0000 7fa86cb99700 1 -- 172.21.15.60:0/2293227680 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86000bbf0 con 0x7fa86806e160 2023-10-06T04:29:06.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.538+0000 7fa86cb99700 1 -- 172.21.15.60:0/2293227680 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa860012430 con 0x7fa86806e160 2023-10-06T04:29:06.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.539+0000 7fa86eb9d700 1 -- 172.21.15.60:0/2293227680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa86806e160 msgr2=0x7fa86806e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:06.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.539+0000 7fa86eb9d700 1 --2- 172.21.15.60:0/2293227680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa86806e160 0x7fa86806e580 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa860009e60 tx=0x7fa860009780 comp rx=0 tx=0).stop 2023-10-06T04:29:06.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.539+0000 7fa86eb9d700 1 -- 172.21.15.60:0/2293227680 shutdown_connections 2023-10-06T04:29:06.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.539+0000 7fa86eb9d700 1 --2- 172.21.15.60:0/2293227680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa86806e160 0x7fa86806e580 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:06.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.539+0000 7fa86eb9d700 1 -- 172.21.15.60:0/2293227680 >> 172.21.15.60:0/2293227680 conn(0x7fa8680cbed0 msgr2=0x7fa8680cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:06.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.539+0000 7fa86eb9d700 1 -- 172.21.15.60:0/2293227680 shutdown_connections 2023-10-06T04:29:06.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.539+0000 7fa86eb9d700 1 -- 172.21.15.60:0/2293227680 wait complete. 2023-10-06T04:29:06.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.540+0000 7fa86eb9d700 1 Processor -- start 2023-10-06T04:29:06.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.540+0000 7fa86eb9d700 1 -- start start 2023-10-06T04:29:06.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.541+0000 7fa86eb9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa86806e160 0x7fa86816a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:06.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.541+0000 7fa86eb9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8681560f0 0x7fa868069100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:06.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.541+0000 7fa86eb9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa868159c60 0x7fa868069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:06.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.541+0000 7fa86eb9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86816b760 con 0x7fa868159c60 2023-10-06T04:29:06.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.541+0000 7fa86eb9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86816ab90 con 0x7fa8681560f0 2023-10-06T04:29:06.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.541+0000 7fa86eb9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86816ae30 con 0x7fa86806e160 2023-10-06T04:29:06.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.542+0000 7fa86e39c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa868159c60 0x7fa868069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:06.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.542+0000 7fa86e39c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa868159c60 0x7fa868069640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52862/0 (socket says 172.21.15.60:52862) 2023-10-06T04:29:06.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.542+0000 7fa86e39c700 1 -- 172.21.15.60:0/3225000566 learned_addr learned my addr 172.21.15.60:0/3225000566 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:06.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.542+0000 7fa86db9b700 1 --2- 172.21.15.60:0/3225000566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa86806e160 0x7fa86816a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:06.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.542+0000 7fa86d39a700 1 --2- 172.21.15.60:0/3225000566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8681560f0 0x7fa868069100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:06.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.542+0000 7fa86e39c700 1 -- 172.21.15.60:0/3225000566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa86806e160 msgr2=0x7fa86816a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:06.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.542+0000 7fa86e39c700 1 --2- 172.21.15.60:0/3225000566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa86806e160 0x7fa86816a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:06.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.542+0000 7fa86e39c700 1 -- 172.21.15.60:0/3225000566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8681560f0 msgr2=0x7fa868069100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:06.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.542+0000 7fa86e39c700 1 --2- 172.21.15.60:0/3225000566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8681560f0 0x7fa868069100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:06.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.542+0000 7fa86e39c700 1 -- 172.21.15.60:0/3225000566 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa860009a20 con 0x7fa868159c60 2023-10-06T04:29:06.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.542+0000 7fa86e39c700 1 --2- 172.21.15.60:0/3225000566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa868159c60 0x7fa868069640 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa8600099f0 tx=0x7fa860019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:06.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.543+0000 7fa85dffb700 1 -- 172.21.15.60:0/3225000566 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa860026480 con 0x7fa868159c60 2023-10-06T04:29:06.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.543+0000 7fa85dffb700 1 -- 172.21.15.60:0/3225000566 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa860026620 con 0x7fa868159c60 2023-10-06T04:29:06.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.543+0000 7fa85dffb700 1 -- 172.21.15.60:0/3225000566 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8600269e0 con 0x7fa868159c60 2023-10-06T04:29:06.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.543+0000 7fa86eb9d700 1 -- 172.21.15.60:0/3225000566 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa86816b110 con 0x7fa868159c60 2023-10-06T04:29:06.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.543+0000 7fa86eb9d700 1 -- 172.21.15.60:0/3225000566 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa86816a6e0 con 0x7fa868159c60 2023-10-06T04:29:06.547 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.544+0000 7fa86eb9d700 1 -- 172.21.15.60:0/3225000566 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa86805f230 con 0x7fa868159c60 2023-10-06T04:29:06.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.545+0000 7fa85dffb700 1 -- 172.21.15.60:0/3225000566 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa86001c400 con 0x7fa868159c60 2023-10-06T04:29:06.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.546+0000 7fa85dffb700 1 --2- 172.21.15.60:0/3225000566 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa84c066f30 0x7fa84c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:06.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.546+0000 7fa85dffb700 1 -- 172.21.15.60:0/3225000566 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6953+0+0 (secure 0 0 0) 0x7fa860086a80 con 0x7fa868159c60 2023-10-06T04:29:06.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.546+0000 7fa86db9b700 1 --2- 172.21.15.60:0/3225000566 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa84c066f30 0x7fa84c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:06.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.547+0000 7fa86db9b700 1 --2- 172.21.15.60:0/3225000566 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa84c066f30 0x7fa84c0693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa864007fd0 tx=0x7fa864009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:06.553 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.551+0000 7fa85dffb700 1 -- 172.21.15.60:0/3225000566 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa860053770 con 0x7fa868159c60 2023-10-06T04:29:06.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:06.801+0000 7fa86eb9d700 1 -- 172.21.15.60:0/3225000566 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa86815a2d0 con 0x7fa868159c60 2023-10-06T04:29:07.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.333+0000 7fa85dffb700 1 -- 172.21.15.60:0/3225000566 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa860056d90 con 0x7fa868159c60 2023-10-06T04:29:07.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.336+0000 7fa86eb9d700 1 -- 172.21.15.60:0/3225000566 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa84c066f30 msgr2=0x7fa84c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:07.339 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.336+0000 7fa86eb9d700 1 --2- 172.21.15.60:0/3225000566 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa84c066f30 0x7fa84c0693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa864007fd0 tx=0x7fa864009040 comp rx=0 tx=0).stop 2023-10-06T04:29:07.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.336+0000 7fa86eb9d700 1 -- 172.21.15.60:0/3225000566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa868159c60 msgr2=0x7fa868069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:07.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.336+0000 7fa86eb9d700 1 --2- 172.21.15.60:0/3225000566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa868159c60 0x7fa868069640 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa8600099f0 tx=0x7fa860019000 comp rx=0 tx=0).stop 2023-10-06T04:29:07.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.336+0000 7fa86eb9d700 1 -- 172.21.15.60:0/3225000566 shutdown_connections 2023-10-06T04:29:07.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.336+0000 7fa86eb9d700 1 --2- 172.21.15.60:0/3225000566 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa84c066f30 0x7fa84c0693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:07.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.336+0000 7fa86eb9d700 1 --2- 172.21.15.60:0/3225000566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa868159c60 0x7fa868069640 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:07.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.336+0000 7fa86eb9d700 1 --2- 172.21.15.60:0/3225000566 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa86806e160 0x7fa86816a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:07.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.336+0000 7fa86eb9d700 1 --2- 172.21.15.60:0/3225000566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8681560f0 0x7fa868069100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:07.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.336+0000 7fa86eb9d700 1 -- 172.21.15.60:0/3225000566 >> 172.21.15.60:0/3225000566 conn(0x7fa8680cbed0 msgr2=0x7fa8680cc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:07.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.337+0000 7fa86eb9d700 1 -- 172.21.15.60:0/3225000566 shutdown_connections 2023-10-06T04:29:07.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.337+0000 7fa86eb9d700 1 -- 172.21.15.60:0/3225000566 wait complete. 2023-10-06T04:29:07.359 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T04:29:07.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.592+0000 7fbe9b39d700 1 Processor -- start 2023-10-06T04:29:07.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.592+0000 7fbe9b39d700 1 -- start start 2023-10-06T04:29:07.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.593+0000 7fbe9b39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbe941592d0 0x7fbe940a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:07.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.593+0000 7fbe9b39d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe941596a0 0x7fbe9406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:07.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.593+0000 7fbe9b39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe9406e730 0x7fbe940c1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:07.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.593+0000 7fbe9b39d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9406ebd0 con 0x7fbe941596a0 2023-10-06T04:29:07.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.593+0000 7fbe9b39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe940a9de0 con 0x7fbe941592d0 2023-10-06T04:29:07.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.593+0000 7fbe9b39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9406ee40 con 0x7fbe9406e730 2023-10-06T04:29:07.598 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.594+0000 7fbe99b9a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe941596a0 0x7fbe9406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:07.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.594+0000 7fbe99b9a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe941596a0 0x7fbe9406e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52874/0 (socket says 172.21.15.60:52874) 2023-10-06T04:29:07.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.594+0000 7fbe99b9a700 1 -- 172.21.15.60:0/908812888 learned_addr learned my addr 172.21.15.60:0/908812888 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:07.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.594+0000 7fbe9ab9c700 1 --2- 172.21.15.60:0/908812888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe9406e730 0x7fbe940c1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:07.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.594+0000 7fbe9a39b700 1 --2- 172.21.15.60:0/908812888 >> v2:172.21.15.135:3300/0 conn(0x7fbe941592d0 0x7fbe940a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:07.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.594+0000 7fbe99b9a700 1 -- 172.21.15.60:0/908812888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe9406e730 msgr2=0x7fbe940c1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:07.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.594+0000 7fbe99b9a700 1 --2- 172.21.15.60:0/908812888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe9406e730 0x7fbe940c1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:07.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.594+0000 7fbe99b9a700 1 -- 172.21.15.60:0/908812888 >> v2:172.21.15.135:3300/0 conn(0x7fbe941592d0 msgr2=0x7fbe940a98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:07.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.594+0000 7fbe99b9a700 1 --2- 172.21.15.60:0/908812888 >> v2:172.21.15.135:3300/0 conn(0x7fbe941592d0 0x7fbe940a98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:07.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.594+0000 7fbe99b9a700 1 -- 172.21.15.60:0/908812888 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9406f120 con 0x7fbe941596a0 2023-10-06T04:29:07.599 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.594+0000 7fbe99b9a700 1 --2- 172.21.15.60:0/908812888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe941596a0 0x7fbe9406e1f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbe940caad0 tx=0x7fbe84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda8ff16cd6657fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:07.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.595+0000 7fbe99399700 1 -- 172.21.15.60:0/908812888 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8400b860 con 0x7fbe941596a0 2023-10-06T04:29:07.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.595+0000 7fbe99399700 1 -- 172.21.15.60:0/908812888 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8400b9c0 con 0x7fbe941596a0 2023-10-06T04:29:07.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.595+0000 7fbe99399700 1 -- 172.21.15.60:0/908812888 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8400bd60 con 0x7fbe941596a0 2023-10-06T04:29:07.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.595+0000 7fbe9b39d700 1 -- 172.21.15.60:0/908812888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe941596a0 msgr2=0x7fbe9406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:07.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.595+0000 7fbe9b39d700 1 --2- 172.21.15.60:0/908812888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe941596a0 0x7fbe9406e1f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbe940caad0 tx=0x7fbe84009250 comp rx=0 tx=0).stop 2023-10-06T04:29:07.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.595+0000 7fbe9b39d700 1 -- 172.21.15.60:0/908812888 shutdown_connections 2023-10-06T04:29:07.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.595+0000 7fbe9b39d700 1 --2- 172.21.15.60:0/908812888 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe9406e730 0x7fbe940c1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:07.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.595+0000 7fbe9b39d700 1 --2- 172.21.15.60:0/908812888 >> v2:172.21.15.135:3300/0 conn(0x7fbe941592d0 0x7fbe940a98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:07.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.595+0000 7fbe9b39d700 1 --2- 172.21.15.60:0/908812888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe941596a0 0x7fbe9406e1f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:07.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.595+0000 7fbe9b39d700 1 -- 172.21.15.60:0/908812888 >> 172.21.15.60:0/908812888 conn(0x7fbe94069160 msgr2=0x7fbe940ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:07.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.595+0000 7fbe9b39d700 1 -- 172.21.15.60:0/908812888 shutdown_connections 2023-10-06T04:29:07.601 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.595+0000 7fbe9b39d700 1 -- 172.21.15.60:0/908812888 wait complete. 2023-10-06T04:29:07.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.597+0000 7fbe9b39d700 1 Processor -- start 2023-10-06T04:29:07.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.597+0000 7fbe9b39d700 1 -- start start 2023-10-06T04:29:07.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.598+0000 7fbe9b39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe9406e730 0x7fbe940c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:07.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.598+0000 7fbe9b39d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe941592d0 0x7fbe94157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:07.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.598+0000 7fbe9b39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe941596a0 0x7fbe940cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:07.603 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.598+0000 7fbe9b39d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe941692b0 con 0x7fbe941592d0 2023-10-06T04:29:07.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.598+0000 7fbe9b39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9416a0d0 con 0x7fbe941596a0 2023-10-06T04:29:07.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.598+0000 7fbe9b39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe94157ea0 con 0x7fbe9406e730 2023-10-06T04:29:07.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.598+0000 7fbe99b9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe941592d0 0x7fbe94157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:07.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.598+0000 7fbe99b9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe941592d0 0x7fbe94157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52876/0 (socket says 172.21.15.60:52876) 2023-10-06T04:29:07.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.598+0000 7fbe99b9a700 1 -- 172.21.15.60:0/1113699441 learned_addr learned my addr 172.21.15.60:0/1113699441 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:07.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.599+0000 7fbe9a39b700 1 --2- 172.21.15.60:0/1113699441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe9406e730 0x7fbe940c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:07.604 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.599+0000 7fbe99b9a700 1 -- 172.21.15.60:0/1113699441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe9406e730 msgr2=0x7fbe940c4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:07.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.599+0000 7fbe99b9a700 1 --2- 172.21.15.60:0/1113699441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe9406e730 0x7fbe940c4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:07.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.599+0000 7fbe99b9a700 1 -- 172.21.15.60:0/1113699441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe941596a0 msgr2=0x7fbe940cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:07.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.599+0000 7fbe9ab9c700 1 --2- 172.21.15.60:0/1113699441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe941596a0 0x7fbe940cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:07.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.599+0000 7fbe99b9a700 1 --2- 172.21.15.60:0/1113699441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe941596a0 0x7fbe940cbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:07.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.599+0000 7fbe99b9a700 1 -- 172.21.15.60:0/1113699441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe840094f0 con 0x7fbe941592d0 2023-10-06T04:29:07.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.599+0000 7fbe9a39b700 1 --2- 172.21.15.60:0/1113699441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe9406e730 0x7fbe940c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:07.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.599+0000 7fbe99b9a700 1 --2- 172.21.15.60:0/1113699441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe941592d0 0x7fbe94157960 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbe940696a0 tx=0x7fbe84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:07.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.599+0000 7fbe8a7fc700 1 -- 172.21.15.60:0/1113699441 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8401a450 con 0x7fbe941592d0 2023-10-06T04:29:07.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.599+0000 7fbe8a7fc700 1 -- 172.21.15.60:0/1113699441 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8401a5b0 con 0x7fbe941592d0 2023-10-06T04:29:07.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.599+0000 7fbe8a7fc700 1 -- 172.21.15.60:0/1113699441 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8401a970 con 0x7fbe941592d0 2023-10-06T04:29:07.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.599+0000 7fbe9b39d700 1 -- 172.21.15.60:0/1113699441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe941694c0 con 0x7fbe941592d0 2023-10-06T04:29:07.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.599+0000 7fbe9b39d700 1 -- 172.21.15.60:0/1113699441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe94169a80 con 0x7fbe941592d0 2023-10-06T04:29:07.606 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.600+0000 7fbe9b39d700 1 -- 172.21.15.60:0/1113699441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe9405f230 con 0x7fbe941592d0 2023-10-06T04:29:07.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.601+0000 7fbe8a7fc700 1 -- 172.21.15.60:0/1113699441 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe8401ad20 con 0x7fbe941592d0 2023-10-06T04:29:07.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.602+0000 7fbe8a7fc700 1 --2- 172.21.15.60:0/1113699441 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbe78066f30 0x7fbe780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:07.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.602+0000 7fbe8a7fc700 1 -- 172.21.15.60:0/1113699441 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6953+0+0 (secure 0 0 0) 0x7fbe84086780 con 0x7fbe941592d0 2023-10-06T04:29:07.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.602+0000 7fbe9a39b700 1 --2- 172.21.15.60:0/1113699441 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbe78066f30 0x7fbe780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:07.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.603+0000 7fbe9a39b700 1 --2- 172.21.15.60:0/1113699441 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbe78066f30 0x7fbe780693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbe90006fd0 tx=0x7fbe90008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:07.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.606+0000 7fbe8a7fc700 1 -- 172.21.15.60:0/1113699441 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe84053470 con 0x7fbe941592d0 2023-10-06T04:29:07.811 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:07.809+0000 7fbe9b39d700 1 -- 172.21.15.60:0/1113699441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbe940aecf0 con 0x7fbe941592d0 2023-10-06T04:29:08.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.424+0000 7fbe8a7fc700 1 -- 172.21.15.60:0/1113699441 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbe84056a90 con 0x7fbe941592d0 2023-10-06T04:29:08.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.428+0000 7fbe9b39d700 1 -- 172.21.15.60:0/1113699441 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbe78066f30 msgr2=0x7fbe780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:08.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.428+0000 7fbe9b39d700 1 --2- 172.21.15.60:0/1113699441 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbe78066f30 0x7fbe780693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbe90006fd0 tx=0x7fbe90008040 comp rx=0 tx=0).stop 2023-10-06T04:29:08.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.428+0000 7fbe9b39d700 1 -- 172.21.15.60:0/1113699441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe941592d0 msgr2=0x7fbe94157960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:08.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.428+0000 7fbe9b39d700 1 --2- 172.21.15.60:0/1113699441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe941592d0 0x7fbe94157960 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbe940696a0 tx=0x7fbe84017000 comp rx=0 tx=0).stop 2023-10-06T04:29:08.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.428+0000 7fbe9b39d700 1 -- 172.21.15.60:0/1113699441 shutdown_connections 2023-10-06T04:29:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.428+0000 7fbe9b39d700 1 --2- 172.21.15.60:0/1113699441 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbe78066f30 0x7fbe780693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.428+0000 7fbe9b39d700 1 --2- 172.21.15.60:0/1113699441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe941596a0 0x7fbe940cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.428+0000 7fbe9b39d700 1 --2- 172.21.15.60:0/1113699441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe9406e730 0x7fbe940c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.428+0000 7fbe9b39d700 1 --2- 172.21.15.60:0/1113699441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe941592d0 0x7fbe94157960 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.428+0000 7fbe9b39d700 1 -- 172.21.15.60:0/1113699441 >> 172.21.15.60:0/1113699441 conn(0x7fbe94069160 msgr2=0x7fbe9406ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.428+0000 7fbe9b39d700 1 -- 172.21.15.60:0/1113699441 shutdown_connections 2023-10-06T04:29:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.428+0000 7fbe9b39d700 1 -- 172.21.15.60:0/1113699441 wait complete. 2023-10-06T04:29:08.433 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2023-10-06T04:29:08.450 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T04:29:08.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.645+0000 7faf3a39d700 1 Processor -- start 2023-10-06T04:29:08.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.645+0000 7faf3a39d700 1 -- start start 2023-10-06T04:29:08.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.647+0000 7faf3a39d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faf3406aa90 0x7faf3406d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:08.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.647+0000 7faf3a39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3406b960 0x7faf340af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:08.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.647+0000 7faf3a39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7faf3406ae60 0x7faf34158f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:08.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.647+0000 7faf3a39d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf340c75b0 con 0x7faf3406aa90 2023-10-06T04:29:08.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.647+0000 7faf3a39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3406e6b0 con 0x7faf3406ae60 2023-10-06T04:29:08.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.647+0000 7faf3a39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3406daa0 con 0x7faf3406b960 2023-10-06T04:29:08.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.647+0000 7faf3939b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faf3406aa90 0x7faf3406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:08.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.647+0000 7faf3939b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faf3406aa90 0x7faf3406d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52878/0 (socket says 172.21.15.60:52878) 2023-10-06T04:29:08.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.647+0000 7faf3939b700 1 -- 172.21.15.60:0/3395504473 learned_addr learned my addr 172.21.15.60:0/3395504473 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:08.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.647+0000 7faf38b9a700 1 --2- 172.21.15.60:0/3395504473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3406b960 0x7faf340af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:08.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.647+0000 7faf39b9c700 1 --2- 172.21.15.60:0/3395504473 >> v2:172.21.15.135:3300/0 conn(0x7faf3406ae60 0x7faf34158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:08.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.647+0000 7faf3939b700 1 -- 172.21.15.60:0/3395504473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3406b960 msgr2=0x7faf340af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:08.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.647+0000 7faf3939b700 1 --2- 172.21.15.60:0/3395504473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3406b960 0x7faf340af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:08.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.647+0000 7faf3939b700 1 -- 172.21.15.60:0/3395504473 >> v2:172.21.15.135:3300/0 conn(0x7faf3406ae60 msgr2=0x7faf34158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:08.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.647+0000 7faf3939b700 1 --2- 172.21.15.60:0/3395504473 >> v2:172.21.15.135:3300/0 conn(0x7faf3406ae60 0x7faf34158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:08.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.647+0000 7faf3939b700 1 -- 172.21.15.60:0/3395504473 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3406dd80 con 0x7faf3406aa90 2023-10-06T04:29:08.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.648+0000 7faf3939b700 1 --2- 172.21.15.60:0/3395504473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3406aa90 0x7faf3406d410 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faf300099b0 tx=0x7faf30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1b29d8ba47a874 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:08.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.648+0000 7faf2bfff700 1 -- 172.21.15.60:0/3395504473 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3000b820 con 0x7faf3406aa90 2023-10-06T04:29:08.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.648+0000 7faf2bfff700 1 -- 172.21.15.60:0/3395504473 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3000b980 con 0x7faf3406aa90 2023-10-06T04:29:08.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.648+0000 7faf2bfff700 1 -- 172.21.15.60:0/3395504473 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3000bd20 con 0x7faf3406aa90 2023-10-06T04:29:08.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.648+0000 7faf3a39d700 1 -- 172.21.15.60:0/3395504473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3406aa90 msgr2=0x7faf3406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:08.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.648+0000 7faf3a39d700 1 --2- 172.21.15.60:0/3395504473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3406aa90 0x7faf3406d410 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faf300099b0 tx=0x7faf30009250 comp rx=0 tx=0).stop 2023-10-06T04:29:08.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.648+0000 7faf3a39d700 1 -- 172.21.15.60:0/3395504473 shutdown_connections 2023-10-06T04:29:08.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.648+0000 7faf3a39d700 1 --2- 172.21.15.60:0/3395504473 >> v2:172.21.15.135:3300/0 conn(0x7faf3406ae60 0x7faf34158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:08.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.648+0000 7faf3a39d700 1 --2- 172.21.15.60:0/3395504473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3406aa90 0x7faf3406d410 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:08.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.648+0000 7faf3a39d700 1 --2- 172.21.15.60:0/3395504473 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3406b960 0x7faf340af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:08.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.648+0000 7faf3a39d700 1 -- 172.21.15.60:0/3395504473 >> 172.21.15.60:0/3395504473 conn(0x7faf3406a090 msgr2=0x7faf340cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:08.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.649+0000 7faf3a39d700 1 -- 172.21.15.60:0/3395504473 shutdown_connections 2023-10-06T04:29:08.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.649+0000 7faf3a39d700 1 -- 172.21.15.60:0/3395504473 wait complete. 2023-10-06T04:29:08.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.650+0000 7faf3a39d700 1 Processor -- start 2023-10-06T04:29:08.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.650+0000 7faf3a39d700 1 -- start start 2023-10-06T04:29:08.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.651+0000 7faf3a39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3406aa90 0x7faf3414a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:08.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.651+0000 7faf3a39d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3406ae60 0x7faf3414b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:08.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.651+0000 7faf3a39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf3406b960 0x7faf3414bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:08.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.651+0000 7faf3a39d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3414c610 con 0x7faf3406ae60 2023-10-06T04:29:08.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.651+0000 7faf3a39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3414c8f0 con 0x7faf3406b960 2023-10-06T04:29:08.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.651+0000 7faf3a39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3414cbd0 con 0x7faf3406aa90 2023-10-06T04:29:08.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.651+0000 7faf38b9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3406ae60 0x7faf3414b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:08.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.651+0000 7faf38b9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3406ae60 0x7faf3414b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52886/0 (socket says 172.21.15.60:52886) 2023-10-06T04:29:08.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.651+0000 7faf38b9a700 1 -- 172.21.15.60:0/673064786 learned_addr learned my addr 172.21.15.60:0/673064786 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:08.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.652+0000 7faf3939b700 1 --2- 172.21.15.60:0/673064786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3406aa90 0x7faf3414a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:08.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.652+0000 7faf39b9c700 1 --2- 172.21.15.60:0/673064786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf3406b960 0x7faf3414bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:08.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.652+0000 7faf38b9a700 1 -- 172.21.15.60:0/673064786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3406aa90 msgr2=0x7faf3414a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:08.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.652+0000 7faf38b9a700 1 --2- 172.21.15.60:0/673064786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3406aa90 0x7faf3414a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:08.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.652+0000 7faf38b9a700 1 -- 172.21.15.60:0/673064786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf3406b960 msgr2=0x7faf3414bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:08.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.652+0000 7faf38b9a700 1 --2- 172.21.15.60:0/673064786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf3406b960 0x7faf3414bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:08.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.652+0000 7faf38b9a700 1 -- 172.21.15.60:0/673064786 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf300094f0 con 0x7faf3406ae60 2023-10-06T04:29:08.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.652+0000 7faf3939b700 1 --2- 172.21.15.60:0/673064786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3406aa90 0x7faf3414a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:08.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.652+0000 7faf38b9a700 1 --2- 172.21.15.60:0/673064786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3406ae60 0x7faf3414b710 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faf2400d890 tx=0x7faf24008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:08.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.652+0000 7faf297fa700 1 -- 172.21.15.60:0/673064786 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf240125f0 con 0x7faf3406ae60 2023-10-06T04:29:08.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.652+0000 7faf297fa700 1 -- 172.21.15.60:0/673064786 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf24012770 con 0x7faf3406ae60 2023-10-06T04:29:08.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.652+0000 7faf3a39d700 1 -- 172.21.15.60:0/673064786 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3414ceb0 con 0x7faf3406ae60 2023-10-06T04:29:08.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.652+0000 7faf297fa700 1 -- 172.21.15.60:0/673064786 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf24012b30 con 0x7faf3406ae60 2023-10-06T04:29:08.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.653+0000 7faf3a39d700 1 -- 172.21.15.60:0/673064786 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3414a630 con 0x7faf3406ae60 2023-10-06T04:29:08.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.653+0000 7faf3a39d700 1 -- 172.21.15.60:0/673064786 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3414d3d0 con 0x7faf3406ae60 2023-10-06T04:29:08.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.654+0000 7faf297fa700 1 -- 172.21.15.60:0/673064786 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf2401e460 con 0x7faf3406ae60 2023-10-06T04:29:08.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.655+0000 7faf297fa700 1 --2- 172.21.15.60:0/673064786 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7faf18066f30 0x7faf180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:08.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.655+0000 7faf297fa700 1 -- 172.21.15.60:0/673064786 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6515+0+0 (secure 0 0 0) 0x7faf24085080 con 0x7faf3406ae60 2023-10-06T04:29:08.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.655+0000 7faf3939b700 1 --2- 172.21.15.60:0/673064786 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7faf18066f30 0x7faf180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:08.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.656+0000 7faf3939b700 1 --2- 172.21.15.60:0/673064786 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7faf18066f30 0x7faf180693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7faf300099b0 tx=0x7faf30017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:08.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.659+0000 7faf297fa700 1 -- 172.21.15.60:0/673064786 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf3414d3d0 con 0x7faf3406ae60 2023-10-06T04:29:08.848 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:29:08.854 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:29:08.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:08.860+0000 7faf3a39d700 1 -- 172.21.15.60:0/673064786 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faf3414d3d0 con 0x7faf3406ae60 2023-10-06T04:29:09.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.430+0000 7faf297fa700 1 -- 172.21.15.60:0/673064786 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7faf3414d3d0 con 0x7faf3406ae60 2023-10-06T04:29:09.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.435+0000 7faf3a39d700 1 -- 172.21.15.60:0/673064786 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7faf18066f30 msgr2=0x7faf180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:09.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.435+0000 7faf3a39d700 1 --2- 172.21.15.60:0/673064786 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7faf18066f30 0x7faf180693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7faf300099b0 tx=0x7faf30017000 comp rx=0 tx=0).stop 2023-10-06T04:29:09.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.435+0000 7faf3a39d700 1 -- 172.21.15.60:0/673064786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3406ae60 msgr2=0x7faf3414b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:09.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.435+0000 7faf3a39d700 1 --2- 172.21.15.60:0/673064786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3406ae60 0x7faf3414b710 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faf2400d890 tx=0x7faf24008040 comp rx=0 tx=0).stop 2023-10-06T04:29:09.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.435+0000 7faf3a39d700 1 -- 172.21.15.60:0/673064786 shutdown_connections 2023-10-06T04:29:09.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.435+0000 7faf3a39d700 1 --2- 172.21.15.60:0/673064786 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7faf18066f30 0x7faf180693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:09.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.435+0000 7faf3a39d700 1 --2- 172.21.15.60:0/673064786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf3406b960 0x7faf3414bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:09.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.435+0000 7faf3a39d700 1 --2- 172.21.15.60:0/673064786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faf3406aa90 0x7faf3414a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:09.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.435+0000 7faf3a39d700 1 --2- 172.21.15.60:0/673064786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3406ae60 0x7faf3414b710 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:09.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.435+0000 7faf3a39d700 1 -- 172.21.15.60:0/673064786 >> 172.21.15.60:0/673064786 conn(0x7faf3406a090 msgr2=0x7faf340b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:09.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.436+0000 7faf3a39d700 1 -- 172.21.15.60:0/673064786 shutdown_connections 2023-10-06T04:29:09.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.436+0000 7faf3a39d700 1 -- 172.21.15.60:0/673064786 wait complete. 2023-10-06T04:29:09.440 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2023-10-06T04:29:09.459 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-06T04:29:09.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.649+0000 7fbe853ff700 1 Processor -- start 2023-10-06T04:29:09.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.649+0000 7fbe853ff700 1 -- start start 2023-10-06T04:29:09.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.650+0000 7fbe853ff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe8006ace0 0x7fbe800a6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:09.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.650+0000 7fbe853ff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe80069590 con 0x7fbe800ccd70 2023-10-06T04:29:09.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.650+0000 7fbe853ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe800ac720 con 0x7fbe800abbe0 2023-10-06T04:29:09.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.650+0000 7fbe853ff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe800ad330 con 0x7fbe8006ace0 2023-10-06T04:29:09.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.650+0000 7fbe7f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe8006ace0 0x7fbe800a6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:09.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.650+0000 7fbe7f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe8006ace0 0x7fbe800a6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52900/0 (socket says 172.21.15.60:52900) 2023-10-06T04:29:09.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.650+0000 7fbe7e7fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbe800ccd70 0x7fbe800af270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33112/0 (socket says 172.21.15.60:33112) 2023-10-06T04:29:09.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.650+0000 7fbe7f7fe700 1 -- 172.21.15.60:0/335027781 learned_addr learned my addr 172.21.15.60:0/335027781 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:09.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.651+0000 7fbe7f7fe700 1 -- 172.21.15.60:0/335027781 >> v1:172.21.15.135:6789/0 conn(0x7fbe800abbe0 legacy=0x7fbe800a63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:09.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.651+0000 7fbe7f7fe700 1 -- 172.21.15.60:0/335027781 >> v1:172.21.15.60:6789/0 conn(0x7fbe800ccd70 legacy=0x7fbe800af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:09.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.651+0000 7fbe7f7fe700 1 -- 172.21.15.60:0/335027781 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe800aca00 con 0x7fbe8006ace0 2023-10-06T04:29:09.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.651+0000 7fbe7f7fe700 1 --2- 172.21.15.60:0/335027781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe8006ace0 0x7fbe800a6ac0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbe78009f20 tx=0x7fbe78009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9803e7a1f13a19 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:09.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.652+0000 7fbe7dffb700 1 -- 172.21.15.60:0/335027781 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7800e070 con 0x7fbe8006ace0 2023-10-06T04:29:09.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.652+0000 7fbe7dffb700 1 -- 172.21.15.60:0/335027781 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7800ba80 con 0x7fbe8006ace0 2023-10-06T04:29:09.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.652+0000 7fbe7dffb700 1 -- 172.21.15.60:0/335027781 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe780092e0 con 0x7fbe8006ace0 2023-10-06T04:29:09.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.652+0000 7fbe853ff700 1 -- 172.21.15.60:0/335027781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe8006ace0 msgr2=0x7fbe800a6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:09.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.652+0000 7fbe853ff700 1 --2- 172.21.15.60:0/335027781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe8006ace0 0x7fbe800a6ac0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbe78009f20 tx=0x7fbe78009840 comp rx=0 tx=0).stop 2023-10-06T04:29:09.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.653+0000 7fbe853ff700 1 -- 172.21.15.60:0/335027781 shutdown_connections 2023-10-06T04:29:09.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.653+0000 7fbe853ff700 1 --2- 172.21.15.60:0/335027781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe8006ace0 0x7fbe800a6ac0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:09.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.653+0000 7fbe853ff700 1 -- 172.21.15.60:0/335027781 >> 172.21.15.60:0/335027781 conn(0x7fbe800cc0d0 msgr2=0x7fbe800cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:09.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.653+0000 7fbe853ff700 1 -- 172.21.15.60:0/335027781 shutdown_connections 2023-10-06T04:29:09.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.653+0000 7fbe853ff700 1 -- 172.21.15.60:0/335027781 wait complete. 2023-10-06T04:29:09.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.655+0000 7fbe853ff700 1 Processor -- start 2023-10-06T04:29:09.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.655+0000 7fbe853ff700 1 -- start start 2023-10-06T04:29:09.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.656+0000 7fbe853ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe8006ace0 0x7fbe801798a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:09.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.656+0000 7fbe853ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe800abbe0 0x7fbe800a7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:09.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.656+0000 7fbe853ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe800ccd70 0x7fbe800a9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:09.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.656+0000 7fbe853ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8015d5d0 con 0x7fbe800abbe0 2023-10-06T04:29:09.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.656+0000 7fbe853ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8015d8b0 con 0x7fbe800ccd70 2023-10-06T04:29:09.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.656+0000 7fbe853ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe80179de0 con 0x7fbe8006ace0 2023-10-06T04:29:09.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.657+0000 7fbe7e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe800abbe0 0x7fbe800a7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:09.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.657+0000 7fbe7e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe800abbe0 0x7fbe800a7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52908/0 (socket says 172.21.15.60:52908) 2023-10-06T04:29:09.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.657+0000 7fbe7e7fc700 1 -- 172.21.15.60:0/2736247996 learned_addr learned my addr 172.21.15.60:0/2736247996 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:09.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.657+0000 7fbe7f7fe700 1 --2- 172.21.15.60:0/2736247996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe800ccd70 0x7fbe800a9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:09.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.657+0000 7fbe7effd700 1 --2- 172.21.15.60:0/2736247996 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe8006ace0 0x7fbe801798a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:09.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.657+0000 7fbe7e7fc700 1 -- 172.21.15.60:0/2736247996 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe8006ace0 msgr2=0x7fbe801798a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:09.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.657+0000 7fbe7e7fc700 1 --2- 172.21.15.60:0/2736247996 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe8006ace0 0x7fbe801798a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:09.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.657+0000 7fbe7e7fc700 1 -- 172.21.15.60:0/2736247996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe800ccd70 msgr2=0x7fbe800a9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:09.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.657+0000 7fbe7e7fc700 1 --2- 172.21.15.60:0/2736247996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe800ccd70 0x7fbe800a9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:09.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.657+0000 7fbe7e7fc700 1 -- 172.21.15.60:0/2736247996 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe78009ae0 con 0x7fbe800abbe0 2023-10-06T04:29:09.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.658+0000 7fbe7effd700 1 --2- 172.21.15.60:0/2736247996 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe8006ace0 0x7fbe801798a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:09.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.658+0000 7fbe7e7fc700 1 --2- 172.21.15.60:0/2736247996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe800abbe0 0x7fbe800a7f60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbe74001eb0 tx=0x7fbe74007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:09.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.658+0000 7fbe66ffd700 1 -- 172.21.15.60:0/2736247996 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe74005a70 con 0x7fbe800abbe0 2023-10-06T04:29:09.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.658+0000 7fbe66ffd700 1 -- 172.21.15.60:0/2736247996 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe74005bd0 con 0x7fbe800abbe0 2023-10-06T04:29:09.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.658+0000 7fbe853ff700 1 -- 172.21.15.60:0/2736247996 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8017a060 con 0x7fbe800abbe0 2023-10-06T04:29:09.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.658+0000 7fbe66ffd700 1 -- 172.21.15.60:0/2736247996 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740070d0 con 0x7fbe800abbe0 2023-10-06T04:29:09.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.658+0000 7fbe853ff700 1 -- 172.21.15.60:0/2736247996 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8017a620 con 0x7fbe800abbe0 2023-10-06T04:29:09.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.660+0000 7fbe853ff700 1 -- 172.21.15.60:0/2736247996 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8015da20 con 0x7fbe800abbe0 2023-10-06T04:29:09.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.661+0000 7fbe66ffd700 1 -- 172.21.15.60:0/2736247996 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe74007480 con 0x7fbe800abbe0 2023-10-06T04:29:09.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.663+0000 7fbe66ffd700 1 --2- 172.21.15.60:0/2736247996 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbe6c066f30 0x7fbe6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:09.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.663+0000 7fbe66ffd700 1 -- 172.21.15.60:0/2736247996 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6043+0+0 (secure 0 0 0) 0x7fbe74083af0 con 0x7fbe800abbe0 2023-10-06T04:29:09.665 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.663+0000 7fbe7effd700 1 --2- 172.21.15.60:0/2736247996 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbe6c066f30 0x7fbe6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:09.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.664+0000 7fbe7effd700 1 --2- 172.21.15.60:0/2736247996 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbe6c066f30 0x7fbe6c0693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbe70007fd0 tx=0x7fbe70009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:09.669 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.667+0000 7fbe66ffd700 1 -- 172.21.15.60:0/2736247996 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe74050b70 con 0x7fbe800abbe0 2023-10-06T04:29:09.882 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:09.880+0000 7fbe853ff700 1 -- 172.21.15.60:0/2736247996 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbe8004bb40 con 0x7fbe800abbe0 2023-10-06T04:29:10.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.432+0000 7fbe66ffd700 1 -- 172.21.15.60:0/2736247996 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7fbe74017020 con 0x7fbe800abbe0 2023-10-06T04:29:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.437+0000 7fbe853ff700 1 -- 172.21.15.60:0/2736247996 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbe6c066f30 msgr2=0x7fbe6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.437+0000 7fbe853ff700 1 --2- 172.21.15.60:0/2736247996 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbe6c066f30 0x7fbe6c0693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbe70007fd0 tx=0x7fbe70009040 comp rx=0 tx=0).stop 2023-10-06T04:29:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.437+0000 7fbe853ff700 1 -- 172.21.15.60:0/2736247996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe800abbe0 msgr2=0x7fbe800a7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.437+0000 7fbe853ff700 1 --2- 172.21.15.60:0/2736247996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe800abbe0 0x7fbe800a7f60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbe74001eb0 tx=0x7fbe74007f40 comp rx=0 tx=0).stop 2023-10-06T04:29:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.437+0000 7fbe853ff700 1 -- 172.21.15.60:0/2736247996 shutdown_connections 2023-10-06T04:29:10.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.437+0000 7fbe853ff700 1 --2- 172.21.15.60:0/2736247996 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbe6c066f30 0x7fbe6c0693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:10.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.437+0000 7fbe853ff700 1 --2- 172.21.15.60:0/2736247996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe800ccd70 0x7fbe800a9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:10.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.437+0000 7fbe853ff700 1 --2- 172.21.15.60:0/2736247996 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbe8006ace0 0x7fbe801798a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:10.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.437+0000 7fbe853ff700 1 --2- 172.21.15.60:0/2736247996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe800abbe0 0x7fbe800a7f60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:10.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.437+0000 7fbe853ff700 1 -- 172.21.15.60:0/2736247996 >> 172.21.15.60:0/2736247996 conn(0x7fbe800cc0d0 msgr2=0x7fbe8006d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:10.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.437+0000 7fbe853ff700 1 -- 172.21.15.60:0/2736247996 shutdown_connections 2023-10-06T04:29:10.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.437+0000 7fbe853ff700 1 -- 172.21.15.60:0/2736247996 wait complete. 2023-10-06T04:29:10.442 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data_ec' removed 2023-10-06T04:29:10.461 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T04:29:10.461 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T04:29:10.462 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T04:29:10.462 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:29:10.462 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T04:29:10.462 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T04:29:10.463 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T04:29:10.463 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:29:10.463 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T04:29:10.463 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T04:29:10.464 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T04:29:10.464 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:29:10.464 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T04:29:10.464 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T04:29:10.465 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T04:29:10.465 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:29:10.477 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T04:29:10.477 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T04:29:10.478 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T04:29:10.478 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T04:29:10.480 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T04:29:10.480 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T04:29:10.481 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T04:29:10.481 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T04:29:10.522 INFO:tasks.ceph.mds.a:Started 2023-10-06T04:29:10.522 DEBUG:teuthology.parallel:result is None 2023-10-06T04:29:10.525 INFO:tasks.ceph.mds.c:Started 2023-10-06T04:29:10.525 DEBUG:teuthology.parallel:result is None 2023-10-06T04:29:10.525 INFO:tasks.ceph.mds.b:Started 2023-10-06T04:29:10.526 DEBUG:teuthology.parallel:result is None 2023-10-06T04:29:10.529 INFO:tasks.ceph.mds.d:Started 2023-10-06T04:29:10.529 DEBUG:teuthology.parallel:result is None 2023-10-06T04:29:10.529 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T04:29:10.662 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2023-10-06T04:29:10.663 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2023-10-06T04:29:10.663 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2023-10-06T04:29:10.663 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-10-06T04:29:10.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.729+0000 7fcd1ffff700 1 Processor -- start 2023-10-06T04:29:10.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.729+0000 7fcd1ffff700 1 -- start start 2023-10-06T04:29:10.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.731+0000 7fcd1ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcd2006a590 0x7fcd201536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:10.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.731+0000 7fcd1ffff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcd2006e660 0x7fcd20153c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:10.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.731+0000 7fcd1ffff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd200c9cc0 con 0x7fcd2006a960 2023-10-06T04:29:10.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.731+0000 7fcd1ffff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2006f560 con 0x7fcd2006a590 2023-10-06T04:29:10.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.731+0000 7fcd1ffff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2006eaa0 con 0x7fcd2006e660 2023-10-06T04:29:10.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.731+0000 7fcd1effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcd2006a590 0x7fcd201536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:10.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.731+0000 7fcd1effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcd2006a590 0x7fcd201536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52946/0 (socket says 172.21.15.60:52946) 2023-10-06T04:29:10.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.731+0000 7fcd1effd700 1 -- 172.21.15.60:0/1213109129 learned_addr learned my addr 172.21.15.60:0/1213109129 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:10.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.731+0000 7fcd1f7fe700 1 --2- 172.21.15.60:0/1213109129 >> v2:172.21.15.135:3300/0 conn(0x7fcd2006e660 0x7fcd20153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:10.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.731+0000 7fcd1effd700 1 -- 172.21.15.60:0/1213109129 >> v2:172.21.15.135:3300/0 conn(0x7fcd2006e660 msgr2=0x7fcd20153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:10.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.731+0000 7fcd1effd700 1 --2- 172.21.15.60:0/1213109129 >> v2:172.21.15.135:3300/0 conn(0x7fcd2006e660 0x7fcd20153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:10.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.731+0000 7fcd1effd700 1 -- 172.21.15.60:0/1213109129 >> v1:172.21.15.135:6789/0 conn(0x7fcd2006a960 legacy=0x7fcd2006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:10.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.731+0000 7fcd1effd700 1 -- 172.21.15.60:0/1213109129 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd200c6710 con 0x7fcd2006a590 2023-10-06T04:29:10.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.732+0000 7fcd1effd700 1 --2- 172.21.15.60:0/1213109129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd2006a590 0x7fcd201536f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcd20156680 tx=0x7fcd10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414ef0f0461dbef6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:10.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.732+0000 7fcd1dffb700 1 -- 172.21.15.60:0/1213109129 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10009ea0 con 0x7fcd2006a590 2023-10-06T04:29:10.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.732+0000 7fcd1dffb700 1 -- 172.21.15.60:0/1213109129 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1000b820 con 0x7fcd2006a590 2023-10-06T04:29:10.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.732+0000 7fcd1dffb700 1 -- 172.21.15.60:0/1213109129 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1000bbc0 con 0x7fcd2006a590 2023-10-06T04:29:10.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.732+0000 7fcd1ffff700 1 -- 172.21.15.60:0/1213109129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd2006a590 msgr2=0x7fcd201536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:10.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.732+0000 7fcd1ffff700 1 --2- 172.21.15.60:0/1213109129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd2006a590 0x7fcd201536f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcd20156680 tx=0x7fcd10009250 comp rx=0 tx=0).stop 2023-10-06T04:29:10.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.733+0000 7fcd1ffff700 1 -- 172.21.15.60:0/1213109129 shutdown_connections 2023-10-06T04:29:10.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.733+0000 7fcd1ffff700 1 --2- 172.21.15.60:0/1213109129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd2006a590 0x7fcd201536f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:10.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.733+0000 7fcd1ffff700 1 --2- 172.21.15.60:0/1213109129 >> v2:172.21.15.135:3300/0 conn(0x7fcd2006e660 0x7fcd20153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:10.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.733+0000 7fcd1ffff700 1 -- 172.21.15.60:0/1213109129 >> 172.21.15.60:0/1213109129 conn(0x7fcd20068080 msgr2=0x7fcd200cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:10.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.733+0000 7fcd1ffff700 1 -- 172.21.15.60:0/1213109129 shutdown_connections 2023-10-06T04:29:10.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.733+0000 7fcd1ffff700 1 -- 172.21.15.60:0/1213109129 wait complete. 2023-10-06T04:29:10.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.734+0000 7fcd1ffff700 1 Processor -- start 2023-10-06T04:29:10.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.734+0000 7fcd1ffff700 1 -- start start 2023-10-06T04:29:10.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.735+0000 7fcd1ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd2006a590 0x7fcd201566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:10.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.735+0000 7fcd1ffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd2006a960 0x7fcd2015e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:10.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.735+0000 7fcd1ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd2006e660 0x7fcd2015ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:10.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.735+0000 7fcd1ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2015e3a0 con 0x7fcd2006a590 2023-10-06T04:29:10.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.735+0000 7fcd1ffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2015da70 con 0x7fcd2006e660 2023-10-06T04:29:10.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.735+0000 7fcd1ffff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2015dd50 con 0x7fcd2006a960 2023-10-06T04:29:10.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.735+0000 7fcd1effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd2006a590 0x7fcd201566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:10.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.735+0000 7fcd1effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd2006a590 0x7fcd201566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52962/0 (socket says 172.21.15.60:52962) 2023-10-06T04:29:10.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.735+0000 7fcd1effd700 1 -- 172.21.15.60:0/3058701887 learned_addr learned my addr 172.21.15.60:0/3058701887 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:10.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.735+0000 7fcd1e7fc700 1 --2- 172.21.15.60:0/3058701887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd2006a960 0x7fcd2015e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:10.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.736+0000 7fcd1f7fe700 1 --2- 172.21.15.60:0/3058701887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd2006e660 0x7fcd2015ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:10.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.736+0000 7fcd1effd700 1 -- 172.21.15.60:0/3058701887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd2006a960 msgr2=0x7fcd2015e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:10.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.736+0000 7fcd1effd700 1 --2- 172.21.15.60:0/3058701887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd2006a960 0x7fcd2015e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:10.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.736+0000 7fcd1effd700 1 -- 172.21.15.60:0/3058701887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd2006e660 msgr2=0x7fcd2015ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:10.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.736+0000 7fcd1effd700 1 --2- 172.21.15.60:0/3058701887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd2006e660 0x7fcd2015ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:10.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.736+0000 7fcd1effd700 1 -- 172.21.15.60:0/3058701887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd100094f0 con 0x7fcd2006a590 2023-10-06T04:29:10.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.736+0000 7fcd1effd700 1 --2- 172.21.15.60:0/3058701887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd2006a590 0x7fcd201566b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcd100094c0 tx=0x7fcd10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:10.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.736+0000 7fcd06ffd700 1 -- 172.21.15.60:0/3058701887 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1000bba0 con 0x7fcd2006a590 2023-10-06T04:29:10.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.736+0000 7fcd06ffd700 1 -- 172.21.15.60:0/3058701887 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1001be00 con 0x7fcd2006a590 2023-10-06T04:29:10.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.736+0000 7fcd06ffd700 1 -- 172.21.15.60:0/3058701887 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10011650 con 0x7fcd2006a590 2023-10-06T04:29:10.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.736+0000 7fcd1ffff700 1 -- 172.21.15.60:0/3058701887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2015e030 con 0x7fcd2006a590 2023-10-06T04:29:10.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.737+0000 7fcd1ffff700 1 -- 172.21.15.60:0/3058701887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd20156bf0 con 0x7fcd2006a590 2023-10-06T04:29:10.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.737+0000 7fcd1ffff700 1 -- 172.21.15.60:0/3058701887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2015e680 con 0x7fcd2006a590 2023-10-06T04:29:10.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.738+0000 7fcd06ffd700 1 -- 172.21.15.60:0/3058701887 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd10011a00 con 0x7fcd2006a590 2023-10-06T04:29:10.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.740+0000 7fcd06ffd700 1 --2- 172.21.15.60:0/3058701887 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fcd0c066f30 0x7fcd0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:10.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.740+0000 7fcd06ffd700 1 -- 172.21.15.60:0/3058701887 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fcd10085c20 con 0x7fcd2006a590 2023-10-06T04:29:10.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.740+0000 7fcd1e7fc700 1 --2- 172.21.15.60:0/3058701887 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fcd0c066f30 0x7fcd0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:10.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.741+0000 7fcd1e7fc700 1 --2- 172.21.15.60:0/3058701887 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fcd0c066f30 0x7fcd0c0693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcd20159840 tx=0x7fcd14000bc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:10.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.744+0000 7fcd06ffd700 1 -- 172.21.15.60:0/3058701887 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd10052e50 con 0x7fcd2006a590 2023-10-06T04:29:10.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:10.964+0000 7fcd1ffff700 1 -- 172.21.15.60:0/3058701887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fcd20156ea0 con 0x7fcd2006a590 2023-10-06T04:29:12.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.351+0000 7fcd06ffd700 1 -- 172.21.15.60:0/3058701887 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcd10015020 con 0x7fcd2006a590 2023-10-06T04:29:12.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.354+0000 7fcd1ffff700 1 -- 172.21.15.60:0/3058701887 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fcd0c066f30 msgr2=0x7fcd0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:12.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.354+0000 7fcd1ffff700 1 --2- 172.21.15.60:0/3058701887 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fcd0c066f30 0x7fcd0c0693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcd20159840 tx=0x7fcd14000bc0 comp rx=0 tx=0).stop 2023-10-06T04:29:12.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.354+0000 7fcd1ffff700 1 -- 172.21.15.60:0/3058701887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd2006a590 msgr2=0x7fcd201566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:12.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.354+0000 7fcd1ffff700 1 --2- 172.21.15.60:0/3058701887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd2006a590 0x7fcd201566b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcd100094c0 tx=0x7fcd10017000 comp rx=0 tx=0).stop 2023-10-06T04:29:12.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.354+0000 7fcd1ffff700 1 -- 172.21.15.60:0/3058701887 shutdown_connections 2023-10-06T04:29:12.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.354+0000 7fcd1ffff700 1 --2- 172.21.15.60:0/3058701887 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fcd0c066f30 0x7fcd0c0693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:12.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.354+0000 7fcd1ffff700 1 --2- 172.21.15.60:0/3058701887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd2006a590 0x7fcd201566b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:12.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.354+0000 7fcd1ffff700 1 --2- 172.21.15.60:0/3058701887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd2006e660 0x7fcd2015ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:12.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.354+0000 7fcd1ffff700 1 --2- 172.21.15.60:0/3058701887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd2006a960 0x7fcd2015e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:12.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.354+0000 7fcd1ffff700 1 -- 172.21.15.60:0/3058701887 >> 172.21.15.60:0/3058701887 conn(0x7fcd20068080 msgr2=0x7fcd2015be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:12.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.355+0000 7fcd1ffff700 1 -- 172.21.15.60:0/3058701887 shutdown_connections 2023-10-06T04:29:12.358 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.355+0000 7fcd1ffff700 1 -- 172.21.15.60:0/3058701887 wait complete. 2023-10-06T04:29:12.358 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2023-10-06T04:29:12.377 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T04:29:12.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.566+0000 7f335359e700 1 Processor -- start 2023-10-06T04:29:12.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.567+0000 7f335359e700 1 -- start start 2023-10-06T04:29:12.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.568+0000 7f335359e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3354159390 0x7f33540ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:12.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.568+0000 7f335359e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f33540ab410 0x7f33540aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:12.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.568+0000 7f335359e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33540686c0 con 0x7f3354159760 2023-10-06T04:29:12.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.568+0000 7f335359e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3354068c80 con 0x7f3354159390 2023-10-06T04:29:12.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.568+0000 7f335359e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33540ace20 con 0x7f33540ab410 2023-10-06T04:29:12.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.568+0000 7f335259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3354159390 0x7f33540ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:12.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.568+0000 7f335259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3354159390 0x7f33540ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52976/0 (socket says 172.21.15.60:52976) 2023-10-06T04:29:12.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.568+0000 7f335259c700 1 -- 172.21.15.60:0/1397217928 learned_addr learned my addr 172.21.15.60:0/1397217928 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:12.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.568+0000 7f3352d9d700 1 --2- 172.21.15.60:0/1397217928 >> v2:172.21.15.135:3300/0 conn(0x7f33540ab410 0x7f33540aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:12.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.569+0000 7f335259c700 1 -- 172.21.15.60:0/1397217928 >> v2:172.21.15.135:3300/0 conn(0x7f33540ab410 msgr2=0x7f33540aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:12.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.569+0000 7f335259c700 1 --2- 172.21.15.60:0/1397217928 >> v2:172.21.15.135:3300/0 conn(0x7f33540ab410 0x7f33540aeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:12.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.569+0000 7f335259c700 1 -- 172.21.15.60:0/1397217928 >> v1:172.21.15.60:6789/0 conn(0x7f3354159760 legacy=0x7f33540aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:12.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.569+0000 7f335259c700 1 -- 172.21.15.60:0/1397217928 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33540ad0f0 con 0x7f3354159390 2023-10-06T04:29:12.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.569+0000 7f335159a700 1 -- 172.21.15.60:0/1397217928 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 375952594 0 0) 0x7f33540686c0 con 0x7f3354159760 2023-10-06T04:29:12.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.569+0000 7f335259c700 1 --2- 172.21.15.60:0/1397217928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3354159390 0x7f33540ac8e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f335406b320 tx=0x7f3344009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff4bcc8b95d45c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:12.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.569+0000 7f335159a700 1 -- 172.21.15.60:0/1397217928 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334400b860 con 0x7f3354159390 2023-10-06T04:29:12.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.569+0000 7f335159a700 1 -- 172.21.15.60:0/1397217928 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334400b9c0 con 0x7f3354159390 2023-10-06T04:29:12.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.569+0000 7f335159a700 1 -- 172.21.15.60:0/1397217928 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334400bd60 con 0x7f3354159390 2023-10-06T04:29:12.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.570+0000 7f335359e700 1 -- 172.21.15.60:0/1397217928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3354159390 msgr2=0x7f33540ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:12.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.570+0000 7f335359e700 1 --2- 172.21.15.60:0/1397217928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3354159390 0x7f33540ac8e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f335406b320 tx=0x7f3344009250 comp rx=0 tx=0).stop 2023-10-06T04:29:12.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.570+0000 7f335359e700 1 -- 172.21.15.60:0/1397217928 shutdown_connections 2023-10-06T04:29:12.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.570+0000 7f335359e700 1 --2- 172.21.15.60:0/1397217928 >> v2:172.21.15.135:3300/0 conn(0x7f33540ab410 0x7f33540aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:12.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.570+0000 7f335359e700 1 --2- 172.21.15.60:0/1397217928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3354159390 0x7f33540ac8e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:12.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.570+0000 7f335359e700 1 -- 172.21.15.60:0/1397217928 >> 172.21.15.60:0/1397217928 conn(0x7f3354097410 msgr2=0x7f3354067d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:12.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.570+0000 7f335359e700 1 -- 172.21.15.60:0/1397217928 shutdown_connections 2023-10-06T04:29:12.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.570+0000 7f335359e700 1 -- 172.21.15.60:0/1397217928 wait complete. 2023-10-06T04:29:12.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.571+0000 7f335359e700 1 Processor -- start 2023-10-06T04:29:12.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.572+0000 7f335359e700 1 -- start start 2023-10-06T04:29:12.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.572+0000 7f335359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33540ab410 0x7f335415b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:12.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.573+0000 7f335359e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3354159390 0x7f3354155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:12.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.573+0000 7f335359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3354159760 0x7f335415f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:12.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.573+0000 7f335359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335415aea0 con 0x7f3354159760 2023-10-06T04:29:12.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.573+0000 7f335359e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335415b870 con 0x7f33540ab410 2023-10-06T04:29:12.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.573+0000 7f335359e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335415a290 con 0x7f3354159390 2023-10-06T04:29:12.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.573+0000 7f3352d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3354159760 0x7f335415f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:12.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.573+0000 7f3352d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3354159760 0x7f335415f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52992/0 (socket says 172.21.15.60:52992) 2023-10-06T04:29:12.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.573+0000 7f3352d9d700 1 -- 172.21.15.60:0/4000050885 learned_addr learned my addr 172.21.15.60:0/4000050885 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:12.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.573+0000 7f335259c700 1 --2- 172.21.15.60:0/4000050885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33540ab410 0x7f335415b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:12.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.573+0000 7f3351d9b700 1 --2- 172.21.15.60:0/4000050885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3354159390 0x7f3354155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:12.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.573+0000 7f3352d9d700 1 -- 172.21.15.60:0/4000050885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3354159390 msgr2=0x7f3354155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:12.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.573+0000 7f3352d9d700 1 --2- 172.21.15.60:0/4000050885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3354159390 0x7f3354155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:12.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.573+0000 7f3352d9d700 1 -- 172.21.15.60:0/4000050885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33540ab410 msgr2=0x7f335415b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:12.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.573+0000 7f3352d9d700 1 --2- 172.21.15.60:0/4000050885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33540ab410 0x7f335415b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:12.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.573+0000 7f3352d9d700 1 -- 172.21.15.60:0/4000050885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33440094f0 con 0x7f3354159760 2023-10-06T04:29:12.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.573+0000 7f335259c700 1 --2- 172.21.15.60:0/4000050885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33540ab410 0x7f335415b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:12.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.573+0000 7f3351d9b700 1 --2- 172.21.15.60:0/4000050885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3354159390 0x7f3354155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:12.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.574+0000 7f3352d9d700 1 --2- 172.21.15.60:0/4000050885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3354159760 0x7f335415f550 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f334c007f30 tx=0x7f334c0098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:12.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.574+0000 7f33427fc700 1 -- 172.21.15.60:0/4000050885 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c00ecf0 con 0x7f3354159760 2023-10-06T04:29:12.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.574+0000 7f33427fc700 1 -- 172.21.15.60:0/4000050885 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c00ee50 con 0x7f3354159760 2023-10-06T04:29:12.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.574+0000 7f33427fc700 1 -- 172.21.15.60:0/4000050885 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c014670 con 0x7f3354159760 2023-10-06T04:29:12.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.574+0000 7f335359e700 1 -- 172.21.15.60:0/4000050885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f335415a570 con 0x7f3354159760 2023-10-06T04:29:12.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.574+0000 7f335359e700 1 -- 172.21.15.60:0/4000050885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335415ab30 con 0x7f3354159760 2023-10-06T04:29:12.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.575+0000 7f335359e700 1 -- 172.21.15.60:0/4000050885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f335415b050 con 0x7f3354159760 2023-10-06T04:29:12.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.576+0000 7f33427fc700 1 -- 172.21.15.60:0/4000050885 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f334c0149e0 con 0x7f3354159760 2023-10-06T04:29:12.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.577+0000 7f33427fc700 1 --2- 172.21.15.60:0/4000050885 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3334066f30 0x7f33340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:12.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.577+0000 7f33427fc700 1 -- 172.21.15.60:0/4000050885 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f334c084cb0 con 0x7f3354159760 2023-10-06T04:29:12.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.577+0000 7f335259c700 1 --2- 172.21.15.60:0/4000050885 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3334066f30 0x7f33340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:12.580 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.578+0000 7f335259c700 1 --2- 172.21.15.60:0/4000050885 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3334066f30 0x7f33340693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f335406b320 tx=0x7f3344017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:12.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.581+0000 7f33427fc700 1 -- 172.21.15.60:0/4000050885 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f334c0559c0 con 0x7f3354159760 2023-10-06T04:29:12.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.861+0000 7f335359e700 1 -- 172.21.15.60:0/4000050885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f335405f230 con 0x7f3354159760 2023-10-06T04:29:12.864 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.862+0000 7f33427fc700 1 -- 172.21.15.60:0/4000050885 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f334c009a20 con 0x7f3354159760 2023-10-06T04:29:12.864 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:12.865 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-06T04:29:12.865 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2023-10-06T04:29:12.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.865 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2023-10-06T04:29:12.865 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCfjB9l31LHOhAA7oRZKqE2zYkwjD5IUSmSlw==", 2023-10-06T04:29:12.865 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.865 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-06T04:29:12.865 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-06T04:29:12.865 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-06T04:29:12.865 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-06T04:29:12.865 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.866 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2023-10-06T04:29:12.866 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCgjB9lsLtCFBAAtWYATiOcWNMUcmh6pc1nfA==", 2023-10-06T04:29:12.866 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.866 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-06T04:29:12.866 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-06T04:29:12.866 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-06T04:29:12.866 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-06T04:29:12.866 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.867 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2023-10-06T04:29:12.867 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCgjB9lzD64CRAAflvW0zdIHohaoWwPATxBaw==", 2023-10-06T04:29:12.867 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.867 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-06T04:29:12.867 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-06T04:29:12.867 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-06T04:29:12.867 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-06T04:29:12.867 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.867 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2023-10-06T04:29:12.868 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCgjB9lZ/WlHhAAdyWltCo3F+8GYbyqbsLSOw==", 2023-10-06T04:29:12.868 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.868 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-06T04:29:12.868 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-06T04:29:12.868 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-06T04:29:12.868 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-06T04:29:12.868 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.868 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2023-10-06T04:29:12.868 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCijB9lMRRnGBAA03hwJv6eO23P0qs0lKCM1A==", 2023-10-06T04:29:12.868 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.869 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-06T04:29:12.869 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-06T04:29:12.869 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-06T04:29:12.869 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.869 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2023-10-06T04:29:12.869 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCljB9lSTk1GxAA6pc+JLH5X3q5VXsvnSwtxQ==", 2023-10-06T04:29:12.869 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.869 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-06T04:29:12.869 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-06T04:29:12.869 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-06T04:29:12.870 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.870 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2023-10-06T04:29:12.870 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCojB9lx5w8HhAAmd4iqtLPN6rfaizHMb0s4g==", 2023-10-06T04:29:12.870 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.870 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-06T04:29:12.870 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-06T04:29:12.870 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-06T04:29:12.870 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.871 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2023-10-06T04:29:12.871 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCrjB9lLFjnIBAA1lGjBDCfouDKIInGZbxKDA==", 2023-10-06T04:29:12.871 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.871 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-06T04:29:12.871 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-06T04:29:12.871 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-06T04:29:12.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.871 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2023-10-06T04:29:12.871 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCxjB9lFgDvLRAAPnUuIfk9o0PlF+5ME6/vrw==", 2023-10-06T04:29:12.871 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.872 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-06T04:29:12.872 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-06T04:29:12.872 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-06T04:29:12.872 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.872 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2023-10-06T04:29:12.872 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQC0jB9lQ+p7LxAAH2RCxHfabLzYeiRZq92iSg==", 2023-10-06T04:29:12.872 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.872 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-06T04:29:12.872 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-06T04:29:12.872 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-06T04:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2023-10-06T04:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQC3jB9lhTzVNBAAXY87rsg6PV7HgHg0hoHrrQ==", 2023-10-06T04:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-06T04:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-06T04:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-06T04:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2023-10-06T04:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQC6jB9ltew1NxAAabw9KZLEA0/VCw6NCxk6Gg==", 2023-10-06T04:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2023-10-06T04:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2023-10-06T04:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-06T04:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2023-10-06T04:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCgjB9laCuNJxAADKvUHEMFjkCoHT5eURKJlA==", 2023-10-06T04:29:12.874 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-06T04:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-06T04:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-06T04:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-06T04:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2023-10-06T04:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCgjB9lHQ9TNRAA4zKKwf6W90r+fnH78woWIw==", 2023-10-06T04:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-06T04:29:12.875 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-06T04:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-06T04:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-06T04:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2023-10-06T04:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCgjB9lgBloLhAA/s1+hc35sIjChCTkDYB01A==", 2023-10-06T04:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-06T04:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-06T04:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-06T04:29:12.876 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-06T04:29:12.877 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.877 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2023-10-06T04:29:12.877 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQChjB9lA5BlABAAkcO/5PzjO/EEjMcK0YUtFw==", 2023-10-06T04:29:12.877 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.877 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2023-10-06T04:29:12.877 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2023-10-06T04:29:12.877 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2023-10-06T04:29:12.877 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2023-10-06T04:29:12.877 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2023-10-06T04:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCfjB9l4MLwCBAAeWWOdyyVGWObCY83qRs1oQ==", 2023-10-06T04:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-06T04:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2023-10-06T04:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2023-10-06T04:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-06T04:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.878 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-mds", 2023-10-06T04:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDCjB9lcl+rExAA2iKZio27tkj62voJAo+WQg==", 2023-10-06T04:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T04:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T04:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDCjB9l7mirExAAqZ5BTsOSY1S8FG4IAARI0Q==", 2023-10-06T04:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T04:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-osd", 2023-10-06T04:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDCjB9lUnGrExAAJXPlHyMrwxO5hlJsjnZLTA==", 2023-10-06T04:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T04:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T04:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDCjB9lp3qrExAAetDfLq7uRuUOIFM130Ce0g==", 2023-10-06T04:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T04:29:12.881 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.881 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T04:29:12.881 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDCjB9l04WrExAAmmlYAm5xzVu0ZNvlzcNnDw==", 2023-10-06T04:29:12.881 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.881 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T04:29:12.881 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.881 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T04:29:12.881 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDCjB9lAI+rExAA+pE9DoiwCbvANm5HMYwPEg==", 2023-10-06T04:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T04:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2023-10-06T04:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCfjB9ltbW7MxAAx/dyhjAhe0ZnLw85f+JvQQ==", 2023-10-06T04:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-06T04:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-06T04:29:12.882 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-06T04:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2023-10-06T04:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQCfjB9lLZN8LBAABSiC4B4GbjHl1K+WrPY6EA==", 2023-10-06T04:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2023-10-06T04:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2023-10-06T04:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2023-10-06T04:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2023-10-06T04:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:12.883 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2023-10-06T04:29:12.884 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-06T04:29:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.864+0000 7f335359e700 1 -- 172.21.15.60:0/4000050885 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3334066f30 msgr2=0x7f33340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.864+0000 7f335359e700 1 --2- 172.21.15.60:0/4000050885 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3334066f30 0x7f33340693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f335406b320 tx=0x7f3344017000 comp rx=0 tx=0).stop 2023-10-06T04:29:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.864+0000 7f335359e700 1 -- 172.21.15.60:0/4000050885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3354159760 msgr2=0x7f335415f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.864+0000 7f335359e700 1 --2- 172.21.15.60:0/4000050885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3354159760 0x7f335415f550 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f334c007f30 tx=0x7f334c0098e0 comp rx=0 tx=0).stop 2023-10-06T04:29:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.864+0000 7f335359e700 1 -- 172.21.15.60:0/4000050885 shutdown_connections 2023-10-06T04:29:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.864+0000 7f335359e700 1 --2- 172.21.15.60:0/4000050885 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f3334066f30 0x7f33340693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.864+0000 7f335359e700 1 --2- 172.21.15.60:0/4000050885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3354159760 0x7f335415f550 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.864+0000 7f335359e700 1 --2- 172.21.15.60:0/4000050885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33540ab410 0x7f335415b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.864+0000 7f335359e700 1 --2- 172.21.15.60:0/4000050885 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3354159390 0x7f3354155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.865+0000 7f335359e700 1 -- 172.21.15.60:0/4000050885 >> 172.21.15.60:0/4000050885 conn(0x7f3354097410 msgr2=0x7f33540aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.865+0000 7f335359e700 1 -- 172.21.15.60:0/4000050885 shutdown_connections 2023-10-06T04:29:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:12.865+0000 7f335359e700 1 -- 172.21.15.60:0/4000050885 wait complete. 2023-10-06T04:29:12.886 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T04:29:13.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.071+0000 7f361e59d700 1 Processor -- start 2023-10-06T04:29:13.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.072+0000 7f361e59d700 1 -- start start 2023-10-06T04:29:13.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.073+0000 7f361e59d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f36180cadb0 0x7f36180cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:13.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.073+0000 7f361e59d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f36180ccb20 0x7f3618158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:13.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.073+0000 7f361e59d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36180cdc20 con 0x7f361815dc60 2023-10-06T04:29:13.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.073+0000 7f361e59d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36180cd010 con 0x7f36180cadb0 2023-10-06T04:29:13.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.073+0000 7f361e59d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36180cd2f0 con 0x7f36180ccb20 2023-10-06T04:29:13.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.073+0000 7f361d59b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f36180cadb0 0x7f36180cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:13.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.073+0000 7f361dd9c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f361815dc60 0x7f36180c36c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53576/0 (socket says 172.21.15.60:53576) 2023-10-06T04:29:13.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.073+0000 7f361dd9c700 1 -- 172.21.15.60:0/1771127570 learned_addr learned my addr 172.21.15.60:0/1771127570 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:29:13.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.074+0000 7f361cd9a700 1 --2- 172.21.15.60:0/1771127570 >> v2:172.21.15.135:3300/0 conn(0x7f36180ccb20 0x7f3618158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:13.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.074+0000 7f361d59b700 1 -- 172.21.15.60:0/1771127570 >> v2:172.21.15.135:3300/0 conn(0x7f36180ccb20 msgr2=0x7f3618158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:13.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.074+0000 7f361d59b700 1 --2- 172.21.15.60:0/1771127570 >> v2:172.21.15.135:3300/0 conn(0x7f36180ccb20 0x7f3618158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:13.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.074+0000 7f361d59b700 1 -- 172.21.15.60:0/1771127570 >> v1:172.21.15.60:6789/0 conn(0x7f361815dc60 legacy=0x7f36180c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:13.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.074+0000 7f361d59b700 1 -- 172.21.15.60:0/1771127570 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36180cd5d0 con 0x7f36180cadb0 2023-10-06T04:29:13.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.074+0000 7f361cd9a700 1 --2- 172.21.15.60:0/1771127570 >> v2:172.21.15.135:3300/0 conn(0x7f36180ccb20 0x7f3618158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:13.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.074+0000 7f361d59b700 1 --2- 172.21.15.60:0/1771127570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36180cadb0 0x7f36180cc5e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f361815cf60 tx=0x7f3614009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7047ab83233086 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:13.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.074+0000 7f360ffff700 1 -- 172.21.15.60:0/1771127570 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3614011630 con 0x7f36180cadb0 2023-10-06T04:29:13.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.074+0000 7f360ffff700 1 -- 172.21.15.60:0/1771127570 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3614011790 con 0x7f36180cadb0 2023-10-06T04:29:13.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.074+0000 7f360ffff700 1 -- 172.21.15.60:0/1771127570 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3614011b30 con 0x7f36180cadb0 2023-10-06T04:29:13.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.075+0000 7f361e59d700 1 -- 172.21.15.60:0/1771127570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36180cadb0 msgr2=0x7f36180cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:13.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.075+0000 7f361e59d700 1 --2- 172.21.15.60:0/1771127570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36180cadb0 0x7f36180cc5e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f361815cf60 tx=0x7f3614009120 comp rx=0 tx=0).stop 2023-10-06T04:29:13.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.075+0000 7f361e59d700 1 -- 172.21.15.60:0/1771127570 shutdown_connections 2023-10-06T04:29:13.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.075+0000 7f361e59d700 1 --2- 172.21.15.60:0/1771127570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36180cadb0 0x7f36180cc5e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:13.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.075+0000 7f361e59d700 1 --2- 172.21.15.60:0/1771127570 >> v2:172.21.15.135:3300/0 conn(0x7f36180ccb20 0x7f3618158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:13.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.075+0000 7f361e59d700 1 -- 172.21.15.60:0/1771127570 >> 172.21.15.60:0/1771127570 conn(0x7f3618087fc0 msgr2=0x7f3618097430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:13.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.075+0000 7f361e59d700 1 -- 172.21.15.60:0/1771127570 shutdown_connections 2023-10-06T04:29:13.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.075+0000 7f361e59d700 1 -- 172.21.15.60:0/1771127570 wait complete. 2023-10-06T04:29:13.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.076+0000 7f361e59d700 1 Processor -- start 2023-10-06T04:29:13.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.077+0000 7f361e59d700 1 -- start start 2023-10-06T04:29:13.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.077+0000 7f361e59d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36180cadb0 0x7f361816d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:13.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.077+0000 7f361e59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36180ccb20 0x7f361815c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:13.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.077+0000 7f361e59d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f361815dc60 0x7f3618169760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:13.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.077+0000 7f361e59d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361815cb60 con 0x7f361815dc60 2023-10-06T04:29:13.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.077+0000 7f361e59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361816cd90 con 0x7f36180ccb20 2023-10-06T04:29:13.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.077+0000 7f361e59d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361816d350 con 0x7f36180cadb0 2023-10-06T04:29:13.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.078+0000 7f361dd9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f361815dc60 0x7f3618169760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:13.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.078+0000 7f361dd9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f361815dc60 0x7f3618169760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46166/0 (socket says 172.21.15.60:46166) 2023-10-06T04:29:13.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.078+0000 7f361dd9c700 1 -- 172.21.15.60:0/527756962 learned_addr learned my addr 172.21.15.60:0/527756962 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:13.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.078+0000 7f361cd9a700 1 --2- 172.21.15.60:0/527756962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36180ccb20 0x7f361815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:13.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.078+0000 7f361d59b700 1 --2- 172.21.15.60:0/527756962 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36180cadb0 0x7f361816d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:13.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.078+0000 7f361dd9c700 1 -- 172.21.15.60:0/527756962 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36180cadb0 msgr2=0x7f361816d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:13.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.078+0000 7f361dd9c700 1 --2- 172.21.15.60:0/527756962 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36180cadb0 0x7f361816d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:13.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.078+0000 7f361dd9c700 1 -- 172.21.15.60:0/527756962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36180ccb20 msgr2=0x7f361815c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:13.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.078+0000 7f361dd9c700 1 --2- 172.21.15.60:0/527756962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36180ccb20 0x7f361815c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:13.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.078+0000 7f361dd9c700 1 -- 172.21.15.60:0/527756962 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36140093c0 con 0x7f361815dc60 2023-10-06T04:29:13.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.078+0000 7f361cd9a700 1 --2- 172.21.15.60:0/527756962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36180ccb20 0x7f361815c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:13.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.078+0000 7f361dd9c700 1 --2- 172.21.15.60:0/527756962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f361815dc60 0x7f3618169760 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f361000cc90 tx=0x7f3610001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:13.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.079+0000 7f360d7fa700 1 -- 172.21.15.60:0/527756962 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361000a960 con 0x7f361815dc60 2023-10-06T04:29:13.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.079+0000 7f360d7fa700 1 -- 172.21.15.60:0/527756962 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361000aac0 con 0x7f361815dc60 2023-10-06T04:29:13.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.079+0000 7f360d7fa700 1 -- 172.21.15.60:0/527756962 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361000ae80 con 0x7f361815dc60 2023-10-06T04:29:13.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.079+0000 7f361e59d700 1 -- 172.21.15.60:0/527756962 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361816a270 con 0x7f361815dc60 2023-10-06T04:29:13.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.079+0000 7f361e59d700 1 -- 172.21.15.60:0/527756962 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361816cfe0 con 0x7f361815dc60 2023-10-06T04:29:13.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.080+0000 7f361e59d700 1 -- 172.21.15.60:0/527756962 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361805f230 con 0x7f361815dc60 2023-10-06T04:29:13.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.081+0000 7f360d7fa700 1 -- 172.21.15.60:0/527756962 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3610007300 con 0x7f361815dc60 2023-10-06T04:29:13.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.082+0000 7f360d7fa700 1 --2- 172.21.15.60:0/527756962 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f35fc066f30 0x7f35fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:13.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.082+0000 7f360d7fa700 1 -- 172.21.15.60:0/527756962 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f3610084930 con 0x7f361815dc60 2023-10-06T04:29:13.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.082+0000 7f361d59b700 1 --2- 172.21.15.60:0/527756962 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f35fc066f30 0x7f35fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:13.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.082+0000 7f361d59b700 1 --2- 172.21.15.60:0/527756962 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f35fc066f30 0x7f35fc0693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3614009160 tx=0x7f3614016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:13.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.086+0000 7f360d7fa700 1 -- 172.21.15.60:0/527756962 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3610051c30 con 0x7f361815dc60 2023-10-06T04:29:13.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.372+0000 7f361e59d700 1 -- 172.21.15.60:0/527756962 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f361816d490 con 0x7f361815dc60 2023-10-06T04:29:13.378 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.376+0000 7f360d7fa700 1 -- 172.21.15.60:0/527756962 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3610055250 con 0x7f361815dc60 2023-10-06T04:29:13.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.378+0000 7f361e59d700 1 -- 172.21.15.60:0/527756962 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f35fc066f30 msgr2=0x7f35fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:13.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.378+0000 7f361e59d700 1 --2- 172.21.15.60:0/527756962 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f35fc066f30 0x7f35fc0693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3614009160 tx=0x7f3614016000 comp rx=0 tx=0).stop 2023-10-06T04:29:13.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.378+0000 7f361e59d700 1 -- 172.21.15.60:0/527756962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f361815dc60 msgr2=0x7f3618169760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:13.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.378+0000 7f361e59d700 1 --2- 172.21.15.60:0/527756962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f361815dc60 0x7f3618169760 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f361000cc90 tx=0x7f3610001a80 comp rx=0 tx=0).stop 2023-10-06T04:29:13.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.378+0000 7f361e59d700 1 -- 172.21.15.60:0/527756962 shutdown_connections 2023-10-06T04:29:13.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.378+0000 7f361e59d700 1 --2- 172.21.15.60:0/527756962 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f35fc066f30 0x7f35fc0693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:13.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.378+0000 7f361e59d700 1 --2- 172.21.15.60:0/527756962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f361815dc60 0x7f3618169760 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:13.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.378+0000 7f361e59d700 1 --2- 172.21.15.60:0/527756962 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f36180cadb0 0x7f361816d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:13.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.378+0000 7f361e59d700 1 --2- 172.21.15.60:0/527756962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36180ccb20 0x7f361815c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:13.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.378+0000 7f361e59d700 1 -- 172.21.15.60:0/527756962 >> 172.21.15.60:0/527756962 conn(0x7f3618087fc0 msgr2=0x7f36181560d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:13.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.378+0000 7f361e59d700 1 -- 172.21.15.60:0/527756962 shutdown_connections 2023-10-06T04:29:13.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.378+0000 7f361e59d700 1 -- 172.21.15.60:0/527756962 wait complete. 2023-10-06T04:29:13.398 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T04:29:13.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.584+0000 7fb1d3fff700 1 Processor -- start 2023-10-06T04:29:13.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.584+0000 7fb1d3fff700 1 -- start start 2023-10-06T04:29:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.585+0000 7fb1d3fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb1d40688e0 0x7fb1d40cb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.585+0000 7fb1d3fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb1d4068cb0 0x7fb1d415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.585+0000 7fb1d3fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d40c74a0 con 0x7fb1d40c6cc0 2023-10-06T04:29:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.585+0000 7fb1d3fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d40cacb0 con 0x7fb1d40688e0 2023-10-06T04:29:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.585+0000 7fb1d3fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d415a7b0 con 0x7fb1d4068cb0 2023-10-06T04:29:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.585+0000 7fb1d2ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb1d40688e0 0x7fb1d40cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.586+0000 7fb1d37fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb1d40c6cc0 0x7fb1d40cb980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53582/0 (socket says 172.21.15.60:53582) 2023-10-06T04:29:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.586+0000 7fb1d37fe700 1 -- 172.21.15.60:0/3672284028 learned_addr learned my addr 172.21.15.60:0/3672284028 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:29:13.588 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.586+0000 7fb1d27fc700 1 --2- 172.21.15.60:0/3672284028 >> v2:172.21.15.135:3300/0 conn(0x7fb1d4068cb0 0x7fb1d415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:13.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.586+0000 7fb1d2ffd700 1 -- 172.21.15.60:0/3672284028 >> v2:172.21.15.135:3300/0 conn(0x7fb1d4068cb0 msgr2=0x7fb1d415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:13.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.586+0000 7fb1d2ffd700 1 --2- 172.21.15.60:0/3672284028 >> v2:172.21.15.135:3300/0 conn(0x7fb1d4068cb0 0x7fb1d415dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:13.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.586+0000 7fb1d2ffd700 1 -- 172.21.15.60:0/3672284028 >> v1:172.21.15.60:6789/0 conn(0x7fb1d40c6cc0 legacy=0x7fb1d40cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:13.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.586+0000 7fb1d2ffd700 1 -- 172.21.15.60:0/3672284028 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d40ca380 con 0x7fb1d40688e0 2023-10-06T04:29:13.590 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.586+0000 7fb1d27fc700 1 --2- 172.21.15.60:0/3672284028 >> v2:172.21.15.135:3300/0 conn(0x7fb1d4068cb0 0x7fb1d415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:13.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.586+0000 7fb1d1ffb700 1 -- 172.21.15.60:0/3672284028 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639221344 0 0) 0x7fb1d40c74a0 con 0x7fb1d40c6cc0 2023-10-06T04:29:13.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.586+0000 7fb1d2ffd700 1 --2- 172.21.15.60:0/3672284028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1d40688e0 0x7fb1d40cb140 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb1d406f030 tx=0x7fb1c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb239a91309dc6b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:13.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.587+0000 7fb1d1ffb700 1 -- 172.21.15.60:0/3672284028 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c400b6b0 con 0x7fb1d40688e0 2023-10-06T04:29:13.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.587+0000 7fb1d1ffb700 1 -- 172.21.15.60:0/3672284028 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c400b810 con 0x7fb1d40688e0 2023-10-06T04:29:13.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.587+0000 7fb1d1ffb700 1 -- 172.21.15.60:0/3672284028 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c400bbb0 con 0x7fb1d40688e0 2023-10-06T04:29:13.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.587+0000 7fb1d3fff700 1 -- 172.21.15.60:0/3672284028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1d40688e0 msgr2=0x7fb1d40cb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:13.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.587+0000 7fb1d3fff700 1 --2- 172.21.15.60:0/3672284028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1d40688e0 0x7fb1d40cb140 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb1d406f030 tx=0x7fb1c40091a0 comp rx=0 tx=0).stop 2023-10-06T04:29:13.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.587+0000 7fb1d3fff700 1 -- 172.21.15.60:0/3672284028 shutdown_connections 2023-10-06T04:29:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.587+0000 7fb1d3fff700 1 --2- 172.21.15.60:0/3672284028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1d40688e0 0x7fb1d40cb140 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.587+0000 7fb1d3fff700 1 --2- 172.21.15.60:0/3672284028 >> v2:172.21.15.135:3300/0 conn(0x7fb1d4068cb0 0x7fb1d415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.587+0000 7fb1d3fff700 1 -- 172.21.15.60:0/3672284028 >> 172.21.15.60:0/3672284028 conn(0x7fb1d40cd1f0 msgr2=0x7fb1d40c9190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.587+0000 7fb1d3fff700 1 -- 172.21.15.60:0/3672284028 shutdown_connections 2023-10-06T04:29:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.587+0000 7fb1d3fff700 1 -- 172.21.15.60:0/3672284028 wait complete. 2023-10-06T04:29:13.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.589+0000 7fb1d3fff700 1 Processor -- start 2023-10-06T04:29:13.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.589+0000 7fb1d3fff700 1 -- start start 2023-10-06T04:29:13.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.590+0000 7fb1d3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1d40688e0 0x7fb1d40b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:13.594 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.590+0000 7fb1d3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1d4068cb0 0x7fb1d4157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.590+0000 7fb1d3fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1d40c6cc0 0x7fb1d40b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.590+0000 7fb1d3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40af4d0 con 0x7fb1d4068cb0 2023-10-06T04:29:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.590+0000 7fb1d3fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40afd00 con 0x7fb1d40688e0 2023-10-06T04:29:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.590+0000 7fb1d3fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d4158210 con 0x7fb1d40c6cc0 2023-10-06T04:29:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.590+0000 7fb1d27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1d4068cb0 0x7fb1d4157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.590+0000 7fb1d27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1d4068cb0 0x7fb1d4157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46186/0 (socket says 172.21.15.60:46186) 2023-10-06T04:29:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.590+0000 7fb1d27fc700 1 -- 172.21.15.60:0/4084081097 learned_addr learned my addr 172.21.15.60:0/4084081097 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.590+0000 7fb1d27fc700 1 -- 172.21.15.60:0/4084081097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1d40c6cc0 msgr2=0x7fb1d40b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.590+0000 7fb1d27fc700 1 --2- 172.21.15.60:0/4084081097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1d40c6cc0 0x7fb1d40b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.590+0000 7fb1d2ffd700 1 --2- 172.21.15.60:0/4084081097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1d40688e0 0x7fb1d40b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.590+0000 7fb1d27fc700 1 -- 172.21.15.60:0/4084081097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1d40688e0 msgr2=0x7fb1d40b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.590+0000 7fb1d27fc700 1 --2- 172.21.15.60:0/4084081097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1d40688e0 0x7fb1d40b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.590+0000 7fb1d27fc700 1 -- 172.21.15.60:0/4084081097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c4009420 con 0x7fb1d4068cb0 2023-10-06T04:29:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.590+0000 7fb1d2ffd700 1 --2- 172.21.15.60:0/4084081097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1d40688e0 0x7fb1d40b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.590+0000 7fb1d27fc700 1 --2- 172.21.15.60:0/4084081097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1d4068cb0 0x7fb1d4157cd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800d860 tx=0x7fb1c8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.591+0000 7fb1baffd700 1 -- 172.21.15.60:0/4084081097 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c80125f0 con 0x7fb1d4068cb0 2023-10-06T04:29:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.591+0000 7fb1baffd700 1 -- 172.21.15.60:0/4084081097 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c8012750 con 0x7fb1d4068cb0 2023-10-06T04:29:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.591+0000 7fb1baffd700 1 -- 172.21.15.60:0/4084081097 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8012ad0 con 0x7fb1d4068cb0 2023-10-06T04:29:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.591+0000 7fb1d3fff700 1 -- 172.21.15.60:0/4084081097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d40c32e0 con 0x7fb1d4068cb0 2023-10-06T04:29:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.591+0000 7fb1d3fff700 1 -- 172.21.15.60:0/4084081097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d40af990 con 0x7fb1d4068cb0 2023-10-06T04:29:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.592+0000 7fb1d3fff700 1 -- 172.21.15.60:0/4084081097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d405f230 con 0x7fb1d4068cb0 2023-10-06T04:29:13.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.593+0000 7fb1baffd700 1 -- 172.21.15.60:0/4084081097 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1c8014430 con 0x7fb1d4068cb0 2023-10-06T04:29:13.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.594+0000 7fb1baffd700 1 --2- 172.21.15.60:0/4084081097 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb1c0066f30 0x7fb1c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:13.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.594+0000 7fb1baffd700 1 -- 172.21.15.60:0/4084081097 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fb1c8084940 con 0x7fb1d4068cb0 2023-10-06T04:29:13.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.594+0000 7fb1d2ffd700 1 --2- 172.21.15.60:0/4084081097 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb1c0066f30 0x7fb1c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:13.597 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.595+0000 7fb1d2ffd700 1 --2- 172.21.15.60:0/4084081097 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb1c0066f30 0x7fb1c00693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4159010 tx=0x7fb1c4017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:13.600 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.598+0000 7fb1baffd700 1 -- 172.21.15.60:0/4084081097 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1c8051bc0 con 0x7fb1d4068cb0 2023-10-06T04:29:13.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.883+0000 7fb1d3fff700 1 -- 172.21.15.60:0/4084081097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fb1d40ca660 con 0x7fb1d4068cb0 2023-10-06T04:29:13.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.887+0000 7fb1baffd700 1 -- 172.21.15.60:0/4084081097 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb1c80551e0 con 0x7fb1d4068cb0 2023-10-06T04:29:13.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.889+0000 7fb1d3fff700 1 -- 172.21.15.60:0/4084081097 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb1c0066f30 msgr2=0x7fb1c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:13.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.889+0000 7fb1d3fff700 1 --2- 172.21.15.60:0/4084081097 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb1c0066f30 0x7fb1c00693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4159010 tx=0x7fb1c4017000 comp rx=0 tx=0).stop 2023-10-06T04:29:13.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.889+0000 7fb1d3fff700 1 -- 172.21.15.60:0/4084081097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1d4068cb0 msgr2=0x7fb1d4157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:13.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.889+0000 7fb1d3fff700 1 --2- 172.21.15.60:0/4084081097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1d4068cb0 0x7fb1d4157cd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800d860 tx=0x7fb1c8008040 comp rx=0 tx=0).stop 2023-10-06T04:29:13.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.889+0000 7fb1d3fff700 1 -- 172.21.15.60:0/4084081097 shutdown_connections 2023-10-06T04:29:13.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.889+0000 7fb1d3fff700 1 --2- 172.21.15.60:0/4084081097 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb1c0066f30 0x7fb1c00693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:13.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.889+0000 7fb1d3fff700 1 --2- 172.21.15.60:0/4084081097 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1d40c6cc0 0x7fb1d40b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:13.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.889+0000 7fb1d3fff700 1 --2- 172.21.15.60:0/4084081097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1d40688e0 0x7fb1d40b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:13.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.889+0000 7fb1d3fff700 1 --2- 172.21.15.60:0/4084081097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1d4068cb0 0x7fb1d4157cd0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:13.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.889+0000 7fb1d3fff700 1 -- 172.21.15.60:0/4084081097 >> 172.21.15.60:0/4084081097 conn(0x7fb1d40cd1f0 msgr2=0x7fb1d406a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:13.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.889+0000 7fb1d3fff700 1 -- 172.21.15.60:0/4084081097 shutdown_connections 2023-10-06T04:29:13.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:13.889+0000 7fb1d3fff700 1 -- 172.21.15.60:0/4084081097 wait complete. 2023-10-06T04:29:13.909 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T04:29:14.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.094+0000 7f8f4bfff700 1 Processor -- start 2023-10-06T04:29:14.097 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.095+0000 7f8f4bfff700 1 -- start start 2023-10-06T04:29:14.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.096+0000 7f8f4bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8f4c06a590 0x7f8f4c1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:14.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.096+0000 7f8f4bfff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4c0c9cc0 con 0x7f8f4c06e660 2023-10-06T04:29:14.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.096+0000 7f8f4bfff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4c0c6710 con 0x7f8f4c06a960 2023-10-06T04:29:14.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.096+0000 7f8f4bfff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4c06f560 con 0x7f8f4c06a590 2023-10-06T04:29:14.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.096+0000 7f8f4affd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8f4c06a590 0x7f8f4c1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:14.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.096+0000 7f8f4affd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8f4c06a590 0x7f8f4c1536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46202/0 (socket says 172.21.15.60:46202) 2023-10-06T04:29:14.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.096+0000 7f8f4affd700 1 -- 172.21.15.60:0/4117071022 learned_addr learned my addr 172.21.15.60:0/4117071022 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:14.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.096+0000 7f8f4b7fe700 1 --1- 172.21.15.60:0/4117071022 >> v1:172.21.15.60:6789/0 conn(0x7f8f4c06e660 0x7f8f4c0ca150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53598/0 (socket says 172.21.15.60:53598) 2023-10-06T04:29:14.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.097+0000 7f8f4affd700 1 -- 172.21.15.60:0/4117071022 >> v1:172.21.15.135:6789/0 conn(0x7f8f4c06a960 legacy=0x7f8f4c06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:14.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.097+0000 7f8f4affd700 1 -- 172.21.15.60:0/4117071022 >> v1:172.21.15.60:6789/0 conn(0x7f8f4c06e660 legacy=0x7f8f4c0ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:14.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.097+0000 7f8f4affd700 1 -- 172.21.15.60:0/4117071022 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4c06ecc0 con 0x7f8f4c06a590 2023-10-06T04:29:14.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.097+0000 7f8f4affd700 1 --2- 172.21.15.60:0/4117071022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f4c06a590 0x7f8f4c1536f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00bc50 tx=0x7f8f3c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4a9593581d2997 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:14.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.097+0000 7f8f49ffb700 1 -- 172.21.15.60:0/4117071022 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c00be60 con 0x7f8f4c06a590 2023-10-06T04:29:14.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.097+0000 7f8f49ffb700 1 -- 172.21.15.60:0/4117071022 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c00de00 con 0x7f8f4c06a590 2023-10-06T04:29:14.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.097+0000 7f8f49ffb700 1 -- 172.21.15.60:0/4117071022 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c0196b0 con 0x7f8f4c06a590 2023-10-06T04:29:14.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.098+0000 7f8f4bfff700 1 -- 172.21.15.60:0/4117071022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f4c06a590 msgr2=0x7f8f4c1536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:14.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.098+0000 7f8f4bfff700 1 --2- 172.21.15.60:0/4117071022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f4c06a590 0x7f8f4c1536f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00bc50 tx=0x7f8f3c00b4f0 comp rx=0 tx=0).stop 2023-10-06T04:29:14.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.098+0000 7f8f4bfff700 1 -- 172.21.15.60:0/4117071022 shutdown_connections 2023-10-06T04:29:14.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.098+0000 7f8f4bfff700 1 --2- 172.21.15.60:0/4117071022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f4c06a590 0x7f8f4c1536f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:14.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.098+0000 7f8f4bfff700 1 -- 172.21.15.60:0/4117071022 >> 172.21.15.60:0/4117071022 conn(0x7f8f4c068080 msgr2=0x7f8f4c0cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:14.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.098+0000 7f8f4bfff700 1 -- 172.21.15.60:0/4117071022 shutdown_connections 2023-10-06T04:29:14.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.098+0000 7f8f4bfff700 1 -- 172.21.15.60:0/4117071022 wait complete. 2023-10-06T04:29:14.103 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.099+0000 7f8f4bfff700 1 Processor -- start 2023-10-06T04:29:14.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.099+0000 7f8f4bfff700 1 -- start start 2023-10-06T04:29:14.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.100+0000 7f8f4bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f4c06a590 0x7f8f4c14e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:14.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.100+0000 7f8f4bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f4c06a960 0x7f8f4c0c5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:14.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.100+0000 7f8f4bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f4c06e660 0x7f8f4c0c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:14.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.100+0000 7f8f4bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c14e8d0 con 0x7f8f4c06a960 2023-10-06T04:29:14.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.100+0000 7f8f4bfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c1540d0 con 0x7f8f4c06a590 2023-10-06T04:29:14.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.100+0000 7f8f4bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c1534c0 con 0x7f8f4c06e660 2023-10-06T04:29:14.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.100+0000 7f8f4a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f4c06a960 0x7f8f4c0c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:14.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.100+0000 7f8f4a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f4c06a960 0x7f8f4c0c5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46204/0 (socket says 172.21.15.60:46204) 2023-10-06T04:29:14.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.100+0000 7f8f4a7fc700 1 -- 172.21.15.60:0/1597867214 learned_addr learned my addr 172.21.15.60:0/1597867214 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:14.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.101+0000 7f8f4affd700 1 --2- 172.21.15.60:0/1597867214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f4c06a590 0x7f8f4c14e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:14.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.101+0000 7f8f4b7fe700 1 --2- 172.21.15.60:0/1597867214 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f4c06e660 0x7f8f4c0c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:14.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.101+0000 7f8f4a7fc700 1 -- 172.21.15.60:0/1597867214 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f4c06e660 msgr2=0x7f8f4c0c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:14.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.101+0000 7f8f4a7fc700 1 --2- 172.21.15.60:0/1597867214 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f4c06e660 0x7f8f4c0c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:14.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.101+0000 7f8f4a7fc700 1 -- 172.21.15.60:0/1597867214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f4c06a590 msgr2=0x7f8f4c14e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:14.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.101+0000 7f8f4a7fc700 1 --2- 172.21.15.60:0/1597867214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f4c06a590 0x7f8f4c14e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:14.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.101+0000 7f8f4a7fc700 1 -- 172.21.15.60:0/1597867214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c00b790 con 0x7f8f4c06a960 2023-10-06T04:29:14.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.101+0000 7f8f4a7fc700 1 --2- 172.21.15.60:0/1597867214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f4c06a960 0x7f8f4c0c5380 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000c790 tx=0x7f8f40007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:14.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.101+0000 7f8f32ffd700 1 -- 172.21.15.60:0/1597867214 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40006820 con 0x7f8f4c06a960 2023-10-06T04:29:14.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.101+0000 7f8f32ffd700 1 -- 172.21.15.60:0/1597867214 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f40006980 con 0x7f8f4c06a960 2023-10-06T04:29:14.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.101+0000 7f8f4bfff700 1 -- 172.21.15.60:0/1597867214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4c1537a0 con 0x7f8f4c06a960 2023-10-06T04:29:14.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.101+0000 7f8f32ffd700 1 -- 172.21.15.60:0/1597867214 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40006d40 con 0x7f8f4c06a960 2023-10-06T04:29:14.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.102+0000 7f8f4bfff700 1 -- 172.21.15.60:0/1597867214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4c153d60 con 0x7f8f4c06a960 2023-10-06T04:29:14.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.102+0000 7f8f4bfff700 1 -- 172.21.15.60:0/1597867214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f4c05f230 con 0x7f8f4c06a960 2023-10-06T04:29:14.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.103+0000 7f8f32ffd700 1 -- 172.21.15.60:0/1597867214 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f40007240 con 0x7f8f4c06a960 2023-10-06T04:29:14.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.104+0000 7f8f32ffd700 1 --2- 172.21.15.60:0/1597867214 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8f38066f30 0x7f8f380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:14.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.104+0000 7f8f32ffd700 1 -- 172.21.15.60:0/1597867214 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f8f40083ab0 con 0x7f8f4c06a960 2023-10-06T04:29:14.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.105+0000 7f8f4affd700 1 --2- 172.21.15.60:0/1597867214 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8f38066f30 0x7f8f380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:14.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.105+0000 7f8f4affd700 1 --2- 172.21.15.60:0/1597867214 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8f38066f30 0x7f8f380693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00bc50 tx=0x7f8f3c01b000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:14.111 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.109+0000 7f8f32ffd700 1 -- 172.21.15.60:0/1597867214 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f40050d30 con 0x7f8f4c06a960 2023-10-06T04:29:14.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.393+0000 7f8f4bfff700 1 -- 172.21.15.60:0/1597867214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f8f4c06d670 con 0x7f8f4c06a960 2023-10-06T04:29:14.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.397+0000 7f8f32ffd700 1 -- 172.21.15.60:0/1597867214 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8f40017070 con 0x7f8f4c06a960 2023-10-06T04:29:14.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.400+0000 7f8f4bfff700 1 -- 172.21.15.60:0/1597867214 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8f38066f30 msgr2=0x7f8f380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:14.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.400+0000 7f8f4bfff700 1 --2- 172.21.15.60:0/1597867214 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8f38066f30 0x7f8f380693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00bc50 tx=0x7f8f3c01b000 comp rx=0 tx=0).stop 2023-10-06T04:29:14.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.400+0000 7f8f4bfff700 1 -- 172.21.15.60:0/1597867214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f4c06a960 msgr2=0x7f8f4c0c5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:14.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.400+0000 7f8f4bfff700 1 --2- 172.21.15.60:0/1597867214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f4c06a960 0x7f8f4c0c5380 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000c790 tx=0x7f8f40007f60 comp rx=0 tx=0).stop 2023-10-06T04:29:14.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.400+0000 7f8f4bfff700 1 -- 172.21.15.60:0/1597867214 shutdown_connections 2023-10-06T04:29:14.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.400+0000 7f8f4bfff700 1 --2- 172.21.15.60:0/1597867214 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8f38066f30 0x7f8f380693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:14.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.400+0000 7f8f4bfff700 1 --2- 172.21.15.60:0/1597867214 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8f4c06e660 0x7f8f4c0c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:14.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.400+0000 7f8f4bfff700 1 --2- 172.21.15.60:0/1597867214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f4c06a590 0x7f8f4c14e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:14.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.400+0000 7f8f4bfff700 1 --2- 172.21.15.60:0/1597867214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f4c06a960 0x7f8f4c0c5380 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:14.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.400+0000 7f8f4bfff700 1 -- 172.21.15.60:0/1597867214 >> 172.21.15.60:0/1597867214 conn(0x7f8f4c068080 msgr2=0x7f8f4c0cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:14.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.400+0000 7f8f4bfff700 1 -- 172.21.15.60:0/1597867214 shutdown_connections 2023-10-06T04:29:14.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.400+0000 7f8f4bfff700 1 -- 172.21.15.60:0/1597867214 wait complete. 2023-10-06T04:29:14.420 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T04:29:14.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.606+0000 7f493c9fe700 1 Processor -- start 2023-10-06T04:29:14.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.606+0000 7f493c9fe700 1 -- start start 2023-10-06T04:29:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.607+0000 7f493c9fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f49380cbc30 0x7f49380cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.607+0000 7f493c9fe700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49380cb7a0 con 0x7f49380b2100 2023-10-06T04:29:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.607+0000 7f493c9fe700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49380b0860 con 0x7f4938159440 2023-10-06T04:29:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.607+0000 7f493c9fe700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49380cb150 con 0x7f49380cbc30 2023-10-06T04:29:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.608+0000 7f493659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f49380cbc30 0x7f49380cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.608+0000 7f493759e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f49380b2100 0x7f49380b2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53608/0 (socket says 172.21.15.60:53608) 2023-10-06T04:29:14.610 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.608+0000 7f493759e700 1 -- 172.21.15.60:0/1208216170 learned_addr learned my addr 172.21.15.60:0/1208216170 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:29:14.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.608+0000 7f493659c700 1 -- 172.21.15.60:0/1208216170 >> v1:172.21.15.135:6789/0 conn(0x7f4938159440 legacy=0x7f49380b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:14.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.608+0000 7f493659c700 1 -- 172.21.15.60:0/1208216170 >> v1:172.21.15.60:6789/0 conn(0x7f49380b2100 legacy=0x7f49380b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:14.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.608+0000 7f493659c700 1 -- 172.21.15.60:0/1208216170 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49380cb430 con 0x7f49380cbc30 2023-10-06T04:29:14.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.608+0000 7f493659c700 1 --2- 172.21.15.60:0/1208216170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49380cbc30 0x7f49380cc080 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f492c0098e0 tx=0x7f492c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5345413702655ae9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:14.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.608+0000 7f4935d9b700 1 -- 172.21.15.60:0/1208216170 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c009e80 con 0x7f49380cbc30 2023-10-06T04:29:14.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.609+0000 7f4935d9b700 1 -- 172.21.15.60:0/1208216170 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c00b860 con 0x7f49380cbc30 2023-10-06T04:29:14.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.609+0000 7f4935d9b700 1 -- 172.21.15.60:0/1208216170 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c00bbe0 con 0x7f49380cbc30 2023-10-06T04:29:14.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.609+0000 7f493c9fe700 1 -- 172.21.15.60:0/1208216170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49380cbc30 msgr2=0x7f49380cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:14.612 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.609+0000 7f493c9fe700 1 --2- 172.21.15.60:0/1208216170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49380cbc30 0x7f49380cc080 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f492c0098e0 tx=0x7f492c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:29:14.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.609+0000 7f493c9fe700 1 -- 172.21.15.60:0/1208216170 shutdown_connections 2023-10-06T04:29:14.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.609+0000 7f493c9fe700 1 --2- 172.21.15.60:0/1208216170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49380cbc30 0x7f49380cc080 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:14.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.609+0000 7f493c9fe700 1 -- 172.21.15.60:0/1208216170 >> 172.21.15.60:0/1208216170 conn(0x7f493806ece0 msgr2=0x7f493806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:14.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.609+0000 7f493c9fe700 1 -- 172.21.15.60:0/1208216170 shutdown_connections 2023-10-06T04:29:14.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.609+0000 7f493c9fe700 1 -- 172.21.15.60:0/1208216170 wait complete. 2023-10-06T04:29:14.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.611+0000 7f493c9fe700 1 Processor -- start 2023-10-06T04:29:14.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.611+0000 7f493c9fe700 1 -- start start 2023-10-06T04:29:14.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.612+0000 7f493c9fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49380b2100 0x7f4938153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:14.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.612+0000 7f493c9fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49380cbc30 0x7f49380cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:14.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.612+0000 7f493c9fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4938159440 0x7f49380c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:14.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.612+0000 7f493c9fe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49380c8d50 con 0x7f4938159440 2023-10-06T04:29:14.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.612+0000 7f493c9fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493816a4e0 con 0x7f49380cbc30 2023-10-06T04:29:14.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.612+0000 7f493c9fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49380c8ff0 con 0x7f49380b2100 2023-10-06T04:29:14.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.612+0000 7f493759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4938159440 0x7f49380c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:14.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.612+0000 7f493759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4938159440 0x7f49380c9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46218/0 (socket says 172.21.15.60:46218) 2023-10-06T04:29:14.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.612+0000 7f493759e700 1 -- 172.21.15.60:0/3941973663 learned_addr learned my addr 172.21.15.60:0/3941973663 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:14.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.612+0000 7f493659c700 1 --2- 172.21.15.60:0/3941973663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49380cbc30 0x7f49380cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:14.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.612+0000 7f4936d9d700 1 --2- 172.21.15.60:0/3941973663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49380b2100 0x7f4938153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:14.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.612+0000 7f493759e700 1 -- 172.21.15.60:0/3941973663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49380b2100 msgr2=0x7f4938153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:14.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.612+0000 7f493759e700 1 --2- 172.21.15.60:0/3941973663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49380b2100 0x7f4938153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:14.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.612+0000 7f493759e700 1 -- 172.21.15.60:0/3941973663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49380cbc30 msgr2=0x7f49380cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:14.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.612+0000 7f493759e700 1 --2- 172.21.15.60:0/3941973663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49380cbc30 0x7f49380cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:14.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.612+0000 7f493759e700 1 -- 172.21.15.60:0/3941973663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c009420 con 0x7f4938159440 2023-10-06T04:29:14.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.612+0000 7f493659c700 1 --2- 172.21.15.60:0/3941973663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49380cbc30 0x7f49380cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:14.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.612+0000 7f4936d9d700 1 --2- 172.21.15.60:0/3941973663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49380b2100 0x7f4938153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:14.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.613+0000 7f493759e700 1 --2- 172.21.15.60:0/3941973663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4938159440 0x7f49380c9ad0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f493000cc40 tx=0x7f4930001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:14.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.613+0000 7f491effd700 1 -- 172.21.15.60:0/3941973663 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493000a9c0 con 0x7f4938159440 2023-10-06T04:29:14.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.613+0000 7f491effd700 1 -- 172.21.15.60:0/3941973663 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493000ab20 con 0x7f4938159440 2023-10-06T04:29:14.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.613+0000 7f491effd700 1 -- 172.21.15.60:0/3941973663 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49300070f0 con 0x7f4938159440 2023-10-06T04:29:14.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.613+0000 7f493c9fe700 1 -- 172.21.15.60:0/3941973663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49380c92d0 con 0x7f4938159440 2023-10-06T04:29:14.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.613+0000 7f493c9fe700 1 -- 172.21.15.60:0/3941973663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49381541c0 con 0x7f4938159440 2023-10-06T04:29:14.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.614+0000 7f493c9fe700 1 -- 172.21.15.60:0/3941973663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493805f230 con 0x7f4938159440 2023-10-06T04:29:14.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.615+0000 7f491effd700 1 -- 172.21.15.60:0/3941973663 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49300074e0 con 0x7f4938159440 2023-10-06T04:29:14.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.616+0000 7f491effd700 1 --2- 172.21.15.60:0/3941973663 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4924066f30 0x7f49240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:14.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.616+0000 7f491effd700 1 -- 172.21.15.60:0/3941973663 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f4930084980 con 0x7f4938159440 2023-10-06T04:29:14.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.616+0000 7f4936d9d700 1 --2- 172.21.15.60:0/3941973663 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4924066f30 0x7f49240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:14.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.617+0000 7f4936d9d700 1 --2- 172.21.15.60:0/3941973663 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4924066f30 0x7f49240693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f49380cdca0 tx=0x7f4928009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:14.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.620+0000 7f491effd700 1 -- 172.21.15.60:0/3941973663 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4930051c80 con 0x7f4938159440 2023-10-06T04:29:14.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.903+0000 7f493c9fe700 1 -- 172.21.15.60:0/3941973663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f4938159810 con 0x7f4938159440 2023-10-06T04:29:14.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.907+0000 7f491effd700 1 -- 172.21.15.60:0/3941973663 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f49300552a0 con 0x7f4938159440 2023-10-06T04:29:14.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.910+0000 7f493c9fe700 1 -- 172.21.15.60:0/3941973663 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4924066f30 msgr2=0x7f49240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:14.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.910+0000 7f493c9fe700 1 --2- 172.21.15.60:0/3941973663 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4924066f30 0x7f49240693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f49380cdca0 tx=0x7f4928009040 comp rx=0 tx=0).stop 2023-10-06T04:29:14.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.910+0000 7f493c9fe700 1 -- 172.21.15.60:0/3941973663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4938159440 msgr2=0x7f49380c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:14.912 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.910+0000 7f493c9fe700 1 --2- 172.21.15.60:0/3941973663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4938159440 0x7f49380c9ad0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f493000cc40 tx=0x7f4930001a50 comp rx=0 tx=0).stop 2023-10-06T04:29:14.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.910+0000 7f493c9fe700 1 -- 172.21.15.60:0/3941973663 shutdown_connections 2023-10-06T04:29:14.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.910+0000 7f493c9fe700 1 --2- 172.21.15.60:0/3941973663 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4924066f30 0x7f49240693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:14.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.910+0000 7f493c9fe700 1 --2- 172.21.15.60:0/3941973663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4938159440 0x7f49380c9ad0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:14.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.910+0000 7f493c9fe700 1 --2- 172.21.15.60:0/3941973663 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f49380b2100 0x7f4938153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:14.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.910+0000 7f493c9fe700 1 --2- 172.21.15.60:0/3941973663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49380cbc30 0x7f49380cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:14.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.910+0000 7f493c9fe700 1 -- 172.21.15.60:0/3941973663 >> 172.21.15.60:0/3941973663 conn(0x7f493806ece0 msgr2=0x7f4938155ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:14.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.910+0000 7f493c9fe700 1 -- 172.21.15.60:0/3941973663 shutdown_connections 2023-10-06T04:29:14.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:14.910+0000 7f493c9fe700 1 -- 172.21.15.60:0/3941973663 wait complete. 2023-10-06T04:29:14.929 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T04:29:15.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.116+0000 7f7b84f9d700 1 Processor -- start 2023-10-06T04:29:15.118 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.116+0000 7f7b84f9d700 1 -- start start 2023-10-06T04:29:15.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.117+0000 7f7b84f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b80159390 0x7f7b800ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:15.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.117+0000 7f7b84f9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b800686c0 con 0x7f7b80159760 2023-10-06T04:29:15.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.117+0000 7f7b84f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b80068c80 con 0x7f7b800ab410 2023-10-06T04:29:15.119 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.117+0000 7f7b84f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b800ace20 con 0x7f7b80159390 2023-10-06T04:29:15.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.117+0000 7f7b7effd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7b80159760 0x7f7b800aad00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53618/0 (socket says 172.21.15.60:53618) 2023-10-06T04:29:15.120 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.117+0000 7f7b7effd700 1 -- 172.21.15.60:0/4011354899 learned_addr learned my addr 172.21.15.60:0/4011354899 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:29:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.117+0000 7f7b7f7fe700 1 --2- 172.21.15.60:0/4011354899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b80159390 0x7f7b800ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.118+0000 7f7b7e7fc700 1 -- 172.21.15.60:0/4011354899 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20764510 0 0) 0x7f7b800686c0 con 0x7f7b80159760 2023-10-06T04:29:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.118+0000 7f7b7e7fc700 1 -- 172.21.15.60:0/4011354899 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b68003570 con 0x7f7b80159760 2023-10-06T04:29:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.118+0000 7f7b7f7fe700 1 -- 172.21.15.60:0/4011354899 >> v1:172.21.15.135:6789/0 conn(0x7f7b800ab410 legacy=0x7f7b800aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.118+0000 7f7b7e7fc700 1 -- 172.21.15.60:0/4011354899 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75385333 0 0) 0x7f7b80068c80 con 0x7f7b800ab410 2023-10-06T04:29:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.118+0000 7f7b7f7fe700 1 -- 172.21.15.60:0/4011354899 >> v1:172.21.15.60:6789/0 conn(0x7f7b80159760 legacy=0x7f7b800aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.118+0000 7f7b7f7fe700 1 -- 172.21.15.60:0/4011354899 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b800ad0f0 con 0x7f7b80159390 2023-10-06T04:29:15.121 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.118+0000 7f7b7f7fe700 1 --2- 172.21.15.60:0/4011354899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b80159390 0x7f7b800ac8e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b70009910 tx=0x7f7b700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76cd75417a662b8a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:15.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.119+0000 7f7b7e7fc700 1 -- 172.21.15.60:0/4011354899 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b74001470 con 0x7f7b80159390 2023-10-06T04:29:15.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.119+0000 7f7b7e7fc700 1 -- 172.21.15.60:0/4011354899 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b70011420 con 0x7f7b80159390 2023-10-06T04:29:15.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.119+0000 7f7b7e7fc700 1 -- 172.21.15.60:0/4011354899 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b700117c0 con 0x7f7b80159390 2023-10-06T04:29:15.122 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.119+0000 7f7b84f9d700 1 -- 172.21.15.60:0/4011354899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b80159390 msgr2=0x7f7b800ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:15.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.119+0000 7f7b84f9d700 1 --2- 172.21.15.60:0/4011354899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b80159390 0x7f7b800ac8e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b70009910 tx=0x7f7b700091a0 comp rx=0 tx=0).stop 2023-10-06T04:29:15.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.119+0000 7f7b84f9d700 1 -- 172.21.15.60:0/4011354899 shutdown_connections 2023-10-06T04:29:15.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.119+0000 7f7b84f9d700 1 --2- 172.21.15.60:0/4011354899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b80159390 0x7f7b800ac8e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:15.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.119+0000 7f7b84f9d700 1 -- 172.21.15.60:0/4011354899 >> 172.21.15.60:0/4011354899 conn(0x7f7b80097410 msgr2=0x7f7b80067d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:15.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.119+0000 7f7b84f9d700 1 -- 172.21.15.60:0/4011354899 shutdown_connections 2023-10-06T04:29:15.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.119+0000 7f7b84f9d700 1 -- 172.21.15.60:0/4011354899 wait complete. 2023-10-06T04:29:15.123 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.121+0000 7f7b84f9d700 1 Processor -- start 2023-10-06T04:29:15.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.121+0000 7f7b84f9d700 1 -- start start 2023-10-06T04:29:15.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.122+0000 7f7b84f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b800ab410 0x7f7b801422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:15.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.122+0000 7f7b84f9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b80159390 0x7f7b8015ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:15.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.122+0000 7f7b84f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b80159760 0x7f7b8015b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:15.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.122+0000 7f7b84f9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8015db00 con 0x7f7b80159390 2023-10-06T04:29:15.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.122+0000 7f7b84f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b801564e0 con 0x7f7b80159760 2023-10-06T04:29:15.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.122+0000 7f7b84f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8015d620 con 0x7f7b800ab410 2023-10-06T04:29:15.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.122+0000 7f7b7effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b80159390 0x7f7b8015ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:15.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.122+0000 7f7b7effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b80159390 0x7f7b8015ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46222/0 (socket says 172.21.15.60:46222) 2023-10-06T04:29:15.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.122+0000 7f7b7effd700 1 -- 172.21.15.60:0/3501910190 learned_addr learned my addr 172.21.15.60:0/3501910190 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:15.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.122+0000 7f7b7f7fe700 1 --2- 172.21.15.60:0/3501910190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b800ab410 0x7f7b801422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:15.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.122+0000 7f7b7ffff700 1 --2- 172.21.15.60:0/3501910190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b80159760 0x7f7b8015b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:15.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.122+0000 7f7b7effd700 1 -- 172.21.15.60:0/3501910190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b800ab410 msgr2=0x7f7b801422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:15.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.122+0000 7f7b7effd700 1 --2- 172.21.15.60:0/3501910190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b800ab410 0x7f7b801422f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:15.126 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.122+0000 7f7b7effd700 1 -- 172.21.15.60:0/3501910190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b80159760 msgr2=0x7f7b8015b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:15.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.122+0000 7f7b7effd700 1 --2- 172.21.15.60:0/3501910190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b80159760 0x7f7b8015b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:15.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.122+0000 7f7b7effd700 1 -- 172.21.15.60:0/3501910190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b70009420 con 0x7f7b80159390 2023-10-06T04:29:15.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.122+0000 7f7b7f7fe700 1 --2- 172.21.15.60:0/3501910190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b800ab410 0x7f7b801422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:15.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.122+0000 7f7b7ffff700 1 --2- 172.21.15.60:0/3501910190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b80159760 0x7f7b8015b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:15.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.123+0000 7f7b7effd700 1 --2- 172.21.15.60:0/3501910190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b80159390 0x7f7b8015ab90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400cb90 tx=0x7f7b74001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:15.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.123+0000 7f7b677fe700 1 -- 172.21.15.60:0/3501910190 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b74007360 con 0x7f7b80159390 2023-10-06T04:29:15.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.123+0000 7f7b677fe700 1 -- 172.21.15.60:0/3501910190 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b740074c0 con 0x7f7b80159390 2023-10-06T04:29:15.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.123+0000 7f7b84f9d700 1 -- 172.21.15.60:0/3501910190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8015fb00 con 0x7f7b80159390 2023-10-06T04:29:15.127 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.123+0000 7f7b677fe700 1 -- 172.21.15.60:0/3501910190 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b74004830 con 0x7f7b80159390 2023-10-06T04:29:15.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.123+0000 7f7b84f9d700 1 -- 172.21.15.60:0/3501910190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b801600c0 con 0x7f7b80159390 2023-10-06T04:29:15.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.124+0000 7f7b84f9d700 1 -- 172.21.15.60:0/3501910190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8015dcb0 con 0x7f7b80159390 2023-10-06T04:29:15.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.125+0000 7f7b677fe700 1 -- 172.21.15.60:0/3501910190 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b74004bc0 con 0x7f7b80159390 2023-10-06T04:29:15.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.126+0000 7f7b677fe700 1 --2- 172.21.15.60:0/3501910190 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7b6c066f30 0x7f7b6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:15.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.126+0000 7f7b677fe700 1 -- 172.21.15.60:0/3501910190 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f7b74083ec0 con 0x7f7b80159390 2023-10-06T04:29:15.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.126+0000 7f7b7f7fe700 1 --2- 172.21.15.60:0/3501910190 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7b6c066f30 0x7f7b6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:15.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.127+0000 7f7b7f7fe700 1 --2- 172.21.15.60:0/3501910190 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7b6c066f30 0x7f7b6c0693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7b8015c6b0 tx=0x7f7b70017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:15.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.130+0000 7f7b677fe700 1 -- 172.21.15.60:0/3501910190 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b8015dcb0 con 0x7f7b80159390 2023-10-06T04:29:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.412+0000 7f7b84f9d700 1 -- 172.21.15.60:0/3501910190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f7b8015d8c0 con 0x7f7b80159390 2023-10-06T04:29:15.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.416+0000 7f7b677fe700 1 -- 172.21.15.60:0/3501910190 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7b740180a0 con 0x7f7b80159390 2023-10-06T04:29:15.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.419+0000 7f7b84f9d700 1 -- 172.21.15.60:0/3501910190 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7b6c066f30 msgr2=0x7f7b6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.419+0000 7f7b84f9d700 1 --2- 172.21.15.60:0/3501910190 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7b6c066f30 0x7f7b6c0693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7b8015c6b0 tx=0x7f7b70017000 comp rx=0 tx=0).stop 2023-10-06T04:29:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.419+0000 7f7b84f9d700 1 -- 172.21.15.60:0/3501910190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b80159390 msgr2=0x7f7b8015ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.419+0000 7f7b84f9d700 1 --2- 172.21.15.60:0/3501910190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b80159390 0x7f7b8015ab90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400cb90 tx=0x7f7b74001bb0 comp rx=0 tx=0).stop 2023-10-06T04:29:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.419+0000 7f7b84f9d700 1 -- 172.21.15.60:0/3501910190 shutdown_connections 2023-10-06T04:29:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.419+0000 7f7b84f9d700 1 --2- 172.21.15.60:0/3501910190 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7b6c066f30 0x7f7b6c0693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.419+0000 7f7b84f9d700 1 --2- 172.21.15.60:0/3501910190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b80159760 0x7f7b8015b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.419+0000 7f7b84f9d700 1 --2- 172.21.15.60:0/3501910190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7b800ab410 0x7f7b801422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.419+0000 7f7b84f9d700 1 --2- 172.21.15.60:0/3501910190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b80159390 0x7f7b8015ab90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.419+0000 7f7b84f9d700 1 -- 172.21.15.60:0/3501910190 >> 172.21.15.60:0/3501910190 conn(0x7f7b80097410 msgr2=0x7f7b800aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.419+0000 7f7b84f9d700 1 -- 172.21.15.60:0/3501910190 shutdown_connections 2023-10-06T04:29:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.419+0000 7f7b84f9d700 1 -- 172.21.15.60:0/3501910190 wait complete. 2023-10-06T04:29:15.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T04:29:15.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.625+0000 7f175659d700 1 Processor -- start 2023-10-06T04:29:15.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.625+0000 7f175659d700 1 -- start start 2023-10-06T04:29:15.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.626+0000 7f175659d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1750159440 0x7f17500b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:15.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.626+0000 7f175659d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f17500b2100 0x7f17500b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:15.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.626+0000 7f175659d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17500cb7a0 con 0x7f17500b35d0 2023-10-06T04:29:15.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.626+0000 7f175659d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17500b0860 con 0x7f1750159440 2023-10-06T04:29:15.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.626+0000 7f175659d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17500cb150 con 0x7f17500b2100 2023-10-06T04:29:15.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.626+0000 7f175559b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1750159440 0x7f17500b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:15.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.626+0000 7f175559b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1750159440 0x7f17500b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46234/0 (socket says 172.21.15.60:46234) 2023-10-06T04:29:15.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.627+0000 7f175559b700 1 -- 172.21.15.60:0/1915345640 learned_addr learned my addr 172.21.15.60:0/1915345640 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:15.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.627+0000 7f1755d9c700 1 --2- 172.21.15.60:0/1915345640 >> v2:172.21.15.135:3300/0 conn(0x7f17500b2100 0x7f17500b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.627+0000 7f175559b700 1 -- 172.21.15.60:0/1915345640 >> v2:172.21.15.135:3300/0 conn(0x7f17500b2100 msgr2=0x7f17500b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.627+0000 7f175559b700 1 --2- 172.21.15.60:0/1915345640 >> v2:172.21.15.135:3300/0 conn(0x7f17500b2100 0x7f17500b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.627+0000 7f175559b700 1 -- 172.21.15.60:0/1915345640 >> v1:172.21.15.135:6789/0 conn(0x7f17500b35d0 legacy=0x7f17500cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.627+0000 7f175559b700 1 -- 172.21.15.60:0/1915345640 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17500cb430 con 0x7f1750159440 2023-10-06T04:29:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.627+0000 7f175559b700 1 --2- 172.21.15.60:0/1915345640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1750159440 0x7f17500b3090 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f17500ca7f0 tx=0x7f174c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29ef451d8fb080e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.627+0000 7f1747fff700 1 -- 172.21.15.60:0/1915345640 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c00b860 con 0x7f1750159440 2023-10-06T04:29:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.628+0000 7f1747fff700 1 -- 172.21.15.60:0/1915345640 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c00b9c0 con 0x7f1750159440 2023-10-06T04:29:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.628+0000 7f1747fff700 1 -- 172.21.15.60:0/1915345640 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c00bd60 con 0x7f1750159440 2023-10-06T04:29:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.628+0000 7f175659d700 1 -- 172.21.15.60:0/1915345640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1750159440 msgr2=0x7f17500b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.628+0000 7f175659d700 1 --2- 172.21.15.60:0/1915345640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1750159440 0x7f17500b3090 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f17500ca7f0 tx=0x7f174c009250 comp rx=0 tx=0).stop 2023-10-06T04:29:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.628+0000 7f175659d700 1 -- 172.21.15.60:0/1915345640 shutdown_connections 2023-10-06T04:29:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.628+0000 7f175659d700 1 --2- 172.21.15.60:0/1915345640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1750159440 0x7f17500b3090 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.628+0000 7f175659d700 1 --2- 172.21.15.60:0/1915345640 >> v2:172.21.15.135:3300/0 conn(0x7f17500b2100 0x7f17500b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.628+0000 7f175659d700 1 -- 172.21.15.60:0/1915345640 >> 172.21.15.60:0/1915345640 conn(0x7f175006ece0 msgr2=0x7f175006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:15.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.628+0000 7f175659d700 1 -- 172.21.15.60:0/1915345640 shutdown_connections 2023-10-06T04:29:15.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.628+0000 7f175659d700 1 -- 172.21.15.60:0/1915345640 wait complete. 2023-10-06T04:29:15.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.630+0000 7f175659d700 1 Processor -- start 2023-10-06T04:29:15.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.630+0000 7f175659d700 1 -- start start 2023-10-06T04:29:15.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.631+0000 7f175659d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17500b2100 0x7f1750155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:15.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.631+0000 7f175659d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17500b35d0 0x7f175015a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:15.638 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.631+0000 7f175659d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1750159440 0x7f17500c6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:15.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.631+0000 7f175659d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1750159da0 con 0x7f17500b2100 2023-10-06T04:29:15.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.631+0000 7f175659d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17500c4b80 con 0x7f1750159440 2023-10-06T04:29:15.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.631+0000 7f175659d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175015bc10 con 0x7f17500b35d0 2023-10-06T04:29:15.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.631+0000 7f175559b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17500b2100 0x7f1750155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:15.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.631+0000 7f175559b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17500b2100 0x7f1750155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46250/0 (socket says 172.21.15.60:46250) 2023-10-06T04:29:15.639 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.631+0000 7f175559b700 1 -- 172.21.15.60:0/344104532 learned_addr learned my addr 172.21.15.60:0/344104532 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:15.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.631+0000 7f1755d9c700 1 --2- 172.21.15.60:0/344104532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1750159440 0x7f17500c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:15.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.631+0000 7f175559b700 1 -- 172.21.15.60:0/344104532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17500b35d0 msgr2=0x7f175015a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:15.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.631+0000 7f1754d9a700 1 --2- 172.21.15.60:0/344104532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17500b35d0 0x7f175015a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:15.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.631+0000 7f175559b700 1 --2- 172.21.15.60:0/344104532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17500b35d0 0x7f175015a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:15.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.631+0000 7f175559b700 1 -- 172.21.15.60:0/344104532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1750159440 msgr2=0x7f17500c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:15.640 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.631+0000 7f175559b700 1 --2- 172.21.15.60:0/344104532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1750159440 0x7f17500c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:15.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.631+0000 7f175559b700 1 -- 172.21.15.60:0/344104532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c0094f0 con 0x7f17500b2100 2023-10-06T04:29:15.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.631+0000 7f1755d9c700 1 --2- 172.21.15.60:0/344104532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1750159440 0x7f17500c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:15.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.631+0000 7f1754d9a700 1 --2- 172.21.15.60:0/344104532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17500b35d0 0x7f175015a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:15.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.632+0000 7f175559b700 1 --2- 172.21.15.60:0/344104532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17500b2100 0x7f1750155bf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1750069150 tx=0x7f174c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:15.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.632+0000 7f17457fa700 1 -- 172.21.15.60:0/344104532 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c011e60 con 0x7f17500b2100 2023-10-06T04:29:15.641 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.632+0000 7f17457fa700 1 -- 172.21.15.60:0/344104532 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c01a630 con 0x7f17500b2100 2023-10-06T04:29:15.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.632+0000 7f17457fa700 1 -- 172.21.15.60:0/344104532 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c01a9f0 con 0x7f17500b2100 2023-10-06T04:29:15.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.632+0000 7f175659d700 1 -- 172.21.15.60:0/344104532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1750156130 con 0x7f17500b2100 2023-10-06T04:29:15.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.632+0000 7f175659d700 1 -- 172.21.15.60:0/344104532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17500c4250 con 0x7f17500b2100 2023-10-06T04:29:15.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.633+0000 7f175659d700 1 -- 172.21.15.60:0/344104532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f175005f230 con 0x7f17500b2100 2023-10-06T04:29:15.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.634+0000 7f17457fa700 1 -- 172.21.15.60:0/344104532 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f174c02d440 con 0x7f17500b2100 2023-10-06T04:29:15.642 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.635+0000 7f17457fa700 1 --2- 172.21.15.60:0/344104532 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1734066f30 0x7f17340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:15.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.635+0000 7f17457fa700 1 -- 172.21.15.60:0/344104532 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f174c085fe0 con 0x7f17500b2100 2023-10-06T04:29:15.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.635+0000 7f1754d9a700 1 --2- 172.21.15.60:0/344104532 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1734066f30 0x7f17340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:15.643 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.636+0000 7f1754d9a700 1 --2- 172.21.15.60:0/344104532 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1734066f30 0x7f17340693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f17500d13a0 tx=0x7f1740009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:15.644 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.639+0000 7f17457fa700 1 -- 172.21.15.60:0/344104532 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f174c053280 con 0x7f17500b2100 2023-10-06T04:29:15.922 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.920+0000 7f175659d700 1 -- 172.21.15.60:0/344104532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f17500cdf20 con 0x7f17500b2100 2023-10-06T04:29:15.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.923+0000 7f17457fa700 1 -- 172.21.15.60:0/344104532 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f174c0568a0 con 0x7f17500b2100 2023-10-06T04:29:15.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.925+0000 7f175659d700 1 -- 172.21.15.60:0/344104532 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1734066f30 msgr2=0x7f17340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:15.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.925+0000 7f175659d700 1 --2- 172.21.15.60:0/344104532 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1734066f30 0x7f17340693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f17500d13a0 tx=0x7f1740009040 comp rx=0 tx=0).stop 2023-10-06T04:29:15.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.925+0000 7f175659d700 1 -- 172.21.15.60:0/344104532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17500b2100 msgr2=0x7f1750155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:15.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.925+0000 7f175659d700 1 --2- 172.21.15.60:0/344104532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17500b2100 0x7f1750155bf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1750069150 tx=0x7f174c017000 comp rx=0 tx=0).stop 2023-10-06T04:29:15.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.925+0000 7f175659d700 1 -- 172.21.15.60:0/344104532 shutdown_connections 2023-10-06T04:29:15.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.925+0000 7f175659d700 1 --2- 172.21.15.60:0/344104532 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1734066f30 0x7f17340693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:15.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.925+0000 7f175659d700 1 --2- 172.21.15.60:0/344104532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17500b2100 0x7f1750155bf0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:15.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.925+0000 7f175659d700 1 --2- 172.21.15.60:0/344104532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1750159440 0x7f17500c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:15.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.925+0000 7f175659d700 1 --2- 172.21.15.60:0/344104532 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17500b35d0 0x7f175015a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:15.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.925+0000 7f175659d700 1 -- 172.21.15.60:0/344104532 >> 172.21.15.60:0/344104532 conn(0x7f175006ece0 msgr2=0x7f17501568f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:15.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.926+0000 7f175659d700 1 -- 172.21.15.60:0/344104532 shutdown_connections 2023-10-06T04:29:15.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:15.926+0000 7f175659d700 1 -- 172.21.15.60:0/344104532 wait complete. 2023-10-06T04:29:15.946 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:29:16.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.130+0000 7f110ad9d700 1 Processor -- start 2023-10-06T04:29:16.132 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.130+0000 7f110ad9d700 1 -- start start 2023-10-06T04:29:16.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.131+0000 7f110ad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1104159440 0x7f11040b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:16.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.131+0000 7f110ad9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f11040b35d0 0x7f11040cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:16.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.131+0000 7f110ad9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11040cb7a0 con 0x7f11040cc170 2023-10-06T04:29:16.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.131+0000 7f110ad9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11040b0860 con 0x7f1104159440 2023-10-06T04:29:16.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.131+0000 7f110ad9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11040cb150 con 0x7f11040b35d0 2023-10-06T04:29:16.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.131+0000 7f1109d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1104159440 0x7f11040b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:16.134 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.131+0000 7f110a59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f11040cc170 0x7f11040b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53620/0 (socket says 172.21.15.60:53620) 2023-10-06T04:29:16.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.131+0000 7f1109d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1104159440 0x7f11040b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46256/0 (socket says 172.21.15.60:46256) 2023-10-06T04:29:16.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.131+0000 7f110a59c700 1 -- 172.21.15.60:0/3823201614 learned_addr learned my addr 172.21.15.60:0/3823201614 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:29:16.135 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.132+0000 7f110959a700 1 --2- 172.21.15.60:0/3823201614 >> v2:172.21.15.135:3300/0 conn(0x7f11040b35d0 0x7f11040cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:16.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.132+0000 7f1109d9b700 1 -- 172.21.15.60:0/3823201614 >> v2:172.21.15.135:3300/0 conn(0x7f11040b35d0 msgr2=0x7f11040cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:16.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.132+0000 7f1109d9b700 1 --2- 172.21.15.60:0/3823201614 >> v2:172.21.15.135:3300/0 conn(0x7f11040b35d0 0x7f11040cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.132+0000 7f1109d9b700 1 -- 172.21.15.60:0/3823201614 >> v1:172.21.15.60:6789/0 conn(0x7f11040cc170 legacy=0x7f11040b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:16.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.132+0000 7f1109d9b700 1 -- 172.21.15.60:0/3823201614 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11040cb430 con 0x7f1104159440 2023-10-06T04:29:16.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.132+0000 7f1108d99700 1 -- 172.21.15.60:0/3823201614 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609530560 0 0) 0x7f11040cb7a0 con 0x7f11040cc170 2023-10-06T04:29:16.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.132+0000 7f1109d9b700 1 --2- 172.21.15.60:0/3823201614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1104159440 0x7f11040b3090 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f11040d0220 tx=0x7f11000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f3274887672f63 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:16.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.132+0000 7f1108d99700 1 -- 172.21.15.60:0/3823201614 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110000b6b0 con 0x7f1104159440 2023-10-06T04:29:16.137 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.132+0000 7f1108d99700 1 -- 172.21.15.60:0/3823201614 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110000b810 con 0x7f1104159440 2023-10-06T04:29:16.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.132+0000 7f1108d99700 1 -- 172.21.15.60:0/3823201614 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110000bbb0 con 0x7f1104159440 2023-10-06T04:29:16.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.133+0000 7f110ad9d700 1 -- 172.21.15.60:0/3823201614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1104159440 msgr2=0x7f11040b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:16.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.133+0000 7f110ad9d700 1 --2- 172.21.15.60:0/3823201614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1104159440 0x7f11040b3090 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f11040d0220 tx=0x7f11000091a0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.133+0000 7f110ad9d700 1 -- 172.21.15.60:0/3823201614 shutdown_connections 2023-10-06T04:29:16.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.133+0000 7f110ad9d700 1 --2- 172.21.15.60:0/3823201614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1104159440 0x7f11040b3090 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.133+0000 7f110ad9d700 1 --2- 172.21.15.60:0/3823201614 >> v2:172.21.15.135:3300/0 conn(0x7f11040b35d0 0x7f11040cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.133+0000 7f110ad9d700 1 -- 172.21.15.60:0/3823201614 >> 172.21.15.60:0/3823201614 conn(0x7f110406ece0 msgr2=0x7f110406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:16.138 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.133+0000 7f110ad9d700 1 -- 172.21.15.60:0/3823201614 shutdown_connections 2023-10-06T04:29:16.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.133+0000 7f110ad9d700 1 -- 172.21.15.60:0/3823201614 wait complete. 2023-10-06T04:29:16.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.134+0000 7f110ad9d700 1 Processor -- start 2023-10-06T04:29:16.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.135+0000 7f110ad9d700 1 -- start start 2023-10-06T04:29:16.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.135+0000 7f110ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11040b35d0 0x7f110415cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:16.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.135+0000 7f110ad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11040cc170 0x7f110415d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:16.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.135+0000 7f110ad9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1104159440 0x7f110416c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:16.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.135+0000 7f110ad9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11040c7f30 con 0x7f11040b35d0 2023-10-06T04:29:16.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.135+0000 7f110ad9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11040c8210 con 0x7f11040cc170 2023-10-06T04:29:16.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.135+0000 7f110ad9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11040c84f0 con 0x7f1104159440 2023-10-06T04:29:16.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.136+0000 7f1109d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11040b35d0 0x7f110415cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:16.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.136+0000 7f1109d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11040b35d0 0x7f110415cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46258/0 (socket says 172.21.15.60:46258) 2023-10-06T04:29:16.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.136+0000 7f1109d9b700 1 -- 172.21.15.60:0/635176682 learned_addr learned my addr 172.21.15.60:0/635176682 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:16.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.136+0000 7f1109d9b700 1 -- 172.21.15.60:0/635176682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1104159440 msgr2=0x7f110416c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:16.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.136+0000 7f1109d9b700 1 --2- 172.21.15.60:0/635176682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1104159440 0x7f110416c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.136+0000 7f1109d9b700 1 -- 172.21.15.60:0/635176682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11040cc170 msgr2=0x7f110415d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:16.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.136+0000 7f1109d9b700 1 --2- 172.21.15.60:0/635176682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11040cc170 0x7f110415d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.136+0000 7f1109d9b700 1 -- 172.21.15.60:0/635176682 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1100009420 con 0x7f11040b35d0 2023-10-06T04:29:16.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.136+0000 7f1109d9b700 1 --2- 172.21.15.60:0/635176682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11040b35d0 0x7f110415cf10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1104069150 tx=0x7f1100017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:16.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.136+0000 7f10f9ffb700 1 -- 172.21.15.60:0/635176682 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1100011420 con 0x7f11040b35d0 2023-10-06T04:29:16.142 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.137+0000 7f10f9ffb700 1 -- 172.21.15.60:0/635176682 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1100011580 con 0x7f11040b35d0 2023-10-06T04:29:16.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.137+0000 7f10f9ffb700 1 -- 172.21.15.60:0/635176682 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1100011940 con 0x7f11040b35d0 2023-10-06T04:29:16.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.137+0000 7f110ad9d700 1 -- 172.21.15.60:0/635176682 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11040c87d0 con 0x7f11040b35d0 2023-10-06T04:29:16.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.137+0000 7f110ad9d700 1 -- 172.21.15.60:0/635176682 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110416cd60 con 0x7f11040b35d0 2023-10-06T04:29:16.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.138+0000 7f110ad9d700 1 -- 172.21.15.60:0/635176682 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11040c8cf0 con 0x7f11040b35d0 2023-10-06T04:29:16.143 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.138+0000 7f10f9ffb700 1 -- 172.21.15.60:0/635176682 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1100011d30 con 0x7f11040b35d0 2023-10-06T04:29:16.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.139+0000 7f10f9ffb700 1 --2- 172.21.15.60:0/635176682 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f10e8066f30 0x7f10e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:16.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.139+0000 7f10f9ffb700 1 -- 172.21.15.60:0/635176682 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f1100085940 con 0x7f11040b35d0 2023-10-06T04:29:16.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.140+0000 7f110959a700 1 --2- 172.21.15.60:0/635176682 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f10e8066f30 0x7f10e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:16.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.140+0000 7f110959a700 1 --2- 172.21.15.60:0/635176682 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f10e8066f30 0x7f10e80693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1104148410 tx=0x7f10f4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:16.146 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.144+0000 7f10f9ffb700 1 -- 172.21.15.60:0/635176682 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11040c8cf0 con 0x7f11040b35d0 2023-10-06T04:29:16.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.348+0000 7f110ad9d700 1 -- 172.21.15.60:0/635176682 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f110405f230 con 0x7f11040b35d0 2023-10-06T04:29:16.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.349+0000 7f10f9ffb700 1 -- 172.21.15.60:0/635176682 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+13855 (secure 0 0 0) 0x7f1100015020 con 0x7f11040b35d0 2023-10-06T04:29:16.351 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:16.351 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":36,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:29:12.348515+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:29:16.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.351+0000 7f110ad9d700 1 -- 172.21.15.60:0/635176682 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f10e8066f30 msgr2=0x7f10e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:16.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.351+0000 7f110ad9d700 1 --2- 172.21.15.60:0/635176682 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f10e8066f30 0x7f10e80693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1104148410 tx=0x7f10f4008040 comp rx=0 tx=0).stop 2023-10-06T04:29:16.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.351+0000 7f110ad9d700 1 -- 172.21.15.60:0/635176682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11040b35d0 msgr2=0x7f110415cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:16.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.351+0000 7f110ad9d700 1 --2- 172.21.15.60:0/635176682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11040b35d0 0x7f110415cf10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1104069150 tx=0x7f1100017000 comp rx=0 tx=0).stop 2023-10-06T04:29:16.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.351+0000 7f110ad9d700 1 -- 172.21.15.60:0/635176682 shutdown_connections 2023-10-06T04:29:16.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.351+0000 7f110ad9d700 1 --2- 172.21.15.60:0/635176682 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f10e8066f30 0x7f10e80693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.351+0000 7f110ad9d700 1 --2- 172.21.15.60:0/635176682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11040b35d0 0x7f110415cf10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.351+0000 7f110ad9d700 1 --2- 172.21.15.60:0/635176682 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1104159440 0x7f110416c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.351+0000 7f110ad9d700 1 --2- 172.21.15.60:0/635176682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11040cc170 0x7f110415d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.351+0000 7f110ad9d700 1 -- 172.21.15.60:0/635176682 >> 172.21.15.60:0/635176682 conn(0x7f110406ece0 msgr2=0x7f11041573f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:16.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.351+0000 7f110ad9d700 1 -- 172.21.15.60:0/635176682 shutdown_connections 2023-10-06T04:29:16.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.351+0000 7f110ad9d700 1 -- 172.21.15.60:0/635176682 wait complete. 2023-10-06T04:29:16.371 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:27:58.899938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:27:59.373527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T04:29:16.372 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:29:16.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.559+0000 7f5e4c99d700 1 Processor -- start 2023-10-06T04:29:16.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.559+0000 7f5e4c99d700 1 -- start start 2023-10-06T04:29:16.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.560+0000 7f5e4c99d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5e4815c700 0x7f5e480c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:16.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.560+0000 7f5e4c99d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5e4815d670 0x7f5e480c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:16.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.560+0000 7f5e4c99d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e480c72c0 con 0x7f5e4815cad0 2023-10-06T04:29:16.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.560+0000 7f5e4c99d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e480ca310 con 0x7f5e4815d670 2023-10-06T04:29:16.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.560+0000 7f5e4c99d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e480cab70 con 0x7f5e4815c700 2023-10-06T04:29:16.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.561+0000 7f5e46ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5e4815cad0 0x7f5e4815cf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53626/0 (socket says 172.21.15.60:53626) 2023-10-06T04:29:16.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.561+0000 7f5e46ffd700 1 -- 172.21.15.60:0/376394496 learned_addr learned my addr 172.21.15.60:0/376394496 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:29:16.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.561+0000 7f5e47fff700 1 --2- 172.21.15.60:0/376394496 >> v2:172.21.15.60:3300/0 conn(0x7f5e4815d670 0x7f5e480c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:16.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.561+0000 7f5e477fe700 1 --2- 172.21.15.60:0/376394496 >> v2:172.21.15.135:3300/0 conn(0x7f5e4815c700 0x7f5e480c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:16.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.561+0000 7f5e467fc700 1 -- 172.21.15.60:0/376394496 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611804508 0 0) 0x7f5e480c72c0 con 0x7f5e4815cad0 2023-10-06T04:29:16.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.561+0000 7f5e467fc700 1 -- 172.21.15.60:0/376394496 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e30003570 con 0x7f5e4815cad0 2023-10-06T04:29:16.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.561+0000 7f5e47fff700 1 -- 172.21.15.60:0/376394496 >> v2:172.21.15.135:3300/0 conn(0x7f5e4815c700 msgr2=0x7f5e480c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:16.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.561+0000 7f5e47fff700 1 --2- 172.21.15.60:0/376394496 >> v2:172.21.15.135:3300/0 conn(0x7f5e4815c700 0x7f5e480c6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.561+0000 7f5e47fff700 1 -- 172.21.15.60:0/376394496 >> v1:172.21.15.60:6789/0 conn(0x7f5e4815cad0 legacy=0x7f5e4815cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.561+0000 7f5e47fff700 1 -- 172.21.15.60:0/376394496 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e480cc390 con 0x7f5e4815d670 2023-10-06T04:29:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.561+0000 7f5e477fe700 1 --2- 172.21.15.60:0/376394496 >> v2:172.21.15.135:3300/0 conn(0x7f5e4815c700 0x7f5e480c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.562+0000 7f5e47fff700 1 --2- 172.21.15.60:0/376394496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e4815d670 0x7f5e480c24f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5e4806ce10 tx=0x7f5e40009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c43a7f92a855465 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.562+0000 7f5e467fc700 1 -- 172.21.15.60:0/376394496 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4000e070 con 0x7f5e4815d670 2023-10-06T04:29:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.562+0000 7f5e467fc700 1 -- 172.21.15.60:0/376394496 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4000bb60 con 0x7f5e4815d670 2023-10-06T04:29:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.562+0000 7f5e467fc700 1 -- 172.21.15.60:0/376394496 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40012430 con 0x7f5e4815d670 2023-10-06T04:29:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.562+0000 7f5e4c99d700 1 -- 172.21.15.60:0/376394496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e4815d670 msgr2=0x7f5e480c24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.562+0000 7f5e4c99d700 1 --2- 172.21.15.60:0/376394496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e4815d670 0x7f5e480c24f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5e4806ce10 tx=0x7f5e40009780 comp rx=0 tx=0).stop 2023-10-06T04:29:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.562+0000 7f5e4c99d700 1 -- 172.21.15.60:0/376394496 shutdown_connections 2023-10-06T04:29:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.562+0000 7f5e4c99d700 1 --2- 172.21.15.60:0/376394496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e4815d670 0x7f5e480c24f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.562+0000 7f5e4c99d700 1 --2- 172.21.15.60:0/376394496 >> v2:172.21.15.135:3300/0 conn(0x7f5e4815c700 0x7f5e480c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.562+0000 7f5e4c99d700 1 -- 172.21.15.60:0/376394496 >> 172.21.15.60:0/376394496 conn(0x7f5e480c91b0 msgr2=0x7f5e480c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:16.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.563+0000 7f5e4c99d700 1 -- 172.21.15.60:0/376394496 shutdown_connections 2023-10-06T04:29:16.567 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.563+0000 7f5e4c99d700 1 -- 172.21.15.60:0/376394496 wait complete. 2023-10-06T04:29:16.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.564+0000 7f5e4c99d700 1 Processor -- start 2023-10-06T04:29:16.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.564+0000 7f5e4c99d700 1 -- start start 2023-10-06T04:29:16.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.565+0000 7f5e4c99d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e4815c700 0x7f5e481515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:16.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.565+0000 7f5e4c99d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e4815cad0 0x7f5e481561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:16.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.565+0000 7f5e4c99d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e4815d670 0x7f5e48156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:16.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.565+0000 7f5e4c99d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e480b08e0 con 0x7f5e4815cad0 2023-10-06T04:29:16.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.565+0000 7f5e4c99d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e48156c50 con 0x7f5e4815c700 2023-10-06T04:29:16.569 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.565+0000 7f5e4c99d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e48156ea0 con 0x7f5e4815d670 2023-10-06T04:29:16.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.565+0000 7f5e46ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e4815cad0 0x7f5e481561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:16.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.565+0000 7f5e46ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e4815cad0 0x7f5e481561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46268/0 (socket says 172.21.15.60:46268) 2023-10-06T04:29:16.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.565+0000 7f5e477fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e4815c700 0x7f5e481515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:16.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.565+0000 7f5e46ffd700 1 -- 172.21.15.60:0/456907365 learned_addr learned my addr 172.21.15.60:0/456907365 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:16.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.565+0000 7f5e47fff700 1 --2- 172.21.15.60:0/456907365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e4815d670 0x7f5e48156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:16.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.566+0000 7f5e46ffd700 1 -- 172.21.15.60:0/456907365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e4815d670 msgr2=0x7f5e48156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:16.570 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.566+0000 7f5e46ffd700 1 --2- 172.21.15.60:0/456907365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e4815d670 0x7f5e48156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.566+0000 7f5e46ffd700 1 -- 172.21.15.60:0/456907365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e4815c700 msgr2=0x7f5e481515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:16.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.566+0000 7f5e46ffd700 1 --2- 172.21.15.60:0/456907365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e4815c700 0x7f5e481515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.566+0000 7f5e46ffd700 1 -- 172.21.15.60:0/456907365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e40009a20 con 0x7f5e4815cad0 2023-10-06T04:29:16.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.566+0000 7f5e46ffd700 1 --2- 172.21.15.60:0/456907365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e4815cad0 0x7f5e481561d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c00c5c0 tx=0x7f5e3c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:16.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.566+0000 7f5e2f7fe700 1 -- 172.21.15.60:0/456907365 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c005b30 con 0x7f5e4815cad0 2023-10-06T04:29:16.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.566+0000 7f5e2f7fe700 1 -- 172.21.15.60:0/456907365 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c005cb0 con 0x7f5e4815cad0 2023-10-06T04:29:16.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.566+0000 7f5e2f7fe700 1 -- 172.21.15.60:0/456907365 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c007320 con 0x7f5e4815cad0 2023-10-06T04:29:16.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.566+0000 7f5e4c99d700 1 -- 172.21.15.60:0/456907365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e48157180 con 0x7f5e4815cad0 2023-10-06T04:29:16.571 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.566+0000 7f5e4c99d700 1 -- 172.21.15.60:0/456907365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e480b0570 con 0x7f5e4815cad0 2023-10-06T04:29:16.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.567+0000 7f5e4c99d700 1 -- 172.21.15.60:0/456907365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e480b0a90 con 0x7f5e4815cad0 2023-10-06T04:29:16.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.568+0000 7f5e2f7fe700 1 -- 172.21.15.60:0/456907365 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5e3c01b3b0 con 0x7f5e4815cad0 2023-10-06T04:29:16.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.569+0000 7f5e2f7fe700 1 --2- 172.21.15.60:0/456907365 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5e34066f30 0x7f5e340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:16.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.569+0000 7f5e2f7fe700 1 -- 172.21.15.60:0/456907365 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f5e3c083950 con 0x7f5e4815cad0 2023-10-06T04:29:16.572 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.570+0000 7f5e477fe700 1 --2- 172.21.15.60:0/456907365 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5e34066f30 0x7f5e340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:16.573 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.570+0000 7f5e477fe700 1 --2- 172.21.15.60:0/456907365 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5e34066f30 0x7f5e340693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5e38006f00 tx=0x7f5e38008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:16.576 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.574+0000 7f5e2f7fe700 1 -- 172.21.15.60:0/456907365 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e480b0a90 con 0x7f5e4815cad0 2023-10-06T04:29:16.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.775+0000 7f5e4c99d700 1 -- 172.21.15.60:0/456907365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5e480b0a90 con 0x7f5e4815cad0 2023-10-06T04:29:16.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.776+0000 7f5e2f7fe700 1 -- 172.21.15.60:0/456907365 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5e480b0a90 con 0x7f5e4815cad0 2023-10-06T04:29:16.778 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-10-06T04:29:16.780 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.778+0000 7f5e4c99d700 1 -- 172.21.15.60:0/456907365 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5e34066f30 msgr2=0x7f5e340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:16.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.778+0000 7f5e4c99d700 1 --2- 172.21.15.60:0/456907365 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5e34066f30 0x7f5e340693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5e38006f00 tx=0x7f5e38008040 comp rx=0 tx=0).stop 2023-10-06T04:29:16.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.778+0000 7f5e4c99d700 1 -- 172.21.15.60:0/456907365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e4815cad0 msgr2=0x7f5e481561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:16.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.778+0000 7f5e4c99d700 1 --2- 172.21.15.60:0/456907365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e4815cad0 0x7f5e481561d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c00c5c0 tx=0x7f5e3c007e00 comp rx=0 tx=0).stop 2023-10-06T04:29:16.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.778+0000 7f5e4c99d700 1 -- 172.21.15.60:0/456907365 shutdown_connections 2023-10-06T04:29:16.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.778+0000 7f5e4c99d700 1 --2- 172.21.15.60:0/456907365 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5e34066f30 0x7f5e340693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.778+0000 7f5e4c99d700 1 --2- 172.21.15.60:0/456907365 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5e4815d670 0x7f5e48156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.778+0000 7f5e4c99d700 1 --2- 172.21.15.60:0/456907365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e4815c700 0x7f5e481515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.778+0000 7f5e4c99d700 1 --2- 172.21.15.60:0/456907365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e4815cad0 0x7f5e481561d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.778+0000 7f5e4c99d700 1 -- 172.21.15.60:0/456907365 >> 172.21.15.60:0/456907365 conn(0x7f5e480c91b0 msgr2=0x7f5e48068310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:16.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.778+0000 7f5e4c99d700 1 -- 172.21.15.60:0/456907365 shutdown_connections 2023-10-06T04:29:16.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.778+0000 7f5e4c99d700 1 -- 172.21.15.60:0/456907365 wait complete. 2023-10-06T04:29:16.798 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:29:16.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.985+0000 7f7f6199d700 1 Processor -- start 2023-10-06T04:29:16.988 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.985+0000 7f7f6199d700 1 -- start start 2023-10-06T04:29:16.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.987+0000 7f7f6199d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7f5c15c700 0x7f7f5c0c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:16.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.987+0000 7f7f6199d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f5c15cad0 0x7f7f5c15cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:16.990 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.987+0000 7f7f6199d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7f5c15db10 0x7f7f5c15d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:16.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.987+0000 7f7f6199d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f5c0ca310 con 0x7f7f5c15db10 2023-10-06T04:29:16.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.987+0000 7f7f6199d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f5c0c72c0 con 0x7f7f5c15c700 2023-10-06T04:29:16.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.987+0000 7f7f6199d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0cab70 con 0x7f7f5c15cad0 2023-10-06T04:29:16.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.987+0000 7f7f6119c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7f5c15db10 0x7f7f5c15d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:16.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.987+0000 7f7f6119c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7f5c15db10 0x7f7f5c15d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46284/0 (socket says 172.21.15.60:46284) 2023-10-06T04:29:16.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.987+0000 7f7f6119c700 1 -- 172.21.15.60:0/478347168 learned_addr learned my addr 172.21.15.60:0/478347168 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:16.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.987+0000 7f7f5bfff700 1 --2- 172.21.15.60:0/478347168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f5c15cad0 0x7f7f5c15cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:16.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.987+0000 7f7f6099b700 1 --2- 172.21.15.60:0/478347168 >> v2:172.21.15.135:3300/0 conn(0x7f7f5c15c700 0x7f7f5c0c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:16.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.988+0000 7f7f6119c700 1 -- 172.21.15.60:0/478347168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f5c15cad0 msgr2=0x7f7f5c15cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:16.991 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.988+0000 7f7f6119c700 1 --2- 172.21.15.60:0/478347168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f5c15cad0 0x7f7f5c15cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.988+0000 7f7f6119c700 1 -- 172.21.15.60:0/478347168 >> v2:172.21.15.135:3300/0 conn(0x7f7f5c15c700 msgr2=0x7f7f5c0c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:16.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.988+0000 7f7f6119c700 1 --2- 172.21.15.60:0/478347168 >> v2:172.21.15.135:3300/0 conn(0x7f7f5c15c700 0x7f7f5c0c6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.988+0000 7f7f6119c700 1 -- 172.21.15.60:0/478347168 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c0cc390 con 0x7f7f5c15db10 2023-10-06T04:29:16.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.988+0000 7f7f6119c700 1 --2- 172.21.15.60:0/478347168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f5c15db10 0x7f7f5c15d4a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c06ce10 tx=0x7f7f54009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2aab2f9def01caa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:16.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.988+0000 7f7f5b7fe700 1 -- 172.21.15.60:0/478347168 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5400e070 con 0x7f7f5c15db10 2023-10-06T04:29:16.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.988+0000 7f7f5b7fe700 1 -- 172.21.15.60:0/478347168 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5400ba50 con 0x7f7f5c15db10 2023-10-06T04:29:16.992 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.988+0000 7f7f5b7fe700 1 -- 172.21.15.60:0/478347168 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f540092e0 con 0x7f7f5c15db10 2023-10-06T04:29:16.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.989+0000 7f7f6199d700 1 -- 172.21.15.60:0/478347168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f5c15db10 msgr2=0x7f7f5c15d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:16.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.989+0000 7f7f6199d700 1 --2- 172.21.15.60:0/478347168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f5c15db10 0x7f7f5c15d4a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c06ce10 tx=0x7f7f54009840 comp rx=0 tx=0).stop 2023-10-06T04:29:16.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.989+0000 7f7f6199d700 1 -- 172.21.15.60:0/478347168 shutdown_connections 2023-10-06T04:29:16.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.989+0000 7f7f6199d700 1 --2- 172.21.15.60:0/478347168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f5c15db10 0x7f7f5c15d4a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.995 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.989+0000 7f7f6199d700 1 --2- 172.21.15.60:0/478347168 >> v2:172.21.15.135:3300/0 conn(0x7f7f5c15c700 0x7f7f5c0c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.989+0000 7f7f6199d700 1 --2- 172.21.15.60:0/478347168 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f5c15cad0 0x7f7f5c15cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.989+0000 7f7f6199d700 1 -- 172.21.15.60:0/478347168 >> 172.21.15.60:0/478347168 conn(0x7f7f5c0c91b0 msgr2=0x7f7f5c0c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:16.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.989+0000 7f7f6199d700 1 -- 172.21.15.60:0/478347168 shutdown_connections 2023-10-06T04:29:16.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.989+0000 7f7f6199d700 1 -- 172.21.15.60:0/478347168 wait complete. 2023-10-06T04:29:16.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.990+0000 7f7f6199d700 1 Processor -- start 2023-10-06T04:29:16.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.990+0000 7f7f6199d700 1 -- start start 2023-10-06T04:29:16.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.991+0000 7f7f6199d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f5c15c700 0x7f7f5c151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:16.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.991+0000 7f7f6199d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f5c15cad0 0x7f7f5c0c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:16.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.991+0000 7f7f6199d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c15db10 0x7f7f5c0aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:16.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.991+0000 7f7f6199d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0c4e50 con 0x7f7f5c15c700 2023-10-06T04:29:16.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.991+0000 7f7f6199d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0c4240 con 0x7f7f5c15db10 2023-10-06T04:29:16.996 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.991+0000 7f7f6199d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0c4520 con 0x7f7f5c15cad0 2023-10-06T04:29:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.992+0000 7f7f6099b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f5c15c700 0x7f7f5c151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.992+0000 7f7f6099b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f5c15c700 0x7f7f5c151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46290/0 (socket says 172.21.15.60:46290) 2023-10-06T04:29:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.992+0000 7f7f6099b700 1 -- 172.21.15.60:0/2571125896 learned_addr learned my addr 172.21.15.60:0/2571125896 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.992+0000 7f7f6119c700 1 --2- 172.21.15.60:0/2571125896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c15db10 0x7f7f5c0aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.992+0000 7f7f5bfff700 1 --2- 172.21.15.60:0/2571125896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f5c15cad0 0x7f7f5c0c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.992+0000 7f7f6099b700 1 -- 172.21.15.60:0/2571125896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f5c15cad0 msgr2=0x7f7f5c0c37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.992+0000 7f7f6099b700 1 --2- 172.21.15.60:0/2571125896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f5c15cad0 0x7f7f5c0c37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.992+0000 7f7f6099b700 1 -- 172.21.15.60:0/2571125896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c15db10 msgr2=0x7f7f5c0aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.992+0000 7f7f6099b700 1 --2- 172.21.15.60:0/2571125896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c15db10 0x7f7f5c0aa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.992+0000 7f7f6099b700 1 -- 172.21.15.60:0/2571125896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f54009ae0 con 0x7f7f5c15c700 2023-10-06T04:29:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.992+0000 7f7f6099b700 1 --2- 172.21.15.60:0/2571125896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f5c15c700 0x7f7f5c151450 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000d860 tx=0x7f7f50008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:16.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.992+0000 7f7f58ff9700 1 -- 172.21.15.60:0/2571125896 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f500096a0 con 0x7f7f5c15c700 2023-10-06T04:29:16.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.992+0000 7f7f58ff9700 1 -- 172.21.15.60:0/2571125896 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f50009800 con 0x7f7f5c15c700 2023-10-06T04:29:16.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.992+0000 7f7f6199d700 1 -- 172.21.15.60:0/2571125896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5c0c4800 con 0x7f7f5c15c700 2023-10-06T04:29:16.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.993+0000 7f7f58ff9700 1 -- 172.21.15.60:0/2571125896 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f50009bc0 con 0x7f7f5c15c700 2023-10-06T04:29:16.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.993+0000 7f7f6199d700 1 -- 172.21.15.60:0/2571125896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5c0ab3b0 con 0x7f7f5c15c700 2023-10-06T04:29:16.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.994+0000 7f7f6199d700 1 -- 172.21.15.60:0/2571125896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5c05f230 con 0x7f7f5c15c700 2023-10-06T04:29:16.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.994+0000 7f7f58ff9700 1 -- 172.21.15.60:0/2571125896 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f5001e460 con 0x7f7f5c15c700 2023-10-06T04:29:16.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.995+0000 7f7f58ff9700 1 --2- 172.21.15.60:0/2571125896 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7f40066f30 0x7f7f400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:16.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.995+0000 7f7f58ff9700 1 -- 172.21.15.60:0/2571125896 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f7f50084bd0 con 0x7f7f5c15c700 2023-10-06T04:29:16.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.996+0000 7f7f5bfff700 1 --2- 172.21.15.60:0/2571125896 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7f40066f30 0x7f7f400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:16.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.996+0000 7f7f5bfff700 1 --2- 172.21.15.60:0/2571125896 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7f40066f30 0x7f7f400693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0aa590 tx=0x7f7f48008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:17.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:16.999+0000 7f7f58ff9700 1 -- 172.21.15.60:0/2571125896 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f50051e50 con 0x7f7f5c15c700 2023-10-06T04:29:17.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.203+0000 7f7f6199d700 1 -- 172.21.15.60:0/2571125896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7f5c0ca520 con 0x7f7f5c15c700 2023-10-06T04:29:17.205 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.203+0000 7f7f58ff9700 1 -- 172.21.15.60:0/2571125896 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7f50055470 con 0x7f7f5c15c700 2023-10-06T04:29:17.206 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-06T04:29:17.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.205+0000 7f7f6199d700 1 -- 172.21.15.60:0/2571125896 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7f40066f30 msgr2=0x7f7f400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:17.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.205+0000 7f7f6199d700 1 --2- 172.21.15.60:0/2571125896 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7f40066f30 0x7f7f400693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0aa590 tx=0x7f7f48008040 comp rx=0 tx=0).stop 2023-10-06T04:29:17.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.205+0000 7f7f6199d700 1 -- 172.21.15.60:0/2571125896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f5c15c700 msgr2=0x7f7f5c151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:17.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.205+0000 7f7f6199d700 1 --2- 172.21.15.60:0/2571125896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f5c15c700 0x7f7f5c151450 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000d860 tx=0x7f7f50008040 comp rx=0 tx=0).stop 2023-10-06T04:29:17.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.206+0000 7f7f6199d700 1 -- 172.21.15.60:0/2571125896 shutdown_connections 2023-10-06T04:29:17.208 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.206+0000 7f7f6199d700 1 --2- 172.21.15.60:0/2571125896 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f7f40066f30 0x7f7f400693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.206+0000 7f7f6199d700 1 --2- 172.21.15.60:0/2571125896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f5c15c700 0x7f7f5c151450 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.206+0000 7f7f6199d700 1 --2- 172.21.15.60:0/2571125896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c15db10 0x7f7f5c0aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.206+0000 7f7f6199d700 1 --2- 172.21.15.60:0/2571125896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7f5c15cad0 0x7f7f5c0c37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.206+0000 7f7f6199d700 1 -- 172.21.15.60:0/2571125896 >> 172.21.15.60:0/2571125896 conn(0x7f7f5c0c91b0 msgr2=0x7f7f5c0c17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:17.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.206+0000 7f7f6199d700 1 -- 172.21.15.60:0/2571125896 shutdown_connections 2023-10-06T04:29:17.209 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.206+0000 7f7f6199d700 1 -- 172.21.15.60:0/2571125896 wait complete. 2023-10-06T04:29:17.226 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T04:29:17.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.411+0000 7f5be8d9d700 1 Processor -- start 2023-10-06T04:29:17.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.411+0000 7f5be8d9d700 1 -- start start 2023-10-06T04:29:17.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.412+0000 7f5be8d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5be40cbc30 0x7f5be40cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:17.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.412+0000 7f5be8d9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be40cb7a0 con 0x7f5be40b2100 2023-10-06T04:29:17.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.412+0000 7f5be8d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be40b0860 con 0x7f5be4159440 2023-10-06T04:29:17.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.412+0000 7f5be8d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be40cb150 con 0x7f5be40cbc30 2023-10-06T04:29:17.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.412+0000 7f5be3fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5be40b2100 0x7f5be40b2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53640/0 (socket says 172.21.15.60:53640) 2023-10-06T04:29:17.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.412+0000 7f5be3fff700 1 -- 172.21.15.60:0/534159491 learned_addr learned my addr 172.21.15.60:0/534159491 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:29:17.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.412+0000 7f5be2ffd700 1 --2- 172.21.15.60:0/534159491 >> v2:172.21.15.135:3300/0 conn(0x7f5be40cbc30 0x7f5be40cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:17.417 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.413+0000 7f5be27fc700 1 -- 172.21.15.60:0/534159491 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187768850 0 0) 0x7f5be40cb7a0 con 0x7f5be40b2100 2023-10-06T04:29:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.413+0000 7f5be27fc700 1 -- 172.21.15.60:0/534159491 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bcc003570 con 0x7f5be40b2100 2023-10-06T04:29:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.413+0000 7f5be27fc700 1 -- 172.21.15.60:0/534159491 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4092583356 0 0) 0x7f5bcc003570 con 0x7f5be40b2100 2023-10-06T04:29:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.413+0000 7f5be27fc700 1 -- 172.21.15.60:0/534159491 >> v2:172.21.15.135:3300/0 conn(0x7f5be40cbc30 msgr2=0x7f5be40cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.413+0000 7f5be27fc700 1 --2- 172.21.15.60:0/534159491 >> v2:172.21.15.135:3300/0 conn(0x7f5be40cbc30 0x7f5be40cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.413+0000 7f5be27fc700 1 -- 172.21.15.60:0/534159491 >> v1:172.21.15.135:6789/0 conn(0x7f5be4159440 legacy=0x7f5be40b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.413+0000 7f5be27fc700 1 -- 172.21.15.60:0/534159491 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be40cb430 con 0x7f5be40b2100 2023-10-06T04:29:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.413+0000 7f5be27fc700 1 -- 172.21.15.60:0/534159491 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7f5bdc0017f0 con 0x7f5be40b2100 2023-10-06T04:29:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.413+0000 7f5be2ffd700 1 --2- 172.21.15.60:0/534159491 >> v2:172.21.15.135:3300/0 conn(0x7f5be40cbc30 0x7f5be40cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:29:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.413+0000 7f5be27fc700 1 -- 172.21.15.60:0/534159491 >> v1:172.21.15.60:6789/0 conn(0x7f5be40b2100 legacy=0x7f5be40b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.413+0000 7f5be27fc700 1 --2- 172.21.15.60:0/534159491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5bcc003ab0 0x7f5bcc003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.413+0000 7f5be27fc700 1 --2- 172.21.15.60:0/534159491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bcc004810 0x7f5bcc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.413+0000 7f5be27fc700 1 --2- 172.21.15.60:0/534159491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bcc005210 0x7f5bcc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.413+0000 7f5be27fc700 1 -- 172.21.15.60:0/534159491 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40cb150 con 0x7f5bcc004810 2023-10-06T04:29:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.413+0000 7f5be27fc700 1 -- 172.21.15.60:0/534159491 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc00c130 con 0x7f5bcc005210 2023-10-06T04:29:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.413+0000 7f5be27fc700 1 -- 172.21.15.60:0/534159491 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc00c2f0 con 0x7f5bcc003ab0 2023-10-06T04:29:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.414+0000 7f5be37fe700 1 --2- 172.21.15.60:0/534159491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5bcc003ab0 0x7f5bcc003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.414+0000 7f5be3fff700 1 --2- 172.21.15.60:0/534159491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bcc005210 0x7f5bcc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.414+0000 7f5be2ffd700 1 --2- 172.21.15.60:0/534159491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bcc004810 0x7f5bcc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.414+0000 7f5be2ffd700 1 -- 172.21.15.60:0/534159491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5bcc003ab0 msgr2=0x7f5bcc003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.414+0000 7f5be2ffd700 1 --2- 172.21.15.60:0/534159491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5bcc003ab0 0x7f5bcc003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.414+0000 7f5be2ffd700 1 -- 172.21.15.60:0/534159491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bcc005210 msgr2=0x7f5bcc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.414+0000 7f5be2ffd700 1 --2- 172.21.15.60:0/534159491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bcc005210 0x7f5bcc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.414+0000 7f5be3fff700 1 -- 172.21.15.60:0/534159491 reap_dead start 2023-10-06T04:29:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.414+0000 7f5be2ffd700 1 -- 172.21.15.60:0/534159491 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc003570 con 0x7f5bcc004810 2023-10-06T04:29:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.414+0000 7f5be2ffd700 1 --2- 172.21.15.60:0/534159491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bcc004810 0x7f5bcc004c80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009df0 tx=0x7f5bd80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317dc94bac5e8863 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.415+0000 7f5be27fc700 1 -- 172.21.15.60:0/534159491 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8009740 con 0x7f5bcc004810 2023-10-06T04:29:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.415+0000 7f5be27fc700 1 -- 172.21.15.60:0/534159491 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd800e920 con 0x7f5bcc004810 2023-10-06T04:29:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.415+0000 7f5be27fc700 1 -- 172.21.15.60:0/534159491 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800ece0 con 0x7f5bcc004810 2023-10-06T04:29:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.415+0000 7f5be8d9d700 1 -- 172.21.15.60:0/534159491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bcc004810 msgr2=0x7f5bcc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.415+0000 7f5be8d9d700 1 --2- 172.21.15.60:0/534159491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bcc004810 0x7f5bcc004c80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009df0 tx=0x7f5bd80091a0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.415+0000 7f5be8d9d700 1 -- 172.21.15.60:0/534159491 shutdown_connections 2023-10-06T04:29:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.415+0000 7f5be8d9d700 1 --2- 172.21.15.60:0/534159491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bcc004810 0x7f5bcc004c80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.415+0000 7f5be8d9d700 1 -- 172.21.15.60:0/534159491 >> 172.21.15.60:0/534159491 conn(0x7f5be406ece0 msgr2=0x7f5be406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.415+0000 7f5be8d9d700 1 -- 172.21.15.60:0/534159491 shutdown_connections 2023-10-06T04:29:17.421 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.415+0000 7f5be8d9d700 1 -- 172.21.15.60:0/534159491 wait complete. 2023-10-06T04:29:17.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.417+0000 7f5be8d9d700 1 Processor -- start 2023-10-06T04:29:17.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.417+0000 7f5be8d9d700 1 -- start start 2023-10-06T04:29:17.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.418+0000 7f5be8d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5bcc004810 0x7f5be41558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:17.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.418+0000 7f5be8d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5be40c5e00 0x7f5be40c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:17.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.418+0000 7f5be8d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5be4159a90 0x7f5be4159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:17.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.418+0000 7f5be8d9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be415a440 con 0x7f5be4159a90 2023-10-06T04:29:17.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.418+0000 7f5be8d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40c4c60 con 0x7f5be40c5e00 2023-10-06T04:29:17.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.418+0000 7f5be8d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40c4f40 con 0x7f5bcc004810 2023-10-06T04:29:17.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.418+0000 7f5be3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5be4159a90 0x7f5be4159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:17.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.418+0000 7f5be3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5be4159a90 0x7f5be4159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46304/0 (socket says 172.21.15.60:46304) 2023-10-06T04:29:17.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.418+0000 7f5be3fff700 1 -- 172.21.15.60:0/3269679878 learned_addr learned my addr 172.21.15.60:0/3269679878 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:17.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.418+0000 7f5be37fe700 1 --2- 172.21.15.60:0/3269679878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5bcc004810 0x7f5be41558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:17.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.418+0000 7f5be3fff700 1 -- 172.21.15.60:0/3269679878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5bcc004810 msgr2=0x7f5be41558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:17.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.418+0000 7f5be3fff700 1 --2- 172.21.15.60:0/3269679878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5bcc004810 0x7f5be41558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.418+0000 7f5be3fff700 1 -- 172.21.15.60:0/3269679878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5be40c5e00 msgr2=0x7f5be40c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:17.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.418+0000 7f5be2ffd700 1 --2- 172.21.15.60:0/3269679878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5be40c5e00 0x7f5be40c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:17.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.418+0000 7f5be3fff700 1 --2- 172.21.15.60:0/3269679878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5be40c5e00 0x7f5be40c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.418+0000 7f5be3fff700 1 -- 172.21.15.60:0/3269679878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be40c5220 con 0x7f5be4159a90 2023-10-06T04:29:17.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.418+0000 7f5be37fe700 1 --2- 172.21.15.60:0/3269679878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5bcc004810 0x7f5be41558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:17.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.418+0000 7f5be2ffd700 1 --2- 172.21.15.60:0/3269679878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5be40c5e00 0x7f5be40c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:17.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.419+0000 7f5be3fff700 1 --2- 172.21.15.60:0/3269679878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5be4159a90 0x7f5be4159f00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5be40b63a0 tx=0x7f5bdc002100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:17.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.419+0000 7f5bcb7fe700 1 -- 172.21.15.60:0/3269679878 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00ac30 con 0x7f5be4159a90 2023-10-06T04:29:17.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.419+0000 7f5bcb7fe700 1 -- 172.21.15.60:0/3269679878 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc00ad90 con 0x7f5be4159a90 2023-10-06T04:29:17.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.419+0000 7f5bcb7fe700 1 -- 172.21.15.60:0/3269679878 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc013600 con 0x7f5be4159a90 2023-10-06T04:29:17.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.419+0000 7f5be8d9d700 1 -- 172.21.15.60:0/3269679878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be40c5500 con 0x7f5be4159a90 2023-10-06T04:29:17.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.419+0000 7f5be8d9d700 1 -- 172.21.15.60:0/3269679878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be40c7e90 con 0x7f5be4159a90 2023-10-06T04:29:17.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.420+0000 7f5be8d9d700 1 -- 172.21.15.60:0/3269679878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be40c8140 con 0x7f5be4159a90 2023-10-06T04:29:17.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.421+0000 7f5bcb7fe700 1 -- 172.21.15.60:0/3269679878 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5bdc013970 con 0x7f5be4159a90 2023-10-06T04:29:17.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.422+0000 7f5bcb7fe700 1 --2- 172.21.15.60:0/3269679878 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5bd0066f30 0x7f5bd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:17.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.422+0000 7f5bcb7fe700 1 -- 172.21.15.60:0/3269679878 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f5bdc084c60 con 0x7f5be4159a90 2023-10-06T04:29:17.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.422+0000 7f5be37fe700 1 --2- 172.21.15.60:0/3269679878 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5bd0066f30 0x7f5bd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:17.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.423+0000 7f5be37fe700 1 --2- 172.21.15.60:0/3269679878 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5bd0066f30 0x7f5bd00693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4000c00 tx=0x7f5bd4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:17.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.426+0000 7f5bcb7fe700 1 -- 172.21.15.60:0/3269679878 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5be40c8140 con 0x7f5be4159a90 2023-10-06T04:29:17.633 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.631+0000 7f5be8d9d700 1 -- 172.21.15.60:0/3269679878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5be405f230 con 0x7f5be4159a90 2023-10-06T04:29:17.634 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.631+0000 7f5bcb7fe700 1 -- 172.21.15.60:0/3269679878 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5bdc051ee0 con 0x7f5be4159a90 2023-10-06T04:29:17.634 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:17.634 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2023-10-06T04:29:17.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:17.634 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2023-10-06T04:29:17.634 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "rbd" 2023-10-06T04:29:17.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2023-10-06T04:29:17.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2023-10-06T04:29:17.635 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 2, 2023-10-06T04:29:17.635 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2023-10-06T04:29:17.635 INFO:teuthology.orchestra.run.smithi060.stdout: } 2023-10-06T04:29:17.635 INFO:teuthology.orchestra.run.smithi060.stdout:] 2023-10-06T04:29:17.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.633+0000 7f5be8d9d700 1 -- 172.21.15.60:0/3269679878 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5bd0066f30 msgr2=0x7f5bd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:17.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.633+0000 7f5be8d9d700 1 --2- 172.21.15.60:0/3269679878 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5bd0066f30 0x7f5bd00693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4000c00 tx=0x7f5bd4009040 comp rx=0 tx=0).stop 2023-10-06T04:29:17.636 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.634+0000 7f5be8d9d700 1 -- 172.21.15.60:0/3269679878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5be4159a90 msgr2=0x7f5be4159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:17.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.634+0000 7f5be8d9d700 1 --2- 172.21.15.60:0/3269679878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5be4159a90 0x7f5be4159f00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5be40b63a0 tx=0x7f5bdc002100 comp rx=0 tx=0).stop 2023-10-06T04:29:17.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.634+0000 7f5be8d9d700 1 -- 172.21.15.60:0/3269679878 shutdown_connections 2023-10-06T04:29:17.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.634+0000 7f5be8d9d700 1 --2- 172.21.15.60:0/3269679878 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5bd0066f30 0x7f5bd00693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.634+0000 7f5be8d9d700 1 --2- 172.21.15.60:0/3269679878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5be4159a90 0x7f5be4159f00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.634+0000 7f5be8d9d700 1 --2- 172.21.15.60:0/3269679878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5bcc004810 0x7f5be41558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.634+0000 7f5be8d9d700 1 --2- 172.21.15.60:0/3269679878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5be40c5e00 0x7f5be40c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.634+0000 7f5be8d9d700 1 -- 172.21.15.60:0/3269679878 >> 172.21.15.60:0/3269679878 conn(0x7f5be406ece0 msgr2=0x7f5be40b54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:17.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.634+0000 7f5be8d9d700 1 -- 172.21.15.60:0/3269679878 shutdown_connections 2023-10-06T04:29:17.637 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.634+0000 7f5be8d9d700 1 -- 172.21.15.60:0/3269679878 wait complete. 2023-10-06T04:29:17.653 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T04:29:17.654 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T04:29:17.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.842+0000 7f057f59e700 1 Processor -- start 2023-10-06T04:29:17.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.842+0000 7f057f59e700 1 -- start start 2023-10-06T04:29:17.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.844+0000 7f057f59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f058006e900 0x7f05800c1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:17.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.844+0000 7f057f59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058006ee40 con 0x7f05801596a0 2023-10-06T04:29:17.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.844+0000 7f057f59e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058006f120 con 0x7f05801592d0 2023-10-06T04:29:17.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.844+0000 7f057f59e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058006a3c0 con 0x7f058006e900 2023-10-06T04:29:17.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.844+0000 7f057dd9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f05801596a0 0x7f058006e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53656/0 (socket says 172.21.15.60:53656) 2023-10-06T04:29:17.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.844+0000 7f057dd9b700 1 -- 172.21.15.60:0/1170383089 learned_addr learned my addr 172.21.15.60:0/1170383089 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:29:17.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.844+0000 7f057ed9d700 1 --2- 172.21.15.60:0/1170383089 >> v2:172.21.15.135:3300/0 conn(0x7f058006e900 0x7f05800c1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:17.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.844+0000 7f057d59a700 1 -- 172.21.15.60:0/1170383089 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394917386 0 0) 0x7f058006ee40 con 0x7f05801596a0 2023-10-06T04:29:17.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.844+0000 7f057d59a700 1 -- 172.21.15.60:0/1170383089 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0568003570 con 0x7f05801596a0 2023-10-06T04:29:17.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.845+0000 7f057d59a700 1 -- 172.21.15.60:0/1170383089 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 845810400 0 0) 0x7f0568003570 con 0x7f05801596a0 2023-10-06T04:29:17.849 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.845+0000 7f057d59a700 1 -- 172.21.15.60:0/1170383089 >> v2:172.21.15.135:3300/0 conn(0x7f058006e900 msgr2=0x7f05800c1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:17.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.845+0000 7f057d59a700 1 --2- 172.21.15.60:0/1170383089 >> v2:172.21.15.135:3300/0 conn(0x7f058006e900 0x7f05800c1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.845+0000 7f057d59a700 1 -- 172.21.15.60:0/1170383089 >> v1:172.21.15.135:6789/0 conn(0x7f05801592d0 legacy=0x7f05800a98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:17.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.845+0000 7f057d59a700 1 -- 172.21.15.60:0/1170383089 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058006a6a0 con 0x7f05801596a0 2023-10-06T04:29:17.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.845+0000 7f057d59a700 1 -- 172.21.15.60:0/1170383089 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7f0574001470 con 0x7f05801596a0 2023-10-06T04:29:17.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.845+0000 7f057ed9d700 1 --2- 172.21.15.60:0/1170383089 >> v2:172.21.15.135:3300/0 conn(0x7f058006e900 0x7f05800c1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:29:17.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.845+0000 7f057d59a700 1 -- 172.21.15.60:0/1170383089 >> v1:172.21.15.60:6789/0 conn(0x7f05801596a0 legacy=0x7f058006e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:17.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.845+0000 7f057d59a700 1 --2- 172.21.15.60:0/1170383089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0568003a60 0x7f0568003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:17.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.845+0000 7f057d59a700 1 --2- 172.21.15.60:0/1170383089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0568004810 0x7f0568004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:17.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.845+0000 7f057d59a700 1 --2- 172.21.15.60:0/1170383089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05680051c0 0x7f056800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:17.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.845+0000 7f057d59a700 1 -- 172.21.15.60:0/1170383089 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058006a3c0 con 0x7f05680051c0 2023-10-06T04:29:17.850 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.845+0000 7f057d59a700 1 -- 172.21.15.60:0/1170383089 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056800c0b0 con 0x7f0568003a60 2023-10-06T04:29:17.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.845+0000 7f057d59a700 1 -- 172.21.15.60:0/1170383089 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056800c270 con 0x7f0568004810 2023-10-06T04:29:17.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.845+0000 7f057ed9d700 1 --2- 172.21.15.60:0/1170383089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05680051c0 0x7f056800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:17.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.845+0000 7f057e59c700 1 --2- 172.21.15.60:0/1170383089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0568003a60 0x7f0568003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:17.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.845+0000 7f057dd9b700 1 --2- 172.21.15.60:0/1170383089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0568004810 0x7f0568004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:17.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.846+0000 7f057ed9d700 1 -- 172.21.15.60:0/1170383089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0568004810 msgr2=0x7f0568004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:17.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.846+0000 7f057ed9d700 1 --2- 172.21.15.60:0/1170383089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0568004810 0x7f0568004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.846+0000 7f057ed9d700 1 -- 172.21.15.60:0/1170383089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0568003a60 msgr2=0x7f0568003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:17.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.846+0000 7f057ed9d700 1 --2- 172.21.15.60:0/1170383089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0568003a60 0x7f0568003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.846+0000 7f057ed9d700 1 -- 172.21.15.60:0/1170383089 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0568003570 con 0x7f05680051c0 2023-10-06T04:29:17.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.846+0000 7f057ed9d700 1 -- 172.21.15.60:0/1170383089 reap_dead start 2023-10-06T04:29:17.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.846+0000 7f057ed9d700 1 --2- 172.21.15.60:0/1170383089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05680051c0 0x7f056800ba60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f057800e3c0 tx=0x7f057800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ff04e233376370 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:17.851 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.846+0000 7f057d59a700 1 -- 172.21.15.60:0/1170383089 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0578009c50 con 0x7f05680051c0 2023-10-06T04:29:17.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.846+0000 7f057d59a700 1 -- 172.21.15.60:0/1170383089 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057800f040 con 0x7f05680051c0 2023-10-06T04:29:17.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.846+0000 7f057d59a700 1 -- 172.21.15.60:0/1170383089 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057800eec0 con 0x7f05680051c0 2023-10-06T04:29:17.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.847+0000 7f057f59e700 1 -- 172.21.15.60:0/1170383089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05680051c0 msgr2=0x7f056800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:17.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.847+0000 7f057f59e700 1 --2- 172.21.15.60:0/1170383089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05680051c0 0x7f056800ba60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f057800e3c0 tx=0x7f057800b040 comp rx=0 tx=0).stop 2023-10-06T04:29:17.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.847+0000 7f057f59e700 1 -- 172.21.15.60:0/1170383089 shutdown_connections 2023-10-06T04:29:17.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.847+0000 7f057f59e700 1 --2- 172.21.15.60:0/1170383089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05680051c0 0x7f056800ba60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.847+0000 7f057f59e700 1 -- 172.21.15.60:0/1170383089 >> 172.21.15.60:0/1170383089 conn(0x7f0580069160 msgr2=0x7f05800ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:17.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.847+0000 7f057f59e700 1 -- 172.21.15.60:0/1170383089 shutdown_connections 2023-10-06T04:29:17.852 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.847+0000 7f057f59e700 1 -- 172.21.15.60:0/1170383089 wait complete. 2023-10-06T04:29:17.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.848+0000 7f057f59e700 1 Processor -- start 2023-10-06T04:29:17.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.848+0000 7f057f59e700 1 -- start start 2023-10-06T04:29:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.849+0000 7f057f59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05680051c0 0x7f05800cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.849+0000 7f057f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05800c5490 0x7f05800c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.849+0000 7f057f59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0580154980 0x7f0580154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.849+0000 7f057f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05800c6af0 con 0x7f05800c5490 2023-10-06T04:29:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.849+0000 7f057f59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0580155310 con 0x7f05680051c0 2023-10-06T04:29:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.849+0000 7f057f59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05800c5ee0 con 0x7f0580154980 2023-10-06T04:29:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.849+0000 7f057dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05800c5490 0x7f05800c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.849+0000 7f057dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05800c5490 0x7f05800c5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46328/0 (socket says 172.21.15.60:46328) 2023-10-06T04:29:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.849+0000 7f057dd9b700 1 -- 172.21.15.60:0/1120624228 learned_addr learned my addr 172.21.15.60:0/1120624228 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.849+0000 7f057e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05680051c0 0x7f05800cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.850+0000 7f057ed9d700 1 --2- 172.21.15.60:0/1120624228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0580154980 0x7f0580154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.850+0000 7f057dd9b700 1 -- 172.21.15.60:0/1120624228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0580154980 msgr2=0x7f0580154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.850+0000 7f057dd9b700 1 --2- 172.21.15.60:0/1120624228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0580154980 0x7f0580154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.850+0000 7f057dd9b700 1 -- 172.21.15.60:0/1120624228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05680051c0 msgr2=0x7f05800cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.850+0000 7f057dd9b700 1 --2- 172.21.15.60:0/1120624228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05680051c0 0x7f05800cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.850+0000 7f057dd9b700 1 -- 172.21.15.60:0/1120624228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05800c61c0 con 0x7f05800c5490 2023-10-06T04:29:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.850+0000 7f057dd9b700 1 --2- 172.21.15.60:0/1120624228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05800c5490 0x7f05800c5900 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f057400e760 tx=0x7f0574000d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.850+0000 7f056e7fc700 1 -- 172.21.15.60:0/1120624228 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0574010490 con 0x7f05800c5490 2023-10-06T04:29:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.850+0000 7f056e7fc700 1 -- 172.21.15.60:0/1120624228 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0574010040 con 0x7f05800c5490 2023-10-06T04:29:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.850+0000 7f056e7fc700 1 -- 172.21.15.60:0/1120624228 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0574010860 con 0x7f05800c5490 2023-10-06T04:29:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.850+0000 7f057f59e700 1 -- 172.21.15.60:0/1120624228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05800c64a0 con 0x7f05800c5490 2023-10-06T04:29:17.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.851+0000 7f057f59e700 1 -- 172.21.15.60:0/1120624228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05800b0700 con 0x7f05800c5490 2023-10-06T04:29:17.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.851+0000 7f057f59e700 1 -- 172.21.15.60:0/1120624228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05800c6c60 con 0x7f05800c5490 2023-10-06T04:29:17.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.853+0000 7f056e7fc700 1 -- 172.21.15.60:0/1120624228 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0574010bd0 con 0x7f05800c5490 2023-10-06T04:29:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.854+0000 7f056e7fc700 1 --2- 172.21.15.60:0/1120624228 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0560066f30 0x7f05600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.854+0000 7f056e7fc700 1 -- 172.21.15.60:0/1120624228 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f0574083850 con 0x7f05800c5490 2023-10-06T04:29:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.854+0000 7f057e59c700 1 --2- 172.21.15.60:0/1120624228 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0560066f30 0x7f05600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.855+0000 7f057e59c700 1 --2- 172.21.15.60:0/1120624228 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0560066f30 0x7f05600693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0570003c80 tx=0x7f0570007d10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:17.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:17.858+0000 7f056e7fc700 1 -- 172.21.15.60:0/1120624228 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0574050ad0 con 0x7f05800c5490 2023-10-06T04:29:18.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:18.062+0000 7f057f59e700 1 -- 172.21.15.60:0/1120624228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f058005f230 con 0x7f05800c5490 2023-10-06T04:29:18.925 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:18.923+0000 7f056e7fc700 1 -- 172.21.15.60:0/1120624228 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0574019020 con 0x7f05800c5490 2023-10-06T04:29:18.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:18.928+0000 7f057f59e700 1 -- 172.21.15.60:0/1120624228 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0560066f30 msgr2=0x7f05600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:18.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:18.928+0000 7f057f59e700 1 --2- 172.21.15.60:0/1120624228 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0560066f30 0x7f05600693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0570003c80 tx=0x7f0570007d10 comp rx=0 tx=0).stop 2023-10-06T04:29:18.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:18.928+0000 7f057f59e700 1 -- 172.21.15.60:0/1120624228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05800c5490 msgr2=0x7f05800c5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:18.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:18.929+0000 7f057f59e700 1 --2- 172.21.15.60:0/1120624228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05800c5490 0x7f05800c5900 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f057400e760 tx=0x7f0574000d70 comp rx=0 tx=0).stop 2023-10-06T04:29:18.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:18.929+0000 7f057f59e700 1 -- 172.21.15.60:0/1120624228 shutdown_connections 2023-10-06T04:29:18.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:18.929+0000 7f057f59e700 1 --2- 172.21.15.60:0/1120624228 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0560066f30 0x7f05600693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:18.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:18.929+0000 7f057f59e700 1 --2- 172.21.15.60:0/1120624228 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0580154980 0x7f0580154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:18.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:18.929+0000 7f057f59e700 1 --2- 172.21.15.60:0/1120624228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05680051c0 0x7f05800cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:18.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:18.929+0000 7f057f59e700 1 --2- 172.21.15.60:0/1120624228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05800c5490 0x7f05800c5900 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:18.933 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:18.929+0000 7f057f59e700 1 -- 172.21.15.60:0/1120624228 >> 172.21.15.60:0/1120624228 conn(0x7f0580069160 msgr2=0x7f05800c9970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:18.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:18.933+0000 7f057f59e700 1 -- 172.21.15.60:0/1120624228 shutdown_connections 2023-10-06T04:29:18.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:18.934+0000 7f057f59e700 1 -- 172.21.15.60:0/1120624228 wait complete. 2023-10-06T04:29:18.937 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2023-10-06T04:29:18.955 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T04:29:19.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.148+0000 7eff0f59e700 1 Processor -- start 2023-10-06T04:29:19.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.148+0000 7eff0f59e700 1 -- start start 2023-10-06T04:29:19.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.150+0000 7eff0f59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7eff100cb060 0x7eff10159b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:19.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.150+0000 7eff0f59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1015a080 0x7eff100c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:19.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.150+0000 7eff0f59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff100ca5b0 con 0x7eff1013c430 2023-10-06T04:29:19.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.150+0000 7eff0f59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1015a8e0 con 0x7eff100cb060 2023-10-06T04:29:19.152 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.150+0000 7eff0f59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1006d500 con 0x7eff1015a080 2023-10-06T04:29:19.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.150+0000 7eff0e59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7eff1013c430 0x7eff100ca950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53670/0 (socket says 172.21.15.60:53670) 2023-10-06T04:29:19.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.150+0000 7eff0e59c700 1 -- 172.21.15.60:0/2194557056 learned_addr learned my addr 172.21.15.60:0/2194557056 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:29:19.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.150+0000 7eff0dd9b700 1 --2- 172.21.15.60:0/2194557056 >> v2:172.21.15.60:3300/0 conn(0x7eff100cb060 0x7eff10159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:19.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.150+0000 7eff0ed9d700 1 --2- 172.21.15.60:0/2194557056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1015a080 0x7eff100c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:19.154 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.150+0000 7eff0d59a700 1 -- 172.21.15.60:0/2194557056 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607977004 0 0) 0x7eff100ca5b0 con 0x7eff1013c430 2023-10-06T04:29:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.150+0000 7eff0d59a700 1 -- 172.21.15.60:0/2194557056 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efef8003570 con 0x7eff1013c430 2023-10-06T04:29:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.150+0000 7eff0dd9b700 1 -- 172.21.15.60:0/2194557056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1015a080 msgr2=0x7eff100c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.150+0000 7eff0dd9b700 1 --2- 172.21.15.60:0/2194557056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1015a080 0x7eff100c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.150+0000 7eff0dd9b700 1 -- 172.21.15.60:0/2194557056 >> v1:172.21.15.60:6789/0 conn(0x7eff1013c430 legacy=0x7eff100ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.151+0000 7eff0dd9b700 1 -- 172.21.15.60:0/2194557056 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1013c800 con 0x7eff100cb060 2023-10-06T04:29:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.151+0000 7eff0dd9b700 1 --2- 172.21.15.60:0/2194557056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100cb060 0x7eff10159b40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7eff040098e0 tx=0x7eff040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a959c4c5e3a6ee23 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.151+0000 7eff0d59a700 1 -- 172.21.15.60:0/2194557056 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04011630 con 0x7eff100cb060 2023-10-06T04:29:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.151+0000 7eff0d59a700 1 -- 172.21.15.60:0/2194557056 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff04011790 con 0x7eff100cb060 2023-10-06T04:29:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.151+0000 7eff0d59a700 1 -- 172.21.15.60:0/2194557056 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04011b10 con 0x7eff100cb060 2023-10-06T04:29:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.152+0000 7eff0f59e700 1 -- 172.21.15.60:0/2194557056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100cb060 msgr2=0x7eff10159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.152+0000 7eff0f59e700 1 --2- 172.21.15.60:0/2194557056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100cb060 0x7eff10159b40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7eff040098e0 tx=0x7eff040091a0 comp rx=0 tx=0).stop 2023-10-06T04:29:19.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.152+0000 7eff0f59e700 1 -- 172.21.15.60:0/2194557056 shutdown_connections 2023-10-06T04:29:19.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.152+0000 7eff0f59e700 1 --2- 172.21.15.60:0/2194557056 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1015a080 0x7eff100c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:19.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.152+0000 7eff0f59e700 1 --2- 172.21.15.60:0/2194557056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100cb060 0x7eff10159b40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:19.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.152+0000 7eff0f59e700 1 -- 172.21.15.60:0/2194557056 >> 172.21.15.60:0/2194557056 conn(0x7eff1006b330 msgr2=0x7eff1006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:19.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.152+0000 7eff0f59e700 1 -- 172.21.15.60:0/2194557056 shutdown_connections 2023-10-06T04:29:19.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.152+0000 7eff0f59e700 1 -- 172.21.15.60:0/2194557056 wait complete. 2023-10-06T04:29:19.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.153+0000 7eff0f59e700 1 Processor -- start 2023-10-06T04:29:19.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.153+0000 7eff0f59e700 1 -- start start 2023-10-06T04:29:19.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.154+0000 7eff0f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100cb060 0x7eff10154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:19.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.154+0000 7eff0f59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1013c430 0x7eff1013dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:19.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.154+0000 7eff0f59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff1015a080 0x7eff1013e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:19.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.154+0000 7eff0f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1015e280 con 0x7eff100cb060 2023-10-06T04:29:19.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.154+0000 7eff0f59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1015d950 con 0x7eff1015a080 2023-10-06T04:29:19.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.154+0000 7eff0f59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1015dc30 con 0x7eff1013c430 2023-10-06T04:29:19.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.154+0000 7eff0e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100cb060 0x7eff10154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:19.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.155+0000 7eff0e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100cb060 0x7eff10154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46332/0 (socket says 172.21.15.60:46332) 2023-10-06T04:29:19.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.155+0000 7eff0e59c700 1 -- 172.21.15.60:0/1757093360 learned_addr learned my addr 172.21.15.60:0/1757093360 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:19.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.155+0000 7eff0dd9b700 1 --2- 172.21.15.60:0/1757093360 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1013c430 0x7eff1013dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:19.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.155+0000 7eff0ed9d700 1 --2- 172.21.15.60:0/1757093360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff1015a080 0x7eff1013e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:19.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.155+0000 7eff0e59c700 1 -- 172.21.15.60:0/1757093360 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1013c430 msgr2=0x7eff1013dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:19.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.155+0000 7eff0e59c700 1 --2- 172.21.15.60:0/1757093360 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1013c430 0x7eff1013dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.155+0000 7eff0e59c700 1 -- 172.21.15.60:0/1757093360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff1015a080 msgr2=0x7eff1013e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.155+0000 7eff0e59c700 1 --2- 172.21.15.60:0/1757093360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff1015a080 0x7eff1013e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.155+0000 7eff0e59c700 1 -- 172.21.15.60:0/1757093360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff04009420 con 0x7eff100cb060 2023-10-06T04:29:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.155+0000 7eff0e59c700 1 --2- 172.21.15.60:0/1757093360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100cb060 0x7eff10154c30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7eff0000c7c0 tx=0x7eff00007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.155+0000 7efefe7fc700 1 -- 172.21.15.60:0/1757093360 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00005cd0 con 0x7eff100cb060 2023-10-06T04:29:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.156+0000 7efefe7fc700 1 -- 172.21.15.60:0/1757093360 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff00005e30 con 0x7eff100cb060 2023-10-06T04:29:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.156+0000 7eff0f59e700 1 -- 172.21.15.60:0/1757093360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1015df10 con 0x7eff100cb060 2023-10-06T04:29:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.156+0000 7efefe7fc700 1 -- 172.21.15.60:0/1757093360 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00007320 con 0x7eff100cb060 2023-10-06T04:29:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.156+0000 7eff0f59e700 1 -- 172.21.15.60:0/1757093360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1015e710 con 0x7eff100cb060 2023-10-06T04:29:19.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.157+0000 7eff0f59e700 1 -- 172.21.15.60:0/1757093360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1015a4a0 con 0x7eff100cb060 2023-10-06T04:29:19.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.158+0000 7efefe7fc700 1 -- 172.21.15.60:0/1757093360 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff0001b3b0 con 0x7eff100cb060 2023-10-06T04:29:19.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.159+0000 7efefe7fc700 1 --2- 172.21.15.60:0/1757093360 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7efef0066f30 0x7efef00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:19.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.159+0000 7efefe7fc700 1 -- 172.21.15.60:0/1757093360 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5896+0+0 (secure 0 0 0) 0x7eff00084130 con 0x7eff100cb060 2023-10-06T04:29:19.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.159+0000 7eff0dd9b700 1 --2- 172.21.15.60:0/1757093360 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7efef0066f30 0x7efef00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:19.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.160+0000 7eff0dd9b700 1 --2- 172.21.15.60:0/1757093360 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7efef0066f30 0x7efef00693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7eff100cb460 tx=0x7eff04017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:19.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.162+0000 7efefe7fc700 1 -- 172.21.15.60:0/1757093360 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff000512c0 con 0x7eff100cb060 2023-10-06T04:29:19.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.365+0000 7eff0f59e700 1 -- 172.21.15.60:0/1757093360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7eff100ca360 con 0x7eff100cb060 2023-10-06T04:29:19.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.932+0000 7efefe7fc700 1 -- 172.21.15.60:0/1757093360 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) v1 ==== 170+0+0 (secure 0 0 0) 0x7eff000170d0 con 0x7eff100cb060 2023-10-06T04:29:19.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.944+0000 7eff0f59e700 1 -- 172.21.15.60:0/1757093360 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7efef0066f30 msgr2=0x7efef00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:19.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.944+0000 7eff0f59e700 1 --2- 172.21.15.60:0/1757093360 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7efef0066f30 0x7efef00693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7eff100cb460 tx=0x7eff04017000 comp rx=0 tx=0).stop 2023-10-06T04:29:19.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.944+0000 7eff0f59e700 1 -- 172.21.15.60:0/1757093360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100cb060 msgr2=0x7eff10154c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:19.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.944+0000 7eff0f59e700 1 --2- 172.21.15.60:0/1757093360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100cb060 0x7eff10154c30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7eff0000c7c0 tx=0x7eff00007e00 comp rx=0 tx=0).stop 2023-10-06T04:29:19.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.944+0000 7eff0f59e700 1 -- 172.21.15.60:0/1757093360 shutdown_connections 2023-10-06T04:29:19.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.944+0000 7eff0f59e700 1 --2- 172.21.15.60:0/1757093360 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7efef0066f30 0x7efef00693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:19.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.944+0000 7eff0f59e700 1 --2- 172.21.15.60:0/1757093360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff100cb060 0x7eff10154c30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:19.947 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.944+0000 7eff0f59e700 1 --2- 172.21.15.60:0/1757093360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff1015a080 0x7eff1013e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:19.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.944+0000 7eff0f59e700 1 --2- 172.21.15.60:0/1757093360 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff1013c430 0x7eff1013dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:19.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.944+0000 7eff0f59e700 1 -- 172.21.15.60:0/1757093360 >> 172.21.15.60:0/1757093360 conn(0x7eff1006b330 msgr2=0x7eff100c3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:19.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.947+0000 7eff0f59e700 1 -- 172.21.15.60:0/1757093360 shutdown_connections 2023-10-06T04:29:19.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:19.948+0000 7eff0f59e700 1 -- 172.21.15.60:0/1757093360 wait complete. 2023-10-06T04:29:19.955 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2023-10-06T04:29:19.976 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T04:29:20.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.164+0000 7fe1a759d700 1 Processor -- start 2023-10-06T04:29:20.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.164+0000 7fe1a759d700 1 -- start start 2023-10-06T04:29:20.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.166+0000 7fe1a759d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00cb060 0x7fe1a0159b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:20.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.166+0000 7fe1a759d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe1a015a080 0x7fe1a00c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:20.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.166+0000 7fe1a759d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a00ca5b0 con 0x7fe1a013c430 2023-10-06T04:29:20.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.166+0000 7fe1a759d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a015a8e0 con 0x7fe1a015a080 2023-10-06T04:29:20.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.166+0000 7fe1a759d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a006d500 con 0x7fe1a00cb060 2023-10-06T04:29:20.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.166+0000 7fe1a659b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe1a013c430 0x7fe1a00ca950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53684/0 (socket says 172.21.15.60:53684) 2023-10-06T04:29:20.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.166+0000 7fe1a659b700 1 -- 172.21.15.60:0/366850198 learned_addr learned my addr 172.21.15.60:0/366850198 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:29:20.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.166+0000 7fe1a6d9c700 1 --2- 172.21.15.60:0/366850198 >> v2:172.21.15.60:3300/0 conn(0x7fe1a015a080 0x7fe1a00c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:20.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.166+0000 7fe1a5d9a700 1 --2- 172.21.15.60:0/366850198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00cb060 0x7fe1a0159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:20.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.166+0000 7fe1a5599700 1 -- 172.21.15.60:0/366850198 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3935642456 0 0) 0x7fe1a00ca5b0 con 0x7fe1a013c430 2023-10-06T04:29:20.169 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.166+0000 7fe1a5599700 1 -- 172.21.15.60:0/366850198 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe18c003570 con 0x7fe1a013c430 2023-10-06T04:29:20.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.166+0000 7fe1a6d9c700 1 -- 172.21.15.60:0/366850198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00cb060 msgr2=0x7fe1a0159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:20.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.166+0000 7fe1a6d9c700 1 --2- 172.21.15.60:0/366850198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00cb060 0x7fe1a0159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:20.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.166+0000 7fe1a6d9c700 1 -- 172.21.15.60:0/366850198 >> v1:172.21.15.60:6789/0 conn(0x7fe1a013c430 legacy=0x7fe1a00ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:20.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.166+0000 7fe1a6d9c700 1 -- 172.21.15.60:0/366850198 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a013c800 con 0x7fe1a015a080 2023-10-06T04:29:20.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.166+0000 7fe1a6d9c700 1 --2- 172.21.15.60:0/366850198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1a015a080 0x7fe1a00c86f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe198009e60 tx=0x7fe198009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd658bbc560a93c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:20.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.166+0000 7fe1a5599700 1 -- 172.21.15.60:0/366850198 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19800e070 con 0x7fe1a015a080 2023-10-06T04:29:20.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.166+0000 7fe1a5599700 1 -- 172.21.15.60:0/366850198 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19800bb60 con 0x7fe1a015a080 2023-10-06T04:29:20.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.166+0000 7fe1a5599700 1 -- 172.21.15.60:0/366850198 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe198012430 con 0x7fe1a015a080 2023-10-06T04:29:20.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.167+0000 7fe1a759d700 1 -- 172.21.15.60:0/366850198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1a015a080 msgr2=0x7fe1a00c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:20.170 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.167+0000 7fe1a759d700 1 --2- 172.21.15.60:0/366850198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1a015a080 0x7fe1a00c86f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe198009e60 tx=0x7fe198009780 comp rx=0 tx=0).stop 2023-10-06T04:29:20.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.167+0000 7fe1a759d700 1 -- 172.21.15.60:0/366850198 shutdown_connections 2023-10-06T04:29:20.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.167+0000 7fe1a759d700 1 --2- 172.21.15.60:0/366850198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1a015a080 0x7fe1a00c86f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:20.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.167+0000 7fe1a759d700 1 --2- 172.21.15.60:0/366850198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00cb060 0x7fe1a0159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:20.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.167+0000 7fe1a759d700 1 -- 172.21.15.60:0/366850198 >> 172.21.15.60:0/366850198 conn(0x7fe1a006b330 msgr2=0x7fe1a006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:20.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.167+0000 7fe1a759d700 1 -- 172.21.15.60:0/366850198 shutdown_connections 2023-10-06T04:29:20.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.167+0000 7fe1a759d700 1 -- 172.21.15.60:0/366850198 wait complete. 2023-10-06T04:29:20.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.168+0000 7fe1a759d700 1 Processor -- start 2023-10-06T04:29:20.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.168+0000 7fe1a759d700 1 -- start start 2023-10-06T04:29:20.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.169+0000 7fe1a759d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00cb060 0x7fe1a00b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:20.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.169+0000 7fe1a759d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1a013c430 0x7fe1a013ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:20.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.169+0000 7fe1a759d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1a015a080 0x7fe1a00c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:20.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.169+0000 7fe1a759d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a00b3550 con 0x7fe1a013c430 2023-10-06T04:29:20.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.169+0000 7fe1a759d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a00b3d60 con 0x7fe1a015a080 2023-10-06T04:29:20.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.169+0000 7fe1a759d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a00b37a0 con 0x7fe1a00cb060 2023-10-06T04:29:20.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.169+0000 7fe1a5d9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1a013c430 0x7fe1a013ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:20.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.169+0000 7fe1a5d9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1a013c430 0x7fe1a013ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46344/0 (socket says 172.21.15.60:46344) 2023-10-06T04:29:20.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.170+0000 7fe1a5d9a700 1 -- 172.21.15.60:0/599309269 learned_addr learned my addr 172.21.15.60:0/599309269 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:20.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.170+0000 7fe1a659b700 1 --2- 172.21.15.60:0/599309269 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00cb060 0x7fe1a00b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:20.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.170+0000 7fe1a6d9c700 1 --2- 172.21.15.60:0/599309269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1a015a080 0x7fe1a00c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:20.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.170+0000 7fe1a5d9a700 1 -- 172.21.15.60:0/599309269 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00cb060 msgr2=0x7fe1a00b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:20.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.170+0000 7fe1a5d9a700 1 --2- 172.21.15.60:0/599309269 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00cb060 0x7fe1a00b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:20.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.170+0000 7fe1a5d9a700 1 -- 172.21.15.60:0/599309269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1a015a080 msgr2=0x7fe1a00c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:20.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.170+0000 7fe1a5d9a700 1 --2- 172.21.15.60:0/599309269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1a015a080 0x7fe1a00c6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:20.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.170+0000 7fe1a5d9a700 1 -- 172.21.15.60:0/599309269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe198009a20 con 0x7fe1a013c430 2023-10-06T04:29:20.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.170+0000 7fe1a6d9c700 1 --2- 172.21.15.60:0/599309269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1a015a080 0x7fe1a00c6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:20.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.170+0000 7fe1a659b700 1 --2- 172.21.15.60:0/599309269 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00cb060 0x7fe1a00b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:20.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.170+0000 7fe1a5d9a700 1 --2- 172.21.15.60:0/599309269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1a013c430 0x7fe1a013ddf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe19000d890 tx=0x7fe190008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:20.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.170+0000 7fe1967fc700 1 -- 172.21.15.60:0/599309269 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19000b600 con 0x7fe1a013c430 2023-10-06T04:29:20.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.171+0000 7fe1967fc700 1 -- 172.21.15.60:0/599309269 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19000b760 con 0x7fe1a013c430 2023-10-06T04:29:20.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.171+0000 7fe1967fc700 1 -- 172.21.15.60:0/599309269 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19000bb00 con 0x7fe1a013c430 2023-10-06T04:29:20.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.171+0000 7fe1a759d700 1 -- 172.21.15.60:0/599309269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a00b3a80 con 0x7fe1a013c430 2023-10-06T04:29:20.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.171+0000 7fe1a759d700 1 -- 172.21.15.60:0/599309269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a013d8d0 con 0x7fe1a013c430 2023-10-06T04:29:20.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.172+0000 7fe1a759d700 1 -- 172.21.15.60:0/599309269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a013d460 con 0x7fe1a013c430 2023-10-06T04:29:20.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.175+0000 7fe1967fc700 1 -- 172.21.15.60:0/599309269 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe190028430 con 0x7fe1a013c430 2023-10-06T04:29:20.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.176+0000 7fe1967fc700 1 --2- 172.21.15.60:0/599309269 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe184066f30 0x7fe1840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:20.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.176+0000 7fe1967fc700 1 -- 172.21.15.60:0/599309269 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fe1900859c0 con 0x7fe1a013c430 2023-10-06T04:29:20.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.176+0000 7fe1a659b700 1 --2- 172.21.15.60:0/599309269 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe184066f30 0x7fe1840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:20.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.176+0000 7fe1a659b700 1 --2- 172.21.15.60:0/599309269 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe184066f30 0x7fe1840693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0058d0 tx=0x7fe19c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.179+0000 7fe1967fc700 1 -- 172.21.15.60:0/599309269 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1900529d0 con 0x7fe1a013c430 2023-10-06T04:29:20.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.427+0000 7fe1a759d700 1 -- 172.21.15.60:0/599309269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe1a005f230 con 0x7fe1a013c430 2023-10-06T04:29:20.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.943+0000 7fe1967fc700 1 -- 172.21.15.60:0/599309269 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe190055ff0 con 0x7fe1a013c430 2023-10-06T04:29:20.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.953+0000 7fe1a759d700 1 -- 172.21.15.60:0/599309269 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe184066f30 msgr2=0x7fe1840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:20.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.953+0000 7fe1a759d700 1 --2- 172.21.15.60:0/599309269 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe184066f30 0x7fe1840693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0058d0 tx=0x7fe19c009040 comp rx=0 tx=0).stop 2023-10-06T04:29:20.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.953+0000 7fe1a759d700 1 -- 172.21.15.60:0/599309269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1a013c430 msgr2=0x7fe1a013ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:20.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.953+0000 7fe1a759d700 1 --2- 172.21.15.60:0/599309269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1a013c430 0x7fe1a013ddf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe19000d890 tx=0x7fe190008040 comp rx=0 tx=0).stop 2023-10-06T04:29:20.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.954+0000 7fe1a759d700 1 -- 172.21.15.60:0/599309269 shutdown_connections 2023-10-06T04:29:20.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.954+0000 7fe1a759d700 1 --2- 172.21.15.60:0/599309269 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe184066f30 0x7fe1840693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:20.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.954+0000 7fe1a759d700 1 --2- 172.21.15.60:0/599309269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1a015a080 0x7fe1a00c6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:20.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.954+0000 7fe1a759d700 1 --2- 172.21.15.60:0/599309269 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1a00cb060 0x7fe1a00b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:20.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.954+0000 7fe1a759d700 1 --2- 172.21.15.60:0/599309269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1a013c430 0x7fe1a013ddf0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:20.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.954+0000 7fe1a759d700 1 -- 172.21.15.60:0/599309269 >> 172.21.15.60:0/599309269 conn(0x7fe1a006b330 msgr2=0x7fe1a00c2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:20.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.956+0000 7fe1a759d700 1 -- 172.21.15.60:0/599309269 shutdown_connections 2023-10-06T04:29:20.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:20.956+0000 7fe1a759d700 1 -- 172.21.15.60:0/599309269 wait complete. 2023-10-06T04:29:20.971 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 6 and data pool 7 2023-10-06T04:29:20.996 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:29:21.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.183+0000 7fb894d9d700 1 Processor -- start 2023-10-06T04:29:21.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.183+0000 7fb894d9d700 1 -- start start 2023-10-06T04:29:21.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.184+0000 7fb894d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb890159440 0x7fb8900b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:21.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.184+0000 7fb894d9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8900cb7a0 con 0x7fb8900b2100 2023-10-06T04:29:21.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.184+0000 7fb894d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8900b0860 con 0x7fb8900b35d0 2023-10-06T04:29:21.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.184+0000 7fb894d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8900cb150 con 0x7fb890159440 2023-10-06T04:29:21.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.185+0000 7fb88ffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb8900b2100 0x7fb8900b2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53692/0 (socket says 172.21.15.60:53692) 2023-10-06T04:29:21.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.185+0000 7fb88ffff700 1 -- 172.21.15.60:0/1923124330 learned_addr learned my addr 172.21.15.60:0/1923124330 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:29:21.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.185+0000 7fb88f7fe700 1 --2- 172.21.15.60:0/1923124330 >> v2:172.21.15.135:3300/0 conn(0x7fb890159440 0x7fb8900b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:21.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.185+0000 7fb88e7fc700 1 -- 172.21.15.60:0/1923124330 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2857550234 0 0) 0x7fb8900cb7a0 con 0x7fb8900b2100 2023-10-06T04:29:21.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.185+0000 7fb88e7fc700 1 -- 172.21.15.60:0/1923124330 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb878003570 con 0x7fb8900b2100 2023-10-06T04:29:21.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.185+0000 7fb88e7fc700 1 -- 172.21.15.60:0/1923124330 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 576074426 0 0) 0x7fb878003570 con 0x7fb8900b2100 2023-10-06T04:29:21.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.185+0000 7fb88e7fc700 1 -- 172.21.15.60:0/1923124330 >> v2:172.21.15.135:3300/0 conn(0x7fb890159440 msgr2=0x7fb8900b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:21.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.185+0000 7fb88e7fc700 1 --2- 172.21.15.60:0/1923124330 >> v2:172.21.15.135:3300/0 conn(0x7fb890159440 0x7fb8900b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:21.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.185+0000 7fb88e7fc700 1 -- 172.21.15.60:0/1923124330 >> v1:172.21.15.135:6789/0 conn(0x7fb8900b35d0 legacy=0x7fb8900cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:21.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.185+0000 7fb88e7fc700 1 -- 172.21.15.60:0/1923124330 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8900cb430 con 0x7fb8900b2100 2023-10-06T04:29:21.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.185+0000 7fb88e7fc700 1 -- 172.21.15.60:0/1923124330 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7fb8880017f0 con 0x7fb8900b2100 2023-10-06T04:29:21.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.185+0000 7fb88e7fc700 1 -- 172.21.15.60:0/1923124330 >> v1:172.21.15.60:6789/0 conn(0x7fb8900b2100 legacy=0x7fb8900b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:21.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.185+0000 7fb88e7fc700 1 --2- 172.21.15.60:0/1923124330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb878003a60 0x7fb878003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:21.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.186+0000 7fb88e7fc700 1 --2- 172.21.15.60:0/1923124330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb878004810 0x7fb878004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:21.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.186+0000 7fb88e7fc700 1 --2- 172.21.15.60:0/1923124330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8780051c0 0x7fb87800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:21.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.186+0000 7fb88e7fc700 1 -- 172.21.15.60:0/1923124330 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900cb150 con 0x7fb878004810 2023-10-06T04:29:21.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.186+0000 7fb88e7fc700 1 -- 172.21.15.60:0/1923124330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87800c160 con 0x7fb8780051c0 2023-10-06T04:29:21.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.186+0000 7fb88e7fc700 1 -- 172.21.15.60:0/1923124330 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87800c320 con 0x7fb878003a60 2023-10-06T04:29:21.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.186+0000 7fb88effd700 1 --2- 172.21.15.60:0/1923124330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb878004810 0x7fb878004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:21.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.186+0000 7fb88f7fe700 1 --2- 172.21.15.60:0/1923124330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb878003a60 0x7fb878003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:21.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.186+0000 7fb88ffff700 1 --2- 172.21.15.60:0/1923124330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8780051c0 0x7fb87800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:21.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.186+0000 7fb88effd700 1 -- 172.21.15.60:0/1923124330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb878003a60 msgr2=0x7fb878003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:21.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.186+0000 7fb88effd700 1 --2- 172.21.15.60:0/1923124330 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb878003a60 0x7fb878003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:21.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.186+0000 7fb88effd700 1 -- 172.21.15.60:0/1923124330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8780051c0 msgr2=0x7fb87800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:21.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.186+0000 7fb88effd700 1 --2- 172.21.15.60:0/1923124330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8780051c0 0x7fb87800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:21.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.186+0000 7fb88effd700 1 -- 172.21.15.60:0/1923124330 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb878003570 con 0x7fb878004810 2023-10-06T04:29:21.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.186+0000 7fb88ffff700 1 -- 172.21.15.60:0/1923124330 reap_dead start 2023-10-06T04:29:21.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.186+0000 7fb88effd700 1 --2- 172.21.15.60:0/1923124330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb878004810 0x7fb878004c80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb8840018e0 tx=0x7fb884007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db47968b04be1698 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:21.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.187+0000 7fb88e7fc700 1 -- 172.21.15.60:0/1923124330 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884012420 con 0x7fb878004810 2023-10-06T04:29:21.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.187+0000 7fb88e7fc700 1 -- 172.21.15.60:0/1923124330 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8840125a0 con 0x7fb878004810 2023-10-06T04:29:21.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.187+0000 7fb88e7fc700 1 -- 172.21.15.60:0/1923124330 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884012960 con 0x7fb878004810 2023-10-06T04:29:21.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.187+0000 7fb894d9d700 1 -- 172.21.15.60:0/1923124330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb878004810 msgr2=0x7fb878004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:21.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.187+0000 7fb894d9d700 1 --2- 172.21.15.60:0/1923124330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb878004810 0x7fb878004c80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb8840018e0 tx=0x7fb884007d30 comp rx=0 tx=0).stop 2023-10-06T04:29:21.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.187+0000 7fb894d9d700 1 -- 172.21.15.60:0/1923124330 shutdown_connections 2023-10-06T04:29:21.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.187+0000 7fb894d9d700 1 --2- 172.21.15.60:0/1923124330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb878004810 0x7fb878004c80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:21.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.187+0000 7fb894d9d700 1 -- 172.21.15.60:0/1923124330 >> 172.21.15.60:0/1923124330 conn(0x7fb89006ece0 msgr2=0x7fb89006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:21.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.187+0000 7fb894d9d700 1 -- 172.21.15.60:0/1923124330 shutdown_connections 2023-10-06T04:29:21.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.187+0000 7fb894d9d700 1 -- 172.21.15.60:0/1923124330 wait complete. 2023-10-06T04:29:21.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.189+0000 7fb894d9d700 1 Processor -- start 2023-10-06T04:29:21.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.189+0000 7fb894d9d700 1 -- start start 2023-10-06T04:29:21.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.189+0000 7fb894d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb878004810 0x7fb8900c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:21.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.189+0000 7fb894d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8900c7d90 0x7fb8900b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:21.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.189+0000 7fb894d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8900ce300 0x7fb8900ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:21.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.189+0000 7fb894d9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900c41a0 con 0x7fb878004810 2023-10-06T04:29:21.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.189+0000 7fb894d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900c4480 con 0x7fb8900c7d90 2023-10-06T04:29:21.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.189+0000 7fb894d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900c4760 con 0x7fb8900ce300 2023-10-06T04:29:21.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.189+0000 7fb88f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb878004810 0x7fb8900c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:21.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.189+0000 7fb88f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb878004810 0x7fb8900c3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46362/0 (socket says 172.21.15.60:46362) 2023-10-06T04:29:21.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.189+0000 7fb88f7fe700 1 -- 172.21.15.60:0/1410204359 learned_addr learned my addr 172.21.15.60:0/1410204359 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:21.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.189+0000 7fb88f7fe700 1 -- 172.21.15.60:0/1410204359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8900ce300 msgr2=0x7fb8900ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:21.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.189+0000 7fb88f7fe700 1 --2- 172.21.15.60:0/1410204359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8900ce300 0x7fb8900ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:21.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.189+0000 7fb88f7fe700 1 -- 172.21.15.60:0/1410204359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8900c7d90 msgr2=0x7fb8900b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:21.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.189+0000 7fb88f7fe700 1 --2- 172.21.15.60:0/1410204359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8900c7d90 0x7fb8900b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:21.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.189+0000 7fb88f7fe700 1 -- 172.21.15.60:0/1410204359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8900c4a40 con 0x7fb878004810 2023-10-06T04:29:21.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.189+0000 7fb88f7fe700 1 --2- 172.21.15.60:0/1410204359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb878004810 0x7fb8900c3bc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb880011700 tx=0x7fb880008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:21.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.191+0000 7fb8777fe700 1 -- 172.21.15.60:0/1410204359 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb880015670 con 0x7fb878004810 2023-10-06T04:29:21.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.191+0000 7fb8777fe700 1 -- 172.21.15.60:0/1410204359 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8800157d0 con 0x7fb878004810 2023-10-06T04:29:21.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.191+0000 7fb894d9d700 1 -- 172.21.15.60:0/1410204359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8900c4d20 con 0x7fb878004810 2023-10-06T04:29:21.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.191+0000 7fb8777fe700 1 -- 172.21.15.60:0/1410204359 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb880015b50 con 0x7fb878004810 2023-10-06T04:29:21.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.191+0000 7fb894d9d700 1 -- 172.21.15.60:0/1410204359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8900b5230 con 0x7fb878004810 2023-10-06T04:29:21.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.192+0000 7fb894d9d700 1 -- 172.21.15.60:0/1410204359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8900b6160 con 0x7fb878004810 2023-10-06T04:29:21.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.193+0000 7fb8777fe700 1 -- 172.21.15.60:0/1410204359 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb880013410 con 0x7fb878004810 2023-10-06T04:29:21.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.193+0000 7fb8777fe700 1 --2- 172.21.15.60:0/1410204359 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb87c066f30 0x7fb87c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:21.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.193+0000 7fb8777fe700 1 -- 172.21.15.60:0/1410204359 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb880084bb0 con 0x7fb878004810 2023-10-06T04:29:21.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.194+0000 7fb88effd700 1 --2- 172.21.15.60:0/1410204359 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb87c066f30 0x7fb87c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:21.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.194+0000 7fb88effd700 1 --2- 172.21.15.60:0/1410204359 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb87c066f30 0x7fb87c0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb8900b57c0 tx=0x7fb884015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:21.199 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.197+0000 7fb8777fe700 1 -- 172.21.15.60:0/1410204359 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb880051b90 con 0x7fb878004810 2023-10-06T04:29:21.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.404+0000 7fb894d9d700 1 -- 172.21.15.60:0/1410204359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8900b0f00 con 0x7fb878004810 2023-10-06T04:29:21.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.405+0000 7fb8777fe700 1 -- 172.21.15.60:0/1410204359 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+17084 (secure 0 0 0) 0x7fb8800551b0 con 0x7fb878004810 2023-10-06T04:29:21.407 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:21.407 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":39,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:29:20.429588+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:29:18.102794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:29:19.405806+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:29:21.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.408+0000 7fb894d9d700 1 -- 172.21.15.60:0/1410204359 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb87c066f30 msgr2=0x7fb87c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:21.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.408+0000 7fb894d9d700 1 --2- 172.21.15.60:0/1410204359 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb87c066f30 0x7fb87c0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb8900b57c0 tx=0x7fb884015000 comp rx=0 tx=0).stop 2023-10-06T04:29:21.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.408+0000 7fb894d9d700 1 -- 172.21.15.60:0/1410204359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb878004810 msgr2=0x7fb8900c3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:21.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.408+0000 7fb894d9d700 1 --2- 172.21.15.60:0/1410204359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb878004810 0x7fb8900c3bc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb880011700 tx=0x7fb880008040 comp rx=0 tx=0).stop 2023-10-06T04:29:21.409 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.408+0000 7fb894d9d700 1 -- 172.21.15.60:0/1410204359 shutdown_connections 2023-10-06T04:29:21.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.408+0000 7fb894d9d700 1 --2- 172.21.15.60:0/1410204359 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb87c066f30 0x7fb87c0693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:21.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.408+0000 7fb894d9d700 1 --2- 172.21.15.60:0/1410204359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb878004810 0x7fb8900c3bc0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:21.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.408+0000 7fb894d9d700 1 --2- 172.21.15.60:0/1410204359 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8900ce300 0x7fb8900ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:21.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.408+0000 7fb894d9d700 1 --2- 172.21.15.60:0/1410204359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8900c7d90 0x7fb8900b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:21.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.408+0000 7fb894d9d700 1 -- 172.21.15.60:0/1410204359 >> 172.21.15.60:0/1410204359 conn(0x7fb89006ece0 msgr2=0x7fb890063410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:21.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.408+0000 7fb894d9d700 1 -- 172.21.15.60:0/1410204359 shutdown_connections 2023-10-06T04:29:21.410 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.408+0000 7fb894d9d700 1 -- 172.21.15.60:0/1410204359 wait complete. 2023-10-06T04:29:21.427 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:29:21.454 INFO:tasks.ceph.mds.c.smithi060.stderr:2023-10-06T04:29:21.453+0000 7f85931f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T04:29:21.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.612+0000 7f889719d700 1 Processor -- start 2023-10-06T04:29:21.613 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.612+0000 7f889719d700 1 -- start start 2023-10-06T04:29:21.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.613+0000 7f889719d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8890159600 0x7f88900abc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:21.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.613+0000 7f889719d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f88900ac1b0 0x7f88900675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:21.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.613+0000 7f889719d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889006a4e0 con 0x7f8890159230 2023-10-06T04:29:21.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.613+0000 7f889719d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88900ac6a0 con 0x7f88900ac1b0 2023-10-06T04:29:21.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.613+0000 7f889719d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889006b9b0 con 0x7f8890159600 2023-10-06T04:29:21.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.614+0000 7f889699c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f88900ac1b0 0x7f88900675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:21.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.614+0000 7f889599a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8890159600 0x7f88900abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:21.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.614+0000 7f889699c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f88900ac1b0 0x7f88900675b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:48406/0 (socket says 172.21.15.60:48406) 2023-10-06T04:29:21.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.614+0000 7f889699c700 1 -- 172.21.15.60:0/3441268968 learned_addr learned my addr 172.21.15.60:0/3441268968 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:21.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.614+0000 7f889699c700 1 -- 172.21.15.60:0/3441268968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8890159600 msgr2=0x7f88900abc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:21.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.614+0000 7f889699c700 1 --2- 172.21.15.60:0/3441268968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8890159600 0x7f88900abc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:21.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.614+0000 7f889699c700 1 -- 172.21.15.60:0/3441268968 >> v1:172.21.15.135:6789/0 conn(0x7f8890159230 legacy=0x7f889006b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:21.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.614+0000 7f889699c700 1 -- 172.21.15.60:0/3441268968 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889006a7c0 con 0x7f88900ac1b0 2023-10-06T04:29:21.616 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.614+0000 7f889599a700 1 --2- 172.21.15.60:0/3441268968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8890159600 0x7f88900abc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:29:21.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.615+0000 7f889699c700 1 --2- 172.21.15.60:0/3441268968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88900ac1b0 0x7f88900675b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8888009f20 tx=0x7f8888009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3c52baabc5a9a8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:21.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.615+0000 7f8895199700 1 -- 172.21.15.60:0/3441268968 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888800e070 con 0x7f88900ac1b0 2023-10-06T04:29:21.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.615+0000 7f8895199700 1 -- 172.21.15.60:0/3441268968 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888800b9d0 con 0x7f88900ac1b0 2023-10-06T04:29:21.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.615+0000 7f8895199700 1 -- 172.21.15.60:0/3441268968 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88880092e0 con 0x7f88900ac1b0 2023-10-06T04:29:21.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.616+0000 7f889719d700 1 -- 172.21.15.60:0/3441268968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88900ac1b0 msgr2=0x7f88900675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:21.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.616+0000 7f889719d700 1 --2- 172.21.15.60:0/3441268968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88900ac1b0 0x7f88900675b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8888009f20 tx=0x7f8888009840 comp rx=0 tx=0).stop 2023-10-06T04:29:21.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.616+0000 7f889719d700 1 -- 172.21.15.60:0/3441268968 shutdown_connections 2023-10-06T04:29:21.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.616+0000 7f889719d700 1 --2- 172.21.15.60:0/3441268968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88900ac1b0 0x7f88900675b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:21.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.616+0000 7f889719d700 1 --2- 172.21.15.60:0/3441268968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8890159600 0x7f88900abc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:21.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.616+0000 7f889719d700 1 -- 172.21.15.60:0/3441268968 >> 172.21.15.60:0/3441268968 conn(0x7f8890069130 msgr2=0x7f88900ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:21.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.616+0000 7f889719d700 1 -- 172.21.15.60:0/3441268968 shutdown_connections 2023-10-06T04:29:21.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.616+0000 7f889719d700 1 -- 172.21.15.60:0/3441268968 wait complete. 2023-10-06T04:29:21.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.617+0000 7f889719d700 1 Processor -- start 2023-10-06T04:29:21.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.617+0000 7f889719d700 1 -- start start 2023-10-06T04:29:21.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.618+0000 7f889719d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88900ac1b0 0x7f88900a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:21.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.618+0000 7f889719d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8890159230 0x7f889014d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:21.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.618+0000 7f889719d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8890159600 0x7f8890155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:21.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.618+0000 7f889719d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88900a9de0 con 0x7f8890159230 2023-10-06T04:29:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.618+0000 7f889719d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889014da70 con 0x7f8890159600 2023-10-06T04:29:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.618+0000 7f889719d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88900ae490 con 0x7f88900ac1b0 2023-10-06T04:29:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.618+0000 7f889599a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8890159230 0x7f889014d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.619+0000 7f889599a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8890159230 0x7f889014d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46372/0 (socket says 172.21.15.60:46372) 2023-10-06T04:29:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.619+0000 7f889599a700 1 -- 172.21.15.60:0/125828631 learned_addr learned my addr 172.21.15.60:0/125828631 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.619+0000 7f889619b700 1 --2- 172.21.15.60:0/125828631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88900ac1b0 0x7f88900a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.619+0000 7f889699c700 1 --2- 172.21.15.60:0/125828631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8890159600 0x7f8890155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.619+0000 7f889599a700 1 -- 172.21.15.60:0/125828631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88900ac1b0 msgr2=0x7f88900a98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.619+0000 7f889599a700 1 --2- 172.21.15.60:0/125828631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88900ac1b0 0x7f88900a98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.619+0000 7f889599a700 1 -- 172.21.15.60:0/125828631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8890159600 msgr2=0x7f8890155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:21.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.619+0000 7f889599a700 1 --2- 172.21.15.60:0/125828631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8890159600 0x7f8890155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.619+0000 7f889599a700 1 -- 172.21.15.60:0/125828631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8880009420 con 0x7f8890159230 2023-10-06T04:29:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.619+0000 7f889699c700 1 --2- 172.21.15.60:0/125828631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8890159600 0x7f8890155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.619+0000 7f889599a700 1 --2- 172.21.15.60:0/125828631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8890159230 0x7f889014d530 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f888000ec80 tx=0x7f88800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.619+0000 7f88867fc700 1 -- 172.21.15.60:0/125828631 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888000c9d0 con 0x7f8890159230 2023-10-06T04:29:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.619+0000 7f88867fc700 1 -- 172.21.15.60:0/125828631 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888000cb30 con 0x7f8890159230 2023-10-06T04:29:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.620+0000 7f88867fc700 1 -- 172.21.15.60:0/125828631 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888000ceb0 con 0x7f8890159230 2023-10-06T04:29:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.620+0000 7f889719d700 1 -- 172.21.15.60:0/125828631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8888009ae0 con 0x7f8890159230 2023-10-06T04:29:21.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.620+0000 7f889719d700 1 -- 172.21.15.60:0/125828631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88900aea10 con 0x7f8890159230 2023-10-06T04:29:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.621+0000 7f889719d700 1 -- 172.21.15.60:0/125828631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889005f230 con 0x7f8890159230 2023-10-06T04:29:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.622+0000 7f88867fc700 1 -- 172.21.15.60:0/125828631 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8880013680 con 0x7f8890159230 2023-10-06T04:29:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.622+0000 7f88867fc700 1 --2- 172.21.15.60:0/125828631 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8874066f30 0x7f88740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.623+0000 7f88867fc700 1 -- 172.21.15.60:0/125828631 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8880084b70 con 0x7f8890159230 2023-10-06T04:29:21.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.623+0000 7f889619b700 1 --2- 172.21.15.60:0/125828631 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8874066f30 0x7f88740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:21.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.623+0000 7f889619b700 1 --2- 172.21.15.60:0/125828631 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8874066f30 0x7f88740693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f888c003860 tx=0x7f888c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.627+0000 7f88867fc700 1 -- 172.21.15.60:0/125828631 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8880051b40 con 0x7f8890159230 2023-10-06T04:29:21.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.829+0000 7f889719d700 1 -- 172.21.15.60:0/125828631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88900c9e60 con 0x7f8890159230 2023-10-06T04:29:21.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.830+0000 7f88867fc700 1 -- 172.21.15.60:0/125828631 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+17084 (secure 0 0 0) 0x7f8880055160 con 0x7f8890159230 2023-10-06T04:29:21.832 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:21.832 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":39,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:29:20.429588+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:29:18.102794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:29:19.405806+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:29:21.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.832+0000 7f889719d700 1 -- 172.21.15.60:0/125828631 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8874066f30 msgr2=0x7f88740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:21.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.832+0000 7f889719d700 1 --2- 172.21.15.60:0/125828631 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8874066f30 0x7f88740693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f888c003860 tx=0x7f888c009040 comp rx=0 tx=0).stop 2023-10-06T04:29:21.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.832+0000 7f889719d700 1 -- 172.21.15.60:0/125828631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8890159230 msgr2=0x7f889014d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:21.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.832+0000 7f889719d700 1 --2- 172.21.15.60:0/125828631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8890159230 0x7f889014d530 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f888000ec80 tx=0x7f88800091a0 comp rx=0 tx=0).stop 2023-10-06T04:29:21.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.832+0000 7f889719d700 1 -- 172.21.15.60:0/125828631 shutdown_connections 2023-10-06T04:29:21.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.832+0000 7f889719d700 1 --2- 172.21.15.60:0/125828631 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8874066f30 0x7f88740693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:21.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.832+0000 7f889719d700 1 --2- 172.21.15.60:0/125828631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8890159600 0x7f8890155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:21.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.832+0000 7f889719d700 1 --2- 172.21.15.60:0/125828631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88900ac1b0 0x7f88900a98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:21.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.832+0000 7f889719d700 1 --2- 172.21.15.60:0/125828631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8890159230 0x7f889014d530 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:21.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.832+0000 7f889719d700 1 -- 172.21.15.60:0/125828631 >> 172.21.15.60:0/125828631 conn(0x7f8890069130 msgr2=0x7f88900ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:21.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.833+0000 7f889719d700 1 -- 172.21.15.60:0/125828631 shutdown_connections 2023-10-06T04:29:21.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:21.833+0000 7f889719d700 1 -- 172.21.15.60:0/125828631 wait complete. 2023-10-06T04:29:21.851 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T04:29:22.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.081+0000 7fd42e5ff700 1 Processor -- start 2023-10-06T04:29:22.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.082+0000 7fd42e5ff700 1 -- start start 2023-10-06T04:29:22.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.083+0000 7fd42e5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4280c7ac0 0x7fd4280c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:22.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.083+0000 7fd42e5ff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd42806e340 0x7fd42815a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:22.087 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.083+0000 7fd42e5ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42806e790 con 0x7fd42813f6f0 2023-10-06T04:29:22.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.083+0000 7fd42e5ff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42815ade0 con 0x7fd42806e340 2023-10-06T04:29:22.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.083+0000 7fd42e5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42806ea20 con 0x7fd4280c7ac0 2023-10-06T04:29:22.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.083+0000 7fd4277fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd42806e340 0x7fd42815a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:22.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.083+0000 7fd4277fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd42806e340 0x7fd42815a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46378/0 (socket says 172.21.15.60:46378) 2023-10-06T04:29:22.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.083+0000 7fd4277fe700 1 -- 172.21.15.60:0/2576079232 learned_addr learned my addr 172.21.15.60:0/2576079232 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:22.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.083+0000 7fd427fff700 1 --2- 172.21.15.60:0/2576079232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4280c7ac0 0x7fd4280c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:22.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.084+0000 7fd4277fe700 1 -- 172.21.15.60:0/2576079232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4280c7ac0 msgr2=0x7fd4280c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:22.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.084+0000 7fd4277fe700 1 --2- 172.21.15.60:0/2576079232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4280c7ac0 0x7fd4280c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:22.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.084+0000 7fd4277fe700 1 -- 172.21.15.60:0/2576079232 >> v1:172.21.15.135:6789/0 conn(0x7fd42813f6f0 legacy=0x7fd4280c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:22.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.084+0000 7fd4277fe700 1 -- 172.21.15.60:0/2576079232 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42806ed00 con 0x7fd42806e340 2023-10-06T04:29:22.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.084+0000 7fd4277fe700 1 --2- 172.21.15.60:0/2576079232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42806e340 0x7fd42815a8a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0099b0 tx=0x7fd41c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8445679f4018a42e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.084+0000 7fd426ffd700 1 -- 172.21.15.60:0/2576079232 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c009ea0 con 0x7fd42806e340 2023-10-06T04:29:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.084+0000 7fd426ffd700 1 -- 172.21.15.60:0/2576079232 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c00b8f0 con 0x7fd42806e340 2023-10-06T04:29:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.084+0000 7fd426ffd700 1 -- 172.21.15.60:0/2576079232 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c00bc90 con 0x7fd42806e340 2023-10-06T04:29:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.085+0000 7fd42e5ff700 1 -- 172.21.15.60:0/2576079232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42806e340 msgr2=0x7fd42815a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.085+0000 7fd42e5ff700 1 --2- 172.21.15.60:0/2576079232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42806e340 0x7fd42815a8a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0099b0 tx=0x7fd41c009250 comp rx=0 tx=0).stop 2023-10-06T04:29:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.085+0000 7fd42e5ff700 1 -- 172.21.15.60:0/2576079232 shutdown_connections 2023-10-06T04:29:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.085+0000 7fd42e5ff700 1 --2- 172.21.15.60:0/2576079232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4280c7ac0 0x7fd4280c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.085+0000 7fd42e5ff700 1 --2- 172.21.15.60:0/2576079232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42806e340 0x7fd42815a8a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.085+0000 7fd42e5ff700 1 -- 172.21.15.60:0/2576079232 >> 172.21.15.60:0/2576079232 conn(0x7fd4280cc0a0 msgr2=0x7fd4280cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.085+0000 7fd42e5ff700 1 -- 172.21.15.60:0/2576079232 shutdown_connections 2023-10-06T04:29:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.085+0000 7fd42e5ff700 1 -- 172.21.15.60:0/2576079232 wait complete. 2023-10-06T04:29:22.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.087+0000 7fd42e5ff700 1 Processor -- start 2023-10-06T04:29:22.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.087+0000 7fd42e5ff700 1 -- start start 2023-10-06T04:29:22.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.088+0000 7fd42e5ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42806e340 0x7fd428166e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:22.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.088+0000 7fd42e5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4280c7ac0 0x7fd4280b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:22.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.088+0000 7fd42e5ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd42813f6f0 0x7fd4280c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:22.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.088+0000 7fd42e5ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4280c46b0 con 0x7fd42806e340 2023-10-06T04:29:22.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.088+0000 7fd42e5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4280c43d0 con 0x7fd4280c7ac0 2023-10-06T04:29:22.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.088+0000 7fd42e5ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4280c5dc0 con 0x7fd42813f6f0 2023-10-06T04:29:22.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.088+0000 7fd427fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42806e340 0x7fd428166e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:22.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.088+0000 7fd4277fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4280c7ac0 0x7fd4280b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:22.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.088+0000 7fd42cb9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd42813f6f0 0x7fd4280c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:22.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.088+0000 7fd427fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42806e340 0x7fd428166e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46380/0 (socket says 172.21.15.60:46380) 2023-10-06T04:29:22.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.088+0000 7fd427fff700 1 -- 172.21.15.60:0/2553789367 learned_addr learned my addr 172.21.15.60:0/2553789367 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:22.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.088+0000 7fd4277fe700 1 --2- 172.21.15.60:0/2553789367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4280c7ac0 0x7fd4280b15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:48420/0 (socket says 172.21.15.60:48420) 2023-10-06T04:29:22.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.089+0000 7fd427fff700 1 -- 172.21.15.60:0/2553789367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd42813f6f0 msgr2=0x7fd4280c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:22.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.089+0000 7fd427fff700 1 --2- 172.21.15.60:0/2553789367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd42813f6f0 0x7fd4280c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:22.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.089+0000 7fd427fff700 1 -- 172.21.15.60:0/2553789367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4280c7ac0 msgr2=0x7fd4280b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:22.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.089+0000 7fd427fff700 1 --2- 172.21.15.60:0/2553789367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4280c7ac0 0x7fd4280b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:22.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.089+0000 7fd427fff700 1 -- 172.21.15.60:0/2553789367 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c0094f0 con 0x7fd42806e340 2023-10-06T04:29:22.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.089+0000 7fd427fff700 1 --2- 172.21.15.60:0/2553789367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42806e340 0x7fd428166e70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd41800ec80 tx=0x7fd4180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:22.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.089+0000 7fd40ffff700 1 -- 172.21.15.60:0/2553789367 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41800c850 con 0x7fd42806e340 2023-10-06T04:29:22.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.089+0000 7fd40ffff700 1 -- 172.21.15.60:0/2553789367 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41800c9b0 con 0x7fd42806e340 2023-10-06T04:29:22.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.089+0000 7fd40ffff700 1 -- 172.21.15.60:0/2553789367 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41800cd50 con 0x7fd42806e340 2023-10-06T04:29:22.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.089+0000 7fd42e5ff700 1 -- 172.21.15.60:0/2553789367 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4280c60a0 con 0x7fd42806e340 2023-10-06T04:29:22.093 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.089+0000 7fd42e5ff700 1 -- 172.21.15.60:0/2553789367 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4280b1b70 con 0x7fd42806e340 2023-10-06T04:29:22.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.090+0000 7fd42e5ff700 1 -- 172.21.15.60:0/2553789367 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4280c66f0 con 0x7fd42806e340 2023-10-06T04:29:22.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.091+0000 7fd40ffff700 1 -- 172.21.15.60:0/2553789367 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd418013680 con 0x7fd42806e340 2023-10-06T04:29:22.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.093+0000 7fd40ffff700 1 --2- 172.21.15.60:0/2553789367 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd414067000 0x7fd4140694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:22.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.093+0000 7fd40ffff700 1 -- 172.21.15.60:0/2553789367 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd418084a70 con 0x7fd42806e340 2023-10-06T04:29:22.094 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.093+0000 7fd4277fe700 1 --2- 172.21.15.60:0/2553789367 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd414067000 0x7fd4140694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:22.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.094+0000 7fd4277fe700 1 --2- 172.21.15.60:0/2553789367 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd414067000 0x7fd4140694b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0099b0 tx=0x7fd41c017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:22.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.097+0000 7fd40ffff700 1 -- 172.21.15.60:0/2553789367 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd418051a20 con 0x7fd42806e340 2023-10-06T04:29:22.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.349+0000 7fd42e5ff700 1 -- 172.21.15.60:0/2553789367 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd428064a90 con 0x7fd42806e340 2023-10-06T04:29:22.962 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.961+0000 7fd40ffff700 1 -- 172.21.15.60:0/2553789367 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd418055040 con 0x7fd42806e340 2023-10-06T04:29:22.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.964+0000 7fd42e5ff700 1 -- 172.21.15.60:0/2553789367 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd414067000 msgr2=0x7fd4140694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:22.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.964+0000 7fd42e5ff700 1 --2- 172.21.15.60:0/2553789367 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd414067000 0x7fd4140694b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0099b0 tx=0x7fd41c017000 comp rx=0 tx=0).stop 2023-10-06T04:29:22.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.964+0000 7fd42e5ff700 1 -- 172.21.15.60:0/2553789367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42806e340 msgr2=0x7fd428166e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:22.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.964+0000 7fd42e5ff700 1 --2- 172.21.15.60:0/2553789367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42806e340 0x7fd428166e70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd41800ec80 tx=0x7fd4180091a0 comp rx=0 tx=0).stop 2023-10-06T04:29:22.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.964+0000 7fd42e5ff700 1 -- 172.21.15.60:0/2553789367 shutdown_connections 2023-10-06T04:29:22.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.964+0000 7fd42e5ff700 1 --2- 172.21.15.60:0/2553789367 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd414067000 0x7fd4140694b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:22.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.964+0000 7fd42e5ff700 1 --2- 172.21.15.60:0/2553789367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42806e340 0x7fd428166e70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:22.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.964+0000 7fd42e5ff700 1 --2- 172.21.15.60:0/2553789367 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd42813f6f0 0x7fd4280c3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:22.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.964+0000 7fd42e5ff700 1 --2- 172.21.15.60:0/2553789367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4280c7ac0 0x7fd4280b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:22.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.964+0000 7fd42e5ff700 1 -- 172.21.15.60:0/2553789367 >> 172.21.15.60:0/2553789367 conn(0x7fd4280cc0a0 msgr2=0x7fd42813ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:22.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.964+0000 7fd42e5ff700 1 -- 172.21.15.60:0/2553789367 shutdown_connections 2023-10-06T04:29:22.967 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:22.964+0000 7fd42e5ff700 1 -- 172.21.15.60:0/2553789367 wait complete. 2023-10-06T04:29:22.986 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T04:29:23.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.178+0000 7fb154f9d700 1 Processor -- start 2023-10-06T04:29:23.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.178+0000 7fb154f9d700 1 -- start start 2023-10-06T04:29:23.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.179+0000 7fb154f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb150154a90 0x7fb1500b1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:23.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.179+0000 7fb154f9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb15006ef10 con 0x7fb1500ae1b0 2023-10-06T04:29:23.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.179+0000 7fb154f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb15006e300 con 0x7fb150154e60 2023-10-06T04:29:23.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.179+0000 7fb154f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb15006e5e0 con 0x7fb150154a90 2023-10-06T04:29:23.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.180+0000 7fb14ffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb1500ae1b0 0x7fb1500ab790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41354/0 (socket says 172.21.15.60:41354) 2023-10-06T04:29:23.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.180+0000 7fb14ffff700 1 -- 172.21.15.60:0/1041717653 learned_addr learned my addr 172.21.15.60:0/1041717653 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:29:23.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.180+0000 7fb14f7fe700 1 --2- 172.21.15.60:0/1041717653 >> v2:172.21.15.135:3300/0 conn(0x7fb150154a90 0x7fb1500b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:23.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.180+0000 7fb14e7fc700 1 -- 172.21.15.60:0/1041717653 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107921092 0 0) 0x7fb15006ef10 con 0x7fb1500ae1b0 2023-10-06T04:29:23.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.180+0000 7fb14e7fc700 1 -- 172.21.15.60:0/1041717653 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb138003570 con 0x7fb1500ae1b0 2023-10-06T04:29:23.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.180+0000 7fb14e7fc700 1 -- 172.21.15.60:0/1041717653 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1446232409 0 0) 0x7fb138003570 con 0x7fb1500ae1b0 2023-10-06T04:29:23.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.180+0000 7fb14e7fc700 1 -- 172.21.15.60:0/1041717653 >> v2:172.21.15.135:3300/0 conn(0x7fb150154a90 msgr2=0x7fb1500b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:23.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.180+0000 7fb14e7fc700 1 --2- 172.21.15.60:0/1041717653 >> v2:172.21.15.135:3300/0 conn(0x7fb150154a90 0x7fb1500b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:23.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.180+0000 7fb14e7fc700 1 -- 172.21.15.60:0/1041717653 >> v1:172.21.15.135:6789/0 conn(0x7fb150154e60 legacy=0x7fb1500adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:23.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.180+0000 7fb14e7fc700 1 -- 172.21.15.60:0/1041717653 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15006e8c0 con 0x7fb1500ae1b0 2023-10-06T04:29:23.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.180+0000 7fb14e7fc700 1 -- 172.21.15.60:0/1041717653 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7fb1480017f0 con 0x7fb1500ae1b0 2023-10-06T04:29:23.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.180+0000 7fb14e7fc700 1 -- 172.21.15.60:0/1041717653 >> v1:172.21.15.60:6789/0 conn(0x7fb1500ae1b0 legacy=0x7fb1500ab790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:23.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.181+0000 7fb14e7fc700 1 --2- 172.21.15.60:0/1041717653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb138003ab0 0x7fb138003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:23.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.181+0000 7fb14e7fc700 1 --2- 172.21.15.60:0/1041717653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb138004810 0x7fb138004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:23.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.181+0000 7fb14e7fc700 1 --2- 172.21.15.60:0/1041717653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb138005210 0x7fb13800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:23.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.181+0000 7fb14e7fc700 1 -- 172.21.15.60:0/1041717653 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15006e5e0 con 0x7fb138005210 2023-10-06T04:29:23.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.181+0000 7fb14e7fc700 1 -- 172.21.15.60:0/1041717653 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13800c1b0 con 0x7fb138004810 2023-10-06T04:29:23.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.181+0000 7fb14e7fc700 1 -- 172.21.15.60:0/1041717653 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13800c370 con 0x7fb138003ab0 2023-10-06T04:29:23.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.181+0000 7fb14ffff700 1 --2- 172.21.15.60:0/1041717653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb138005210 0x7fb13800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:23.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.181+0000 7fb14effd700 1 --2- 172.21.15.60:0/1041717653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb138004810 0x7fb138004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:23.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.181+0000 7fb14f7fe700 1 --2- 172.21.15.60:0/1041717653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb138003ab0 0x7fb138003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:23.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.181+0000 7fb14effd700 1 -- 172.21.15.60:0/1041717653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb138003ab0 msgr2=0x7fb138003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:23.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.181+0000 7fb14effd700 1 --2- 172.21.15.60:0/1041717653 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb138003ab0 0x7fb138003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:23.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.181+0000 7fb14effd700 1 -- 172.21.15.60:0/1041717653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb138005210 msgr2=0x7fb13800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:23.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.181+0000 7fb14effd700 1 --2- 172.21.15.60:0/1041717653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb138005210 0x7fb13800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:23.186 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.181+0000 7fb14effd700 1 -- 172.21.15.60:0/1041717653 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb138003570 con 0x7fb138004810 2023-10-06T04:29:23.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.181+0000 7fb14ffff700 1 --2- 172.21.15.60:0/1041717653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb138005210 0x7fb13800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:29:23.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.181+0000 7fb14ffff700 1 -- 172.21.15.60:0/1041717653 reap_dead start 2023-10-06T04:29:23.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.182+0000 7fb14effd700 1 --2- 172.21.15.60:0/1041717653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb138004810 0x7fb138004c80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb144001880 tx=0x7fb144007d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e755ffade0d9da3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:23.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.182+0000 7fb14e7fc700 1 -- 172.21.15.60:0/1041717653 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb144012420 con 0x7fb138004810 2023-10-06T04:29:23.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.182+0000 7fb14e7fc700 1 -- 172.21.15.60:0/1041717653 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1440125a0 con 0x7fb138004810 2023-10-06T04:29:23.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.182+0000 7fb14e7fc700 1 -- 172.21.15.60:0/1041717653 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb144012960 con 0x7fb138004810 2023-10-06T04:29:23.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.182+0000 7fb154f9d700 1 -- 172.21.15.60:0/1041717653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb138004810 msgr2=0x7fb138004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:23.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.182+0000 7fb154f9d700 1 --2- 172.21.15.60:0/1041717653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb138004810 0x7fb138004c80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb144001880 tx=0x7fb144007d30 comp rx=0 tx=0).stop 2023-10-06T04:29:23.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.183+0000 7fb154f9d700 1 -- 172.21.15.60:0/1041717653 shutdown_connections 2023-10-06T04:29:23.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.183+0000 7fb154f9d700 1 --2- 172.21.15.60:0/1041717653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb138004810 0x7fb138004c80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:23.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.183+0000 7fb154f9d700 1 -- 172.21.15.60:0/1041717653 >> 172.21.15.60:0/1041717653 conn(0x7fb1500cbed0 msgr2=0x7fb1500cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:23.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.183+0000 7fb154f9d700 1 -- 172.21.15.60:0/1041717653 shutdown_connections 2023-10-06T04:29:23.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.183+0000 7fb154f9d700 1 -- 172.21.15.60:0/1041717653 wait complete. 2023-10-06T04:29:23.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.184+0000 7fb154f9d700 1 Processor -- start 2023-10-06T04:29:23.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.184+0000 7fb154f9d700 1 -- start start 2023-10-06T04:29:23.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.185+0000 7fb154f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb138004810 0x7fb15014bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:23.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.185+0000 7fb154f9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb150158160 0x7fb150159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:23.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.185+0000 7fb154f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1501585d0 0x7fb15015a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:23.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.185+0000 7fb154f9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15015b0d0 con 0x7fb150158160 2023-10-06T04:29:23.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.185+0000 7fb154f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1501501d0 con 0x7fb138004810 2023-10-06T04:29:23.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.185+0000 7fb154f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15015ab10 con 0x7fb1501585d0 2023-10-06T04:29:23.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.186+0000 7fb14effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb150158160 0x7fb150159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:23.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.186+0000 7fb14effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb150158160 0x7fb150159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42504/0 (socket says 172.21.15.60:42504) 2023-10-06T04:29:23.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.186+0000 7fb14effd700 1 -- 172.21.15.60:0/1067812603 learned_addr learned my addr 172.21.15.60:0/1067812603 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:23.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.186+0000 7fb14f7fe700 1 --2- 172.21.15.60:0/1067812603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb138004810 0x7fb15014bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:23.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.186+0000 7fb14ffff700 1 --2- 172.21.15.60:0/1067812603 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1501585d0 0x7fb15015a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:23.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.186+0000 7fb14effd700 1 -- 172.21.15.60:0/1067812603 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1501585d0 msgr2=0x7fb15015a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:23.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.186+0000 7fb14effd700 1 --2- 172.21.15.60:0/1067812603 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1501585d0 0x7fb15015a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:23.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.186+0000 7fb14effd700 1 -- 172.21.15.60:0/1067812603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb138004810 msgr2=0x7fb15014bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:23.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.186+0000 7fb14effd700 1 --2- 172.21.15.60:0/1067812603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb138004810 0x7fb15014bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:23.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.186+0000 7fb14effd700 1 -- 172.21.15.60:0/1067812603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15015adf0 con 0x7fb150158160 2023-10-06T04:29:23.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.186+0000 7fb14effd700 1 --2- 172.21.15.60:0/1067812603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb150158160 0x7fb150159cc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb13800c340 tx=0x7fb144015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:23.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.186+0000 7fb1377fe700 1 -- 172.21.15.60:0/1067812603 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb144011760 con 0x7fb150158160 2023-10-06T04:29:23.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.187+0000 7fb1377fe700 1 -- 172.21.15.60:0/1067812603 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1440118c0 con 0x7fb150158160 2023-10-06T04:29:23.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.187+0000 7fb1377fe700 1 -- 172.21.15.60:0/1067812603 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb144011c40 con 0x7fb150158160 2023-10-06T04:29:23.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.187+0000 7fb154f9d700 1 -- 172.21.15.60:0/1067812603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb15014fe60 con 0x7fb150158160 2023-10-06T04:29:23.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.187+0000 7fb154f9d700 1 -- 172.21.15.60:0/1067812603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15014c1d0 con 0x7fb150158160 2023-10-06T04:29:23.192 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.188+0000 7fb154f9d700 1 -- 172.21.15.60:0/1067812603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb150150360 con 0x7fb150158160 2023-10-06T04:29:23.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.189+0000 7fb1377fe700 1 -- 172.21.15.60:0/1067812603 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb144019030 con 0x7fb150158160 2023-10-06T04:29:23.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.189+0000 7fb1377fe700 1 --2- 172.21.15.60:0/1067812603 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb13c066f30 0x7fb13c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:23.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.189+0000 7fb1377fe700 1 -- 172.21.15.60:0/1067812603 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb144085c90 con 0x7fb150158160 2023-10-06T04:29:23.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.190+0000 7fb14f7fe700 1 --2- 172.21.15.60:0/1067812603 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb13c066f30 0x7fb13c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:23.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.190+0000 7fb14f7fe700 1 --2- 172.21.15.60:0/1067812603 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb13c066f30 0x7fb13c0693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb15014e1e0 tx=0x7fb140008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:23.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.194+0000 7fb1377fe700 1 -- 172.21.15.60:0/1067812603 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb144052bc0 con 0x7fb150158160 2023-10-06T04:29:23.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.446+0000 7fb154f9d700 1 -- 172.21.15.60:0/1067812603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb15005f230 con 0x7fb150158160 2023-10-06T04:29:23.968 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.967+0000 7fb1377fe700 1 -- 172.21.15.60:0/1067812603 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb1440220c0 con 0x7fb150158160 2023-10-06T04:29:23.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.970+0000 7fb154f9d700 1 -- 172.21.15.60:0/1067812603 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb13c066f30 msgr2=0x7fb13c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:23.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.970+0000 7fb154f9d700 1 --2- 172.21.15.60:0/1067812603 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb13c066f30 0x7fb13c0693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb15014e1e0 tx=0x7fb140008040 comp rx=0 tx=0).stop 2023-10-06T04:29:23.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.970+0000 7fb154f9d700 1 -- 172.21.15.60:0/1067812603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb150158160 msgr2=0x7fb150159cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:23.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.970+0000 7fb154f9d700 1 --2- 172.21.15.60:0/1067812603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb150158160 0x7fb150159cc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb13800c340 tx=0x7fb144015000 comp rx=0 tx=0).stop 2023-10-06T04:29:23.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.970+0000 7fb154f9d700 1 -- 172.21.15.60:0/1067812603 shutdown_connections 2023-10-06T04:29:23.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.970+0000 7fb154f9d700 1 --2- 172.21.15.60:0/1067812603 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb13c066f30 0x7fb13c0693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:23.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.970+0000 7fb154f9d700 1 --2- 172.21.15.60:0/1067812603 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1501585d0 0x7fb15015a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:23.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.970+0000 7fb154f9d700 1 --2- 172.21.15.60:0/1067812603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb138004810 0x7fb15014bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:23.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.970+0000 7fb154f9d700 1 --2- 172.21.15.60:0/1067812603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb150158160 0x7fb150159cc0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:23.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.970+0000 7fb154f9d700 1 -- 172.21.15.60:0/1067812603 >> 172.21.15.60:0/1067812603 conn(0x7fb1500cbed0 msgr2=0x7fb1500ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:23.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.970+0000 7fb154f9d700 1 -- 172.21.15.60:0/1067812603 shutdown_connections 2023-10-06T04:29:23.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:23.970+0000 7fb154f9d700 1 -- 172.21.15.60:0/1067812603 wait complete. 2023-10-06T04:29:23.992 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:29:24.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.181+0000 7f881bfff700 1 Processor -- start 2023-10-06T04:29:24.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.181+0000 7f881bfff700 1 -- start start 2023-10-06T04:29:24.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.183+0000 7f881bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f881c06f310 0x7f881c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:24.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.183+0000 7f881bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f881c159450 0x7f881c1598b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:24.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.183+0000 7f881bfff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f881c159df0 con 0x7f881c0cb5a0 2023-10-06T04:29:24.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.183+0000 7f881bfff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881c06ebc0 con 0x7f881c06f310 2023-10-06T04:29:24.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.183+0000 7f881bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881c06e040 con 0x7f881c159450 2023-10-06T04:29:24.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.183+0000 7f881affd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f881c0cb5a0 0x7f881c06d5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41368/0 (socket says 172.21.15.60:41368) 2023-10-06T04:29:24.185 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.183+0000 7f881affd700 1 -- 172.21.15.60:0/3410872198 learned_addr learned my addr 172.21.15.60:0/3410872198 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:29:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.183+0000 7f881a7fc700 1 --2- 172.21.15.60:0/3410872198 >> v2:172.21.15.135:3300/0 conn(0x7f881c06f310 0x7f881c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.183+0000 7f881b7fe700 1 --2- 172.21.15.60:0/3410872198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f881c159450 0x7f881c1598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.183+0000 7f8819ffb700 1 -- 172.21.15.60:0/3410872198 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389638302 0 0) 0x7f880c001110 con 0x7f881c0cb5a0 2023-10-06T04:29:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.184+0000 7f8819ffb700 1 -- 172.21.15.60:0/3410872198 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8804003570 con 0x7f881c0cb5a0 2023-10-06T04:29:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.184+0000 7f8819ffb700 1 -- 172.21.15.60:0/3410872198 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1399138740 0 0) 0x7f8804003570 con 0x7f881c0cb5a0 2023-10-06T04:29:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.184+0000 7f8819ffb700 1 -- 172.21.15.60:0/3410872198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f881c159450 msgr2=0x7f881c1598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.184+0000 7f8819ffb700 1 --2- 172.21.15.60:0/3410872198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f881c159450 0x7f881c1598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.184+0000 7f8819ffb700 1 -- 172.21.15.60:0/3410872198 >> v2:172.21.15.135:3300/0 conn(0x7f881c06f310 msgr2=0x7f881c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.184+0000 7f8819ffb700 1 --2- 172.21.15.60:0/3410872198 >> v2:172.21.15.135:3300/0 conn(0x7f881c06f310 0x7f881c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.184+0000 7f8819ffb700 1 -- 172.21.15.60:0/3410872198 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c06e320 con 0x7f881c0cb5a0 2023-10-06T04:29:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.184+0000 7f8819ffb700 1 -- 172.21.15.60:0/3410872198 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7f880c001600 con 0x7f881c0cb5a0 2023-10-06T04:29:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.184+0000 7f881a7fc700 1 --2- 172.21.15.60:0/3410872198 >> v2:172.21.15.135:3300/0 conn(0x7f881c06f310 0x7f881c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:29:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.184+0000 7f8819ffb700 1 -- 172.21.15.60:0/3410872198 >> v1:172.21.15.60:6789/0 conn(0x7f881c0cb5a0 legacy=0x7f881c06d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.184+0000 7f8819ffb700 1 --2- 172.21.15.60:0/3410872198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8804003a60 0x7f8804003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.184+0000 7f8819ffb700 1 --2- 172.21.15.60:0/3410872198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8804004810 0x7f8804004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.184+0000 7f8819ffb700 1 --2- 172.21.15.60:0/3410872198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f881c159450 0x7f88040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.184+0000 7f8819ffb700 1 -- 172.21.15.60:0/3410872198 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c06ebc0 con 0x7f8804003a60 2023-10-06T04:29:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.184+0000 7f8819ffb700 1 -- 172.21.15.60:0/3410872198 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c06e040 con 0x7f8804004810 2023-10-06T04:29:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.184+0000 7f8819ffb700 1 -- 172.21.15.60:0/3410872198 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880400ba60 con 0x7f881c159450 2023-10-06T04:29:24.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.184+0000 7f881affd700 1 --2- 172.21.15.60:0/3410872198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8804003a60 0x7f8804003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:24.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.184+0000 7f881a7fc700 1 --2- 172.21.15.60:0/3410872198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8804004810 0x7f8804004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:24.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.185+0000 7f881b7fe700 1 --2- 172.21.15.60:0/3410872198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f881c159450 0x7f88040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:24.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.185+0000 7f881affd700 1 -- 172.21.15.60:0/3410872198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f881c159450 msgr2=0x7f88040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:24.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.185+0000 7f881affd700 1 --2- 172.21.15.60:0/3410872198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f881c159450 0x7f88040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:24.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.185+0000 7f881affd700 1 -- 172.21.15.60:0/3410872198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8804004810 msgr2=0x7f8804004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:24.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.185+0000 7f881affd700 1 --2- 172.21.15.60:0/3410872198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8804004810 0x7f8804004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:24.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.185+0000 7f881affd700 1 -- 172.21.15.60:0/3410872198 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8804003570 con 0x7f8804003a60 2023-10-06T04:29:24.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.185+0000 7f881b7fe700 1 --2- 172.21.15.60:0/3410872198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f881c159450 0x7f88040051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:24.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.185+0000 7f881affd700 1 --2- 172.21.15.60:0/3410872198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8804003a60 0x7f8804003e70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f880c007e90 tx=0x7f880c007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22366e85be4ae97b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:24.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.185+0000 7f8819ffb700 1 -- 172.21.15.60:0/3410872198 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c00ce80 con 0x7f8804003a60 2023-10-06T04:29:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.185+0000 7f8819ffb700 1 -- 172.21.15.60:0/3410872198 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c005920 con 0x7f8804003a60 2023-10-06T04:29:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.185+0000 7f8819ffb700 1 -- 172.21.15.60:0/3410872198 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c005cc0 con 0x7f8804003a60 2023-10-06T04:29:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.186+0000 7f881bfff700 1 -- 172.21.15.60:0/3410872198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8804003a60 msgr2=0x7f8804003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.186+0000 7f881bfff700 1 --2- 172.21.15.60:0/3410872198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8804003a60 0x7f8804003e70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f880c007e90 tx=0x7f880c007a80 comp rx=0 tx=0).stop 2023-10-06T04:29:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.186+0000 7f881b7fe700 1 -- 172.21.15.60:0/3410872198 reap_dead start 2023-10-06T04:29:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.186+0000 7f881bfff700 1 -- 172.21.15.60:0/3410872198 shutdown_connections 2023-10-06T04:29:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.186+0000 7f881bfff700 1 -- 172.21.15.60:0/3410872198 >> 172.21.15.60:0/3410872198 conn(0x7f881c068080 msgr2=0x7f881c0cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.186+0000 7f881bfff700 1 -- 172.21.15.60:0/3410872198 shutdown_connections 2023-10-06T04:29:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.186+0000 7f881bfff700 1 -- 172.21.15.60:0/3410872198 wait complete. 2023-10-06T04:29:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.187+0000 7f881bfff700 1 Processor -- start 2023-10-06T04:29:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.187+0000 7f881bfff700 1 -- start start 2023-10-06T04:29:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.188+0000 7f881bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8804003a60 0x7f881c1437a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.188+0000 7f881bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f881c143f80 0x7f881c165860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.188+0000 7f881bfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f881c165da0 0x7f881c14bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.188+0000 7f881bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c143ce0 con 0x7f8804003a60 2023-10-06T04:29:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.188+0000 7f881bfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c14b6c0 con 0x7f881c143f80 2023-10-06T04:29:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.188+0000 7f881bfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881c166300 con 0x7f881c165da0 2023-10-06T04:29:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.189+0000 7f881affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8804003a60 0x7f881c1437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.189+0000 7f881affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8804003a60 0x7f881c1437a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42520/0 (socket says 172.21.15.60:42520) 2023-10-06T04:29:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.189+0000 7f881affd700 1 -- 172.21.15.60:0/3965616144 learned_addr learned my addr 172.21.15.60:0/3965616144 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.189+0000 7f881a7fc700 1 --2- 172.21.15.60:0/3965616144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f881c143f80 0x7f881c165860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.189+0000 7f881b7fe700 1 --2- 172.21.15.60:0/3965616144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f881c165da0 0x7f881c14bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.189+0000 7f881affd700 1 -- 172.21.15.60:0/3965616144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f881c165da0 msgr2=0x7f881c14bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.189+0000 7f881affd700 1 --2- 172.21.15.60:0/3965616144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f881c165da0 0x7f881c14bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.189+0000 7f881affd700 1 -- 172.21.15.60:0/3965616144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f881c143f80 msgr2=0x7f881c165860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.189+0000 7f881affd700 1 --2- 172.21.15.60:0/3965616144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f881c143f80 0x7f881c165860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.189+0000 7f881affd700 1 -- 172.21.15.60:0/3965616144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c1665e0 con 0x7f8804003a60 2023-10-06T04:29:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.189+0000 7f881a7fc700 1 --2- 172.21.15.60:0/3965616144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f881c143f80 0x7f881c165860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.189+0000 7f881affd700 1 --2- 172.21.15.60:0/3965616144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8804003a60 0x7f881c1437a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f88040046d0 tx=0x7f880c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.189+0000 7f8802ffd700 1 -- 172.21.15.60:0/3965616144 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c022070 con 0x7f8804003a60 2023-10-06T04:29:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.189+0000 7f8802ffd700 1 -- 172.21.15.60:0/3965616144 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c001160 con 0x7f8804003a60 2023-10-06T04:29:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.190+0000 7f8802ffd700 1 -- 172.21.15.60:0/3965616144 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0074f0 con 0x7f8804003a60 2023-10-06T04:29:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.190+0000 7f881bfff700 1 -- 172.21.15.60:0/3965616144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881c14b350 con 0x7f8804003a60 2023-10-06T04:29:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.190+0000 7f881bfff700 1 -- 172.21.15.60:0/3965616144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881c14c2d0 con 0x7f8804003a60 2023-10-06T04:29:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.191+0000 7f881bfff700 1 -- 172.21.15.60:0/3965616144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881c14b1b0 con 0x7f8804003a60 2023-10-06T04:29:24.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.192+0000 7f8802ffd700 1 -- 172.21.15.60:0/3965616144 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f880c004830 con 0x7f8804003a60 2023-10-06T04:29:24.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.193+0000 7f8802ffd700 1 --2- 172.21.15.60:0/3965616144 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8808066f30 0x7f88080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:24.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.193+0000 7f8802ffd700 1 -- 172.21.15.60:0/3965616144 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f880c087a40 con 0x7f8804003a60 2023-10-06T04:29:24.196 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.193+0000 7f881a7fc700 1 --2- 172.21.15.60:0/3965616144 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8808066f30 0x7f88080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:24.197 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.194+0000 7f881a7fc700 1 --2- 172.21.15.60:0/3965616144 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8808066f30 0x7f88080693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8810006dc0 tx=0x7f8810008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.197+0000 7f8802ffd700 1 -- 172.21.15.60:0/3965616144 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f881c14b1b0 con 0x7f8804003a60 2023-10-06T04:29:24.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.445+0000 7f881bfff700 1 -- 172.21.15.60:0/3965616144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f881c159df0 con 0x7f8804003a60 2023-10-06T04:29:24.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.445+0000 7f8802ffd700 1 -- 172.21.15.60:0/3965616144 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f881c159df0 con 0x7f8804003a60 2023-10-06T04:29:24.447 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:24.447 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1681836371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1681836371},{"type":"v1","addr":"172.21.15.135:6834","nonce":1681836371}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/823204172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":823204172},{"type":"v1","addr":"172.21.15.135:6835","nonce":823204172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4963,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1348379028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1348379028},{"type":"v1","addr":"172.21.15.60:6836","nonce":1348379028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:29:20.429944+0000","modified":"2023-10-06T04:29:23.960780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6837/749877170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":749877170},{"type":"v1","addr":"172.21.15.60:6837","nonce":749877170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:29:24.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.448+0000 7f881bfff700 1 -- 172.21.15.60:0/3965616144 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8808066f30 msgr2=0x7f88080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:24.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.448+0000 7f881bfff700 1 --2- 172.21.15.60:0/3965616144 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8808066f30 0x7f88080693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8810006dc0 tx=0x7f8810008040 comp rx=0 tx=0).stop 2023-10-06T04:29:24.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.448+0000 7f881bfff700 1 -- 172.21.15.60:0/3965616144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8804003a60 msgr2=0x7f881c1437a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:24.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.448+0000 7f881bfff700 1 --2- 172.21.15.60:0/3965616144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8804003a60 0x7f881c1437a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f88040046d0 tx=0x7f880c017000 comp rx=0 tx=0).stop 2023-10-06T04:29:24.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.448+0000 7f881bfff700 1 -- 172.21.15.60:0/3965616144 shutdown_connections 2023-10-06T04:29:24.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.448+0000 7f881bfff700 1 --2- 172.21.15.60:0/3965616144 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8808066f30 0x7f88080693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:24.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.448+0000 7f881bfff700 1 --2- 172.21.15.60:0/3965616144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8804003a60 0x7f881c1437a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:24.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.448+0000 7f881bfff700 1 --2- 172.21.15.60:0/3965616144 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f881c165da0 0x7f881c14bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:24.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.448+0000 7f881bfff700 1 --2- 172.21.15.60:0/3965616144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f881c143f80 0x7f881c165860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:24.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.448+0000 7f881bfff700 1 -- 172.21.15.60:0/3965616144 >> 172.21.15.60:0/3965616144 conn(0x7f881c068080 msgr2=0x7f881c14e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:24.450 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.448+0000 7f881bfff700 1 -- 172.21.15.60:0/3965616144 shutdown_connections 2023-10-06T04:29:24.451 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.448+0000 7f881bfff700 1 -- 172.21.15.60:0/3965616144 wait complete. 2023-10-06T04:29:24.451 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 16 2023-10-06T04:29:24.467 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:29:24.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.651+0000 7f34e7fff700 1 Processor -- start 2023-10-06T04:29:24.653 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.651+0000 7f34e7fff700 1 -- start start 2023-10-06T04:29:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.652+0000 7f34e7fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f34e8159440 0x7f34e80b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.652+0000 7f34e7fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34e80b35d0 0x7f34e80cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.652+0000 7f34e7fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e80cb7a0 con 0x7f34e80cc170 2023-10-06T04:29:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.652+0000 7f34e7fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e80b0860 con 0x7f34e80b35d0 2023-10-06T04:29:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.652+0000 7f34e7fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e80cb150 con 0x7f34e8159440 2023-10-06T04:29:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.653+0000 7f34e67fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34e80b35d0 0x7f34e80cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.653+0000 7f34e67fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34e80b35d0 0x7f34e80cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42522/0 (socket says 172.21.15.60:42522) 2023-10-06T04:29:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.653+0000 7f34e67fc700 1 -- 172.21.15.60:0/3985907631 learned_addr learned my addr 172.21.15.60:0/3985907631 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.653+0000 7f34e77fe700 1 --1- 172.21.15.60:0/3985907631 >> v1:172.21.15.60:6789/0 conn(0x7f34e80cc170 0x7f34e80b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41372/0 (socket says 172.21.15.60:41372) 2023-10-06T04:29:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.653+0000 7f34e6ffd700 1 --2- 172.21.15.60:0/3985907631 >> v2:172.21.15.135:3300/0 conn(0x7f34e8159440 0x7f34e80b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.653+0000 7f34e67fc700 1 -- 172.21.15.60:0/3985907631 >> v2:172.21.15.135:3300/0 conn(0x7f34e8159440 msgr2=0x7f34e80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.653+0000 7f34e67fc700 1 --2- 172.21.15.60:0/3985907631 >> v2:172.21.15.135:3300/0 conn(0x7f34e8159440 0x7f34e80b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.653+0000 7f34e67fc700 1 -- 172.21.15.60:0/3985907631 >> v1:172.21.15.60:6789/0 conn(0x7f34e80cc170 legacy=0x7f34e80b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.653+0000 7f34e67fc700 1 -- 172.21.15.60:0/3985907631 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e80cb430 con 0x7f34e80b35d0 2023-10-06T04:29:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.653+0000 7f34e5ffb700 1 -- 172.21.15.60:0/3985907631 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447348763 0 0) 0x7f34e80cb7a0 con 0x7f34e80cc170 2023-10-06T04:29:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.653+0000 7f34e67fc700 1 --2- 172.21.15.60:0/3985907631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34e80b35d0 0x7f34e80cbc30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f34e806f9f0 tx=0x7f34dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde224e39c4225df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.654+0000 7f34e5ffb700 1 -- 172.21.15.60:0/3985907631 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc00b860 con 0x7f34e80b35d0 2023-10-06T04:29:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.654+0000 7f34e5ffb700 1 -- 172.21.15.60:0/3985907631 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc00b9c0 con 0x7f34e80b35d0 2023-10-06T04:29:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.654+0000 7f34e5ffb700 1 -- 172.21.15.60:0/3985907631 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc00bd60 con 0x7f34e80b35d0 2023-10-06T04:29:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.654+0000 7f34e7fff700 1 -- 172.21.15.60:0/3985907631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34e80b35d0 msgr2=0x7f34e80cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.654+0000 7f34e7fff700 1 --2- 172.21.15.60:0/3985907631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34e80b35d0 0x7f34e80cbc30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f34e806f9f0 tx=0x7f34dc009250 comp rx=0 tx=0).stop 2023-10-06T04:29:24.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.654+0000 7f34e7fff700 1 -- 172.21.15.60:0/3985907631 shutdown_connections 2023-10-06T04:29:24.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.654+0000 7f34e7fff700 1 --2- 172.21.15.60:0/3985907631 >> v2:172.21.15.135:3300/0 conn(0x7f34e8159440 0x7f34e80b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:24.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.654+0000 7f34e7fff700 1 --2- 172.21.15.60:0/3985907631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34e80b35d0 0x7f34e80cbc30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:24.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.654+0000 7f34e7fff700 1 -- 172.21.15.60:0/3985907631 >> 172.21.15.60:0/3985907631 conn(0x7f34e806ece0 msgr2=0x7f34e806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:24.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.654+0000 7f34e7fff700 1 -- 172.21.15.60:0/3985907631 shutdown_connections 2023-10-06T04:29:24.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.655+0000 7f34e7fff700 1 -- 172.21.15.60:0/3985907631 wait complete. 2023-10-06T04:29:24.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.656+0000 7f34e7fff700 1 Processor -- start 2023-10-06T04:29:24.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.656+0000 7f34e7fff700 1 -- start start 2023-10-06T04:29:24.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.657+0000 7f34e7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34e80b35d0 0x7f34e80c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:24.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.657+0000 7f34e7fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34e80cc170 0x7f34e80c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:24.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.657+0000 7f34e7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34e8159440 0x7f34e816cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:24.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.657+0000 7f34e7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80c5c00 con 0x7f34e8159440 2023-10-06T04:29:24.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.657+0000 7f34e7fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80c5e50 con 0x7f34e80b35d0 2023-10-06T04:29:24.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.657+0000 7f34e7fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80c6130 con 0x7f34e80cc170 2023-10-06T04:29:24.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.657+0000 7f34e77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34e8159440 0x7f34e816cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:24.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.657+0000 7f34e77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34e8159440 0x7f34e816cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42536/0 (socket says 172.21.15.60:42536) 2023-10-06T04:29:24.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.657+0000 7f34e77fe700 1 -- 172.21.15.60:0/917655802 learned_addr learned my addr 172.21.15.60:0/917655802 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:24.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.657+0000 7f34e6ffd700 1 --2- 172.21.15.60:0/917655802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34e80b35d0 0x7f34e80c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:24.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.658+0000 7f34e67fc700 1 --2- 172.21.15.60:0/917655802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34e80cc170 0x7f34e80c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:24.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.658+0000 7f34e77fe700 1 -- 172.21.15.60:0/917655802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34e80cc170 msgr2=0x7f34e80c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:24.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.658+0000 7f34e77fe700 1 --2- 172.21.15.60:0/917655802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34e80cc170 0x7f34e80c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:24.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.658+0000 7f34e77fe700 1 -- 172.21.15.60:0/917655802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34e80b35d0 msgr2=0x7f34e80c3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:24.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.658+0000 7f34e77fe700 1 --2- 172.21.15.60:0/917655802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34e80b35d0 0x7f34e80c3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:24.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.658+0000 7f34e77fe700 1 -- 172.21.15.60:0/917655802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34dc0094f0 con 0x7f34e8159440 2023-10-06T04:29:24.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.658+0000 7f34e77fe700 1 --2- 172.21.15.60:0/917655802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34e8159440 0x7f34e816cc80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f34e000cd00 tx=0x7f34e0001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:24.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.658+0000 7f34ceffd700 1 -- 172.21.15.60:0/917655802 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e000ce60 con 0x7f34e8159440 2023-10-06T04:29:24.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.658+0000 7f34ceffd700 1 -- 172.21.15.60:0/917655802 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e0005df0 con 0x7f34e8159440 2023-10-06T04:29:24.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.658+0000 7f34ceffd700 1 -- 172.21.15.60:0/917655802 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e000ab00 con 0x7f34e8159440 2023-10-06T04:29:24.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.658+0000 7f34e7fff700 1 -- 172.21.15.60:0/917655802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e80c6410 con 0x7f34e8159440 2023-10-06T04:29:24.662 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.659+0000 7f34e7fff700 1 -- 172.21.15.60:0/917655802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e80c49c0 con 0x7f34e8159440 2023-10-06T04:29:24.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.659+0000 7f34e7fff700 1 -- 172.21.15.60:0/917655802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e80c6930 con 0x7f34e8159440 2023-10-06T04:29:24.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.660+0000 7f34ceffd700 1 -- 172.21.15.60:0/917655802 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34e00070f0 con 0x7f34e8159440 2023-10-06T04:29:24.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.661+0000 7f34ceffd700 1 --2- 172.21.15.60:0/917655802 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f34d4066f30 0x7f34d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:24.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.662+0000 7f34ceffd700 1 -- 172.21.15.60:0/917655802 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f34e0084820 con 0x7f34e8159440 2023-10-06T04:29:24.663 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.662+0000 7f34e6ffd700 1 --2- 172.21.15.60:0/917655802 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f34d4066f30 0x7f34d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:24.664 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.662+0000 7f34e6ffd700 1 --2- 172.21.15.60:0/917655802 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f34d4066f30 0x7f34d40693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f34d8006fd0 tx=0x7f34d8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:24.666 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.665+0000 7f34ceffd700 1 -- 172.21.15.60:0/917655802 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34e80c6930 con 0x7f34e8159440 2023-10-06T04:29:24.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.871+0000 7f34e7fff700 1 -- 172.21.15.60:0/917655802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34e80c6930 con 0x7f34e8159440 2023-10-06T04:29:24.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.872+0000 7f34ceffd700 1 -- 172.21.15.60:0/917655802 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17071 (secure 0 0 0) 0x7f34e80c6930 con 0x7f34e8159440 2023-10-06T04:29:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:24.874 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":40,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:29:21.931996+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:29:18.102794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:29:19.405806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:29:24.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.874+0000 7f34e7fff700 1 -- 172.21.15.60:0/917655802 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f34d4066f30 msgr2=0x7f34d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:24.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.874+0000 7f34e7fff700 1 --2- 172.21.15.60:0/917655802 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f34d4066f30 0x7f34d40693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f34d8006fd0 tx=0x7f34d8008040 comp rx=0 tx=0).stop 2023-10-06T04:29:24.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.874+0000 7f34e7fff700 1 -- 172.21.15.60:0/917655802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34e8159440 msgr2=0x7f34e816cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:24.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.874+0000 7f34e7fff700 1 --2- 172.21.15.60:0/917655802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34e8159440 0x7f34e816cc80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f34e000cd00 tx=0x7f34e0001ac0 comp rx=0 tx=0).stop 2023-10-06T04:29:24.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.874+0000 7f34e7fff700 1 -- 172.21.15.60:0/917655802 shutdown_connections 2023-10-06T04:29:24.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.874+0000 7f34e7fff700 1 --2- 172.21.15.60:0/917655802 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f34d4066f30 0x7f34d40693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:24.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.874+0000 7f34e7fff700 1 --2- 172.21.15.60:0/917655802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34e8159440 0x7f34e816cc80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:24.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.874+0000 7f34e7fff700 1 --2- 172.21.15.60:0/917655802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34e80b35d0 0x7f34e80c3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:24.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.874+0000 7f34e7fff700 1 --2- 172.21.15.60:0/917655802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f34e80cc170 0x7f34e80c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:24.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.874+0000 7f34e7fff700 1 -- 172.21.15.60:0/917655802 >> 172.21.15.60:0/917655802 conn(0x7f34e806ece0 msgr2=0x7f34e815be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:24.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.875+0000 7f34e7fff700 1 -- 172.21.15.60:0/917655802 shutdown_connections 2023-10-06T04:29:24.877 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:24.875+0000 7f34e7fff700 1 -- 172.21.15.60:0/917655802 wait complete. 2023-10-06T04:29:24.893 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T04:29:24.894 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:29:25.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.079+0000 7f674f39d700 1 Processor -- start 2023-10-06T04:29:25.081 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.080+0000 7f674f39d700 1 -- start start 2023-10-06T04:29:25.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.081+0000 7f674f39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6748153e00 0x7f674806df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:25.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.081+0000 7f674f39d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f674806a960 0x7f674806e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:25.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.081+0000 7f674f39d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67480c9cc0 con 0x7f674806a590 2023-10-06T04:29:25.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.081+0000 7f674f39d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f674806f560 con 0x7f674806a960 2023-10-06T04:29:25.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.081+0000 7f674f39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67480c6710 con 0x7f6748153e00 2023-10-06T04:29:25.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.081+0000 7f674eb9c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f674806a960 0x7f674806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:25.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.081+0000 7f674eb9c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f674806a960 0x7f674806e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42552/0 (socket says 172.21.15.60:42552) 2023-10-06T04:29:25.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.081+0000 7f674eb9c700 1 -- 172.21.15.60:0/3919223423 learned_addr learned my addr 172.21.15.60:0/3919223423 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:25.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.081+0000 7f674db9a700 1 --2- 172.21.15.60:0/3919223423 >> v2:172.21.15.135:3300/0 conn(0x7f6748153e00 0x7f674806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:25.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.082+0000 7f674eb9c700 1 -- 172.21.15.60:0/3919223423 >> v2:172.21.15.135:3300/0 conn(0x7f6748153e00 msgr2=0x7f674806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:25.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.082+0000 7f674eb9c700 1 --2- 172.21.15.60:0/3919223423 >> v2:172.21.15.135:3300/0 conn(0x7f6748153e00 0x7f674806df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.082+0000 7f674eb9c700 1 -- 172.21.15.60:0/3919223423 >> v1:172.21.15.135:6789/0 conn(0x7f674806a590 legacy=0x7f67481536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:25.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.082+0000 7f674eb9c700 1 -- 172.21.15.60:0/3919223423 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674806ecc0 con 0x7f674806a960 2023-10-06T04:29:25.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.082+0000 7f674eb9c700 1 --2- 172.21.15.60:0/3919223423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f674806a960 0x7f674806e490 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f67480b1ec0 tx=0x7f674000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7852a69f93298c45 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:25.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.082+0000 7f674d399700 1 -- 172.21.15.60:0/3919223423 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740010070 con 0x7f674806a960 2023-10-06T04:29:25.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.082+0000 7f674d399700 1 -- 172.21.15.60:0/3919223423 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674000dde0 con 0x7f674806a960 2023-10-06T04:29:25.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.082+0000 7f674d399700 1 -- 172.21.15.60:0/3919223423 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674000b320 con 0x7f674806a960 2023-10-06T04:29:25.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.083+0000 7f674f39d700 1 -- 172.21.15.60:0/3919223423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f674806a960 msgr2=0x7f674806e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:25.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.083+0000 7f674f39d700 1 --2- 172.21.15.60:0/3919223423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f674806a960 0x7f674806e490 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f67480b1ec0 tx=0x7f674000ba50 comp rx=0 tx=0).stop 2023-10-06T04:29:25.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.083+0000 7f674f39d700 1 -- 172.21.15.60:0/3919223423 shutdown_connections 2023-10-06T04:29:25.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.083+0000 7f674f39d700 1 --2- 172.21.15.60:0/3919223423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f674806a960 0x7f674806e490 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.083+0000 7f674f39d700 1 --2- 172.21.15.60:0/3919223423 >> v2:172.21.15.135:3300/0 conn(0x7f6748153e00 0x7f674806df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.083+0000 7f674f39d700 1 -- 172.21.15.60:0/3919223423 >> 172.21.15.60:0/3919223423 conn(0x7f6748068080 msgr2=0x7f67480cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:25.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.083+0000 7f674f39d700 1 -- 172.21.15.60:0/3919223423 shutdown_connections 2023-10-06T04:29:25.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.083+0000 7f674f39d700 1 -- 172.21.15.60:0/3919223423 wait complete. 2023-10-06T04:29:25.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.084+0000 7f674f39d700 1 Processor -- start 2023-10-06T04:29:25.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.085+0000 7f674f39d700 1 -- start start 2023-10-06T04:29:25.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.085+0000 7f674f39d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f674806a590 0x7f67480b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:25.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.085+0000 7f674f39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f674806a960 0x7f6748155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:25.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.085+0000 7f674f39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6748153e00 0x7f6748169a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:25.088 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.085+0000 7f674f39d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67480b0230 con 0x7f674806a590 2023-10-06T04:29:25.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.085+0000 7f674f39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67480b0920 con 0x7f674806a960 2023-10-06T04:29:25.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.085+0000 7f674f39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67480b0ee0 con 0x7f6748153e00 2023-10-06T04:29:25.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.086+0000 7f674e39b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f674806a590 0x7f67480b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:25.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.086+0000 7f674e39b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f674806a590 0x7f67480b1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42564/0 (socket says 172.21.15.60:42564) 2023-10-06T04:29:25.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.086+0000 7f674e39b700 1 -- 172.21.15.60:0/2053329744 learned_addr learned my addr 172.21.15.60:0/2053329744 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:25.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.086+0000 7f674db9a700 1 --2- 172.21.15.60:0/2053329744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f674806a960 0x7f6748155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:25.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.086+0000 7f674eb9c700 1 --2- 172.21.15.60:0/2053329744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6748153e00 0x7f6748169a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:25.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.086+0000 7f674e39b700 1 -- 172.21.15.60:0/2053329744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6748153e00 msgr2=0x7f6748169a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:25.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.086+0000 7f674e39b700 1 --2- 172.21.15.60:0/2053329744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6748153e00 0x7f6748169a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.086+0000 7f674e39b700 1 -- 172.21.15.60:0/2053329744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f674806a960 msgr2=0x7f6748155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:25.089 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.086+0000 7f674e39b700 1 --2- 172.21.15.60:0/2053329744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f674806a960 0x7f6748155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.086+0000 7f674e39b700 1 -- 172.21.15.60:0/2053329744 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674000bcf0 con 0x7f674806a590 2023-10-06T04:29:25.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.086+0000 7f674eb9c700 1 --2- 172.21.15.60:0/2053329744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6748153e00 0x7f6748169a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:25.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.087+0000 7f674e39b700 1 --2- 172.21.15.60:0/2053329744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f674806a590 0x7f67480b1370 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f674400c5c0 tx=0x7f674400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:25.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.087+0000 7f673e7fc700 1 -- 172.21.15.60:0/2053329744 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6744011590 con 0x7f674806a590 2023-10-06T04:29:25.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.087+0000 7f673e7fc700 1 -- 172.21.15.60:0/2053329744 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6744011710 con 0x7f674806a590 2023-10-06T04:29:25.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.087+0000 7f673e7fc700 1 -- 172.21.15.60:0/2053329744 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6744011ad0 con 0x7f674806a590 2023-10-06T04:29:25.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.087+0000 7f674f39d700 1 -- 172.21.15.60:0/2053329744 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f674816a570 con 0x7f674806a590 2023-10-06T04:29:25.090 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.087+0000 7f674f39d700 1 -- 172.21.15.60:0/2053329744 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67480b0b70 con 0x7f674806a590 2023-10-06T04:29:25.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.088+0000 7f674f39d700 1 -- 172.21.15.60:0/2053329744 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f674805f230 con 0x7f674806a590 2023-10-06T04:29:25.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.089+0000 7f673e7fc700 1 -- 172.21.15.60:0/2053329744 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f674401b3b0 con 0x7f674806a590 2023-10-06T04:29:25.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.090+0000 7f673e7fc700 1 --2- 172.21.15.60:0/2053329744 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f672c066f30 0x7f672c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:25.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.090+0000 7f673e7fc700 1 -- 172.21.15.60:0/2053329744 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6744083da0 con 0x7f674806a590 2023-10-06T04:29:25.091 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.090+0000 7f674db9a700 1 --2- 172.21.15.60:0/2053329744 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f672c066f30 0x7f672c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:25.092 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.090+0000 7f674db9a700 1 --2- 172.21.15.60:0/2053329744 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f672c066f30 0x7f672c0693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6738009d10 tx=0x7f67380091a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:25.095 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.094+0000 7f673e7fc700 1 -- 172.21.15.60:0/2053329744 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6744050cd0 con 0x7f674806a590 2023-10-06T04:29:25.293 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.291+0000 7f674f39d700 1 -- 172.21.15.60:0/2053329744 --> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67480b1020 con 0x7f672c066f30 2023-10-06T04:29:25.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.301+0000 7f673e7fc700 1 -- 172.21.15.60:0/2053329744 <== mgr.4098 v2:172.21.15.60:6832/85285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+296319 (secure 0 0 0) 0x7f6738011a50 con 0x7f672c066f30 2023-10-06T04:29:25.306 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:25.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.306+0000 7f674f39d700 1 -- 172.21.15.60:0/2053329744 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f672c066f30 msgr2=0x7f672c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:25.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.306+0000 7f674f39d700 1 --2- 172.21.15.60:0/2053329744 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f672c066f30 0x7f672c0693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6738009d10 tx=0x7f67380091a0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.306+0000 7f674f39d700 1 -- 172.21.15.60:0/2053329744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f674806a590 msgr2=0x7f67480b1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:25.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.306+0000 7f674f39d700 1 --2- 172.21.15.60:0/2053329744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f674806a590 0x7f67480b1370 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f674400c5c0 tx=0x7f674400c8d0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.306+0000 7f674f39d700 1 -- 172.21.15.60:0/2053329744 shutdown_connections 2023-10-06T04:29:25.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.306+0000 7f674f39d700 1 --2- 172.21.15.60:0/2053329744 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f672c066f30 0x7f672c0693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.306+0000 7f674f39d700 1 --2- 172.21.15.60:0/2053329744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f674806a590 0x7f67480b1370 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.306+0000 7f674f39d700 1 --2- 172.21.15.60:0/2053329744 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6748153e00 0x7f6748169a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.306+0000 7f674f39d700 1 --2- 172.21.15.60:0/2053329744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f674806a960 0x7f6748155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.306+0000 7f674f39d700 1 -- 172.21.15.60:0/2053329744 >> 172.21.15.60:0/2053329744 conn(0x7f6748068080 msgr2=0x7f674814da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:25.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.306+0000 7f674f39d700 1 -- 172.21.15.60:0/2053329744 shutdown_connections 2023-10-06T04:29:25.310 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.306+0000 7f674f39d700 1 -- 172.21.15.60:0/2053329744 wait complete. 2023-10-06T04:29:25.310 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-06T04:29:25.324 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-10-06T04:29:23.326393+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399060,"kb_used_data":4372,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752575660,"statfs":{"total":773094113280,"available":770637475840,"internally_reserved":0,"allocated":4476928,"data_stored":2617254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.402165"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T04:29:11.353493+0000","last_change":"2023-10-06T04:28:00.325832+0000","last_active":"2023-10-06T04:29:11.353493+0000","last_peered":"2023-10-06T04:29:11.353493+0000","last_clean":"2023-10-06T04:29:11.353493+0000","last_became_active":"2023-10-06T04:28:00.325466+0000","last_became_peered":"2023-10-06T04:28:00.325466+0000","last_unstale":"2023-10-06T04:29:11.353493+0000","last_undegraded":"2023-10-06T04:29:11.353493+0000","last_fullsized":"2023-10-06T04:29:11.353493+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T04:29:11.358404+0000","last_change":"2023-10-06T04:28:00.175241+0000","last_active":"2023-10-06T04:29:11.358404+0000","last_peered":"2023-10-06T04:29:11.358404+0000","last_clean":"2023-10-06T04:29:11.358404+0000","last_became_active":"2023-10-06T04:28:00.174814+0000","last_became_peered":"2023-10-06T04:28:00.174814+0000","last_unstale":"2023-10-06T04:29:11.358404+0000","last_undegraded":"2023-10-06T04:29:11.358404+0000","last_fullsized":"2023-10-06T04:29:11.358404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T04:29:11.354319+0000","last_change":"2023-10-06T04:28:00.175086+0000","last_active":"2023-10-06T04:29:11.354319+0000","last_peered":"2023-10-06T04:29:11.354319+0000","last_clean":"2023-10-06T04:29:11.354319+0000","last_became_active":"2023-10-06T04:28:00.174735+0000","last_became_peered":"2023-10-06T04:28:00.174735+0000","last_unstale":"2023-10-06T04:29:11.354319+0000","last_undegraded":"2023-10-06T04:29:11.354319+0000","last_fullsized":"2023-10-06T04:29:11.354319+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":176,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T04:29:11.358595+0000","last_change":"2023-10-06T04:28:01.176177+0000","last_active":"2023-10-06T04:29:11.358595+0000","last_peered":"2023-10-06T04:29:11.358595+0000","last_clean":"2023-10-06T04:29:11.358595+0000","last_became_active":"2023-10-06T04:28:01.175255+0000","last_became_peered":"2023-10-06T04:28:01.175255+0000","last_unstale":"2023-10-06T04:29:11.358595+0000","last_undegraded":"2023-10-06T04:29:11.358595+0000","last_fullsized":"2023-10-06T04:29:11.358595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:00.161020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:00.161020+0000","last_clean_scrub_stamp":"2023-10-06T04:28:00.161020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:29.208067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T04:29:11.358593+0000","last_change":"2023-10-06T04:28:00.344573+0000","last_active":"2023-10-06T04:29:11.358593+0000","last_peered":"2023-10-06T04:29:11.358593+0000","last_clean":"2023-10-06T04:29:11.358593+0000","last_became_active":"2023-10-06T04:28:00.344324+0000","last_became_peered":"2023-10-06T04:28:00.344324+0000","last_unstale":"2023-10-06T04:29:11.358593+0000","last_undegraded":"2023-10-06T04:29:11.358593+0000","last_fullsized":"2023-10-06T04:29:11.358593+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:24.184826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T04:29:11.358582+0000","last_change":"2023-10-06T04:28:00.343571+0000","last_active":"2023-10-06T04:29:11.358582+0000","last_peered":"2023-10-06T04:29:11.358582+0000","last_clean":"2023-10-06T04:29:11.358582+0000","last_became_active":"2023-10-06T04:28:00.343268+0000","last_became_peered":"2023-10-06T04:28:00.343268+0000","last_unstale":"2023-10-06T04:29:11.358582+0000","last_undegraded":"2023-10-06T04:29:11.358582+0000","last_fullsized":"2023-10-06T04:29:11.358582+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:00.931419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T04:29:11.359054+0000","last_change":"2023-10-06T04:28:00.344460+0000","last_active":"2023-10-06T04:29:11.359054+0000","last_peered":"2023-10-06T04:29:11.359054+0000","last_clean":"2023-10-06T04:29:11.359054+0000","last_became_active":"2023-10-06T04:28:00.343280+0000","last_became_peered":"2023-10-06T04:28:00.343280+0000","last_unstale":"2023-10-06T04:29:11.359054+0000","last_undegraded":"2023-10-06T04:29:11.359054+0000","last_fullsized":"2023-10-06T04:29:11.359054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T04:29:11.351908+0000","last_change":"2023-10-06T04:28:00.343592+0000","last_active":"2023-10-06T04:29:11.351908+0000","last_peered":"2023-10-06T04:29:11.351908+0000","last_clean":"2023-10-06T04:29:11.351908+0000","last_became_active":"2023-10-06T04:28:00.343313+0000","last_became_peered":"2023-10-06T04:28:00.343313+0000","last_unstale":"2023-10-06T04:29:11.351908+0000","last_undegraded":"2023-10-06T04:29:11.351908+0000","last_fullsized":"2023-10-06T04:29:11.351908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:24.184826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:19.923876+0000","last_change":"2023-10-06T04:29:19.923876+0000","last_active":"2023-10-06T04:29:19.923876+0000","last_peered":"2023-10-06T04:29:19.923876+0000","last_clean":"2023-10-06T04:29:19.923876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:19.923876+0000","last_undegraded":"2023-10-06T04:29:19.923876+0000","last_fullsized":"2023-10-06T04:29:19.923876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T04:29:18.916643+0000","last_change":"2023-10-06T04:29:18.916643+0000","last_active":"2023-10-06T04:29:18.916643+0000","last_peered":"2023-10-06T04:29:18.916643+0000","last_clean":"2023-10-06T04:29:18.916643+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T04:29:18.916643+0000","last_undegraded":"2023-10-06T04:29:18.916643+0000","last_fullsized":"2023-10-06T04:29:18.916643+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T04:29:11.351944+0000","last_change":"2023-10-06T04:28:00.174563+0000","last_active":"2023-10-06T04:29:11.351944+0000","last_peered":"2023-10-06T04:29:11.351944+0000","last_clean":"2023-10-06T04:29:11.351944+0000","last_became_active":"2023-10-06T04:28:00.174265+0000","last_became_peered":"2023-10-06T04:28:00.174265+0000","last_unstale":"2023-10-06T04:29:11.351944+0000","last_undegraded":"2023-10-06T04:29:11.351944+0000","last_fullsized":"2023-10-06T04:29:11.351944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:00.931419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298268,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073572,"statfs":{"total":96636764160,"available":96331337728,"internally_reserved":0,"allocated":1003520,"data_stored":769566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:28:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":4.3070000000000004,"5min":4.3070000000000004,"15min":4.3070000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":8.1609999999999996,"5min":8.1609999999999996,"15min":8.1609999999999996},"last":0.69899999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:28:58 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":5.0730000000000004,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":6.3079999999999998,"5min":6.3079999999999998,"15min":6.3079999999999998},"last":0.60899999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:28:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":4.4619999999999997,"5min":4.4619999999999997,"15min":4.4619999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":8.2840000000000007,"5min":8.2840000000000007,"15min":8.2840000000000007},"last":0.79000000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:28:58 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.7130000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.66700000000000004}]},{"osd":4,"last update":"Fri Oct 6 04:28:58 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":8.0890000000000004,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.623},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":3.3980000000000001,"5min":3.3980000000000001,"15min":3.3980000000000001},"last":0.80200000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:28:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":6.8200000000000003,"5min":6.8200000000000003,"15min":6.8200000000000003},"last":0.753},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":8.3439999999999994,"5min":8.3439999999999994,"15min":8.3439999999999994},"last":0.746}]},{"osd":6,"last update":"Fri Oct 6 04:28:58 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":6.2839999999999998,"5min":6.2839999999999998,"15min":6.2839999999999998},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":4.1420000000000003,"5min":4.1420000000000003,"15min":4.1420000000000003},"last":0.77600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":180176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.77800000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1,"5min":1,"15min":1},"last":0.80600000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.54400000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.70999999999999996}]},{"osd":4,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.746}]},{"osd":5,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":6.6139999999999999,"5min":6.6139999999999999,"15min":6.6139999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":165.47,"5min":165.47,"15min":165.47},"last":0.66900000000000004},{"interface":"front","average":{"1min":6.6020000000000003,"5min":6.6020000000000003,"15min":6.6020000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":165.51300000000001,"5min":165.51300000000001,"15min":165.51300000000001},"last":0.58799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302368,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069472,"statfs":{"total":96636764160,"available":96327139328,"internally_reserved":0,"allocated":1007616,"data_stored":770544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.502}]},{"osd":2,"last update":"Fri Oct 6 04:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.437},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.52000000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.627},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.751}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301784,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070056,"statfs":{"total":96636764160,"available":96327737344,"internally_reserved":0,"allocated":409600,"data_stored":179198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.501}]},{"osd":3,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.438}]},{"osd":4,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.61399999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.71599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301784,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070056,"statfs":{"total":96636764160,"available":96327737344,"internally_reserved":0,"allocated":409600,"data_stored":179198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.33800000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.44600000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.81499999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.748},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.76800000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.69799999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.80400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301784,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070056,"statfs":{"total":96636764160,"available":96327737344,"internally_reserved":0,"allocated":409600,"data_stored":179198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.318},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.39700000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.441},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.504}]},{"osd":4,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.68000000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.629},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.64800000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.73299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":180176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.56899999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.71299999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.88}]},{"osd":3,"last update":"Fri Oct 6 04:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.95399999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.008},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.89200000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":0.97099999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":0.86099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297688,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074152,"statfs":{"total":96636764160,"available":96331931648,"internally_reserved":0,"allocated":409600,"data_stored":179198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.746},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.60099999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.91300000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.84099999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.96199999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.88500000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.90300000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":1.0149999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:29:25.332 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:29:25.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.550+0000 7fbf9559d700 1 Processor -- start 2023-10-06T04:29:25.552 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.550+0000 7fbf9559d700 1 -- start start 2023-10-06T04:29:25.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.551+0000 7fbf9559d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf90157140 0x7fbf900acd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:25.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.552+0000 7fbf9559d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbf900ad260 0x7fbf900aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:25.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.552+0000 7fbf9559d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9015afa0 con 0x7fbf900af330 2023-10-06T04:29:25.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.552+0000 7fbf9559d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf900ad700 con 0x7fbf90157140 2023-10-06T04:29:25.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.552+0000 7fbf9559d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9015b280 con 0x7fbf900ad260 2023-10-06T04:29:25.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.552+0000 7fbf8ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf90157140 0x7fbf900acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:25.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.552+0000 7fbf8ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf90157140 0x7fbf900acd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42578/0 (socket says 172.21.15.60:42578) 2023-10-06T04:29:25.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.552+0000 7fbf8ffff700 1 -- 172.21.15.60:0/273486848 learned_addr learned my addr 172.21.15.60:0/273486848 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:25.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.552+0000 7fbf8f7fe700 1 --2- 172.21.15.60:0/273486848 >> v2:172.21.15.135:3300/0 conn(0x7fbf900ad260 0x7fbf900aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:25.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.552+0000 7fbf8ffff700 1 -- 172.21.15.60:0/273486848 >> v2:172.21.15.135:3300/0 conn(0x7fbf900ad260 msgr2=0x7fbf900aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:25.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.552+0000 7fbf8ffff700 1 --2- 172.21.15.60:0/273486848 >> v2:172.21.15.135:3300/0 conn(0x7fbf900ad260 0x7fbf900aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.552+0000 7fbf8ffff700 1 -- 172.21.15.60:0/273486848 >> v1:172.21.15.135:6789/0 conn(0x7fbf900af330 legacy=0x7fbf900ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:25.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.552+0000 7fbf8ffff700 1 -- 172.21.15.60:0/273486848 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9015b560 con 0x7fbf90157140 2023-10-06T04:29:25.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.552+0000 7fbf8f7fe700 1 --2- 172.21.15.60:0/273486848 >> v2:172.21.15.135:3300/0 conn(0x7fbf900ad260 0x7fbf900aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:25.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.553+0000 7fbf8ffff700 1 --2- 172.21.15.60:0/273486848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90157140 0x7fbf900acd20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbf90088840 tx=0x7fbf80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a5764c435dbedb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:25.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.553+0000 7fbf8effd700 1 -- 172.21.15.60:0/273486848 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8000b820 con 0x7fbf90157140 2023-10-06T04:29:25.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.553+0000 7fbf8effd700 1 -- 172.21.15.60:0/273486848 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8000b980 con 0x7fbf90157140 2023-10-06T04:29:25.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.553+0000 7fbf8effd700 1 -- 172.21.15.60:0/273486848 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8000bd20 con 0x7fbf90157140 2023-10-06T04:29:25.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.553+0000 7fbf9559d700 1 -- 172.21.15.60:0/273486848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90157140 msgr2=0x7fbf900acd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:25.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.553+0000 7fbf9559d700 1 --2- 172.21.15.60:0/273486848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90157140 0x7fbf900acd20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbf90088840 tx=0x7fbf80009250 comp rx=0 tx=0).stop 2023-10-06T04:29:25.556 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.554+0000 7fbf9559d700 1 -- 172.21.15.60:0/273486848 shutdown_connections 2023-10-06T04:29:25.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.554+0000 7fbf9559d700 1 --2- 172.21.15.60:0/273486848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90157140 0x7fbf900acd20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.554+0000 7fbf9559d700 1 --2- 172.21.15.60:0/273486848 >> v2:172.21.15.135:3300/0 conn(0x7fbf900ad260 0x7fbf900aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.554+0000 7fbf9559d700 1 -- 172.21.15.60:0/273486848 >> 172.21.15.60:0/273486848 conn(0x7fbf90097410 msgr2=0x7fbf90067d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:25.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.554+0000 7fbf9559d700 1 -- 172.21.15.60:0/273486848 shutdown_connections 2023-10-06T04:29:25.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.554+0000 7fbf9559d700 1 -- 172.21.15.60:0/273486848 wait complete. 2023-10-06T04:29:25.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.555+0000 7fbf9559d700 1 Processor -- start 2023-10-06T04:29:25.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.555+0000 7fbf9559d700 1 -- start start 2023-10-06T04:29:25.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.556+0000 7fbf9559d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf900ad260 0x7fbf900cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:25.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.556+0000 7fbf9559d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf900af330 0x7fbf90150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:25.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.556+0000 7fbf9559d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90157140 0x7fbf90069f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:25.561 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.556+0000 7fbf9559d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9006a740 con 0x7fbf90157140 2023-10-06T04:29:25.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.556+0000 7fbf9559d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf90151160 con 0x7fbf900af330 2023-10-06T04:29:25.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.556+0000 7fbf9559d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf90169810 con 0x7fbf900ad260 2023-10-06T04:29:25.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.556+0000 7fbf94d9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90157140 0x7fbf90069f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:25.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.557+0000 7fbf94d9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90157140 0x7fbf90069f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42592/0 (socket says 172.21.15.60:42592) 2023-10-06T04:29:25.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.557+0000 7fbf94d9c700 1 -- 172.21.15.60:0/3457248586 learned_addr learned my addr 172.21.15.60:0/3457248586 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:25.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.557+0000 7fbf8f7fe700 1 --2- 172.21.15.60:0/3457248586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf900af330 0x7fbf90150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:25.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.557+0000 7fbf8ffff700 1 --2- 172.21.15.60:0/3457248586 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf900ad260 0x7fbf900cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:25.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.557+0000 7fbf94d9c700 1 -- 172.21.15.60:0/3457248586 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf900ad260 msgr2=0x7fbf900cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:25.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.557+0000 7fbf94d9c700 1 --2- 172.21.15.60:0/3457248586 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf900ad260 0x7fbf900cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.557+0000 7fbf94d9c700 1 -- 172.21.15.60:0/3457248586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf900af330 msgr2=0x7fbf90150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:25.562 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.557+0000 7fbf94d9c700 1 --2- 172.21.15.60:0/3457248586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf900af330 0x7fbf90150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.557+0000 7fbf94d9c700 1 -- 172.21.15.60:0/3457248586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf800094f0 con 0x7fbf90157140 2023-10-06T04:29:25.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.557+0000 7fbf94d9c700 1 --2- 172.21.15.60:0/3457248586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90157140 0x7fbf90069f60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbf8800c930 tx=0x7fbf880026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:25.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.557+0000 7fbf77fff700 1 -- 172.21.15.60:0/3457248586 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf88012630 con 0x7fbf90157140 2023-10-06T04:29:25.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.558+0000 7fbf77fff700 1 -- 172.21.15.60:0/3457248586 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf880127d0 con 0x7fbf90157140 2023-10-06T04:29:25.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.558+0000 7fbf9559d700 1 -- 172.21.15.60:0/3457248586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9016a380 con 0x7fbf90157140 2023-10-06T04:29:25.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.558+0000 7fbf77fff700 1 -- 172.21.15.60:0/3457248586 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf88012b90 con 0x7fbf90157140 2023-10-06T04:29:25.563 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.558+0000 7fbf9559d700 1 -- 172.21.15.60:0/3457248586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf90169a50 con 0x7fbf90157140 2023-10-06T04:29:25.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.559+0000 7fbf9559d700 1 -- 172.21.15.60:0/3457248586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf9016a510 con 0x7fbf90157140 2023-10-06T04:29:25.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.559+0000 7fbf77fff700 1 -- 172.21.15.60:0/3457248586 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf8801a3b0 con 0x7fbf90157140 2023-10-06T04:29:25.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.560+0000 7fbf77fff700 1 --2- 172.21.15.60:0/3457248586 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf7c066f30 0x7fbf7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:25.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.560+0000 7fbf77fff700 1 -- 172.21.15.60:0/3457248586 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fbf880844a0 con 0x7fbf90157140 2023-10-06T04:29:25.564 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.561+0000 7fbf8ffff700 1 --2- 172.21.15.60:0/3457248586 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf7c066f30 0x7fbf7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:25.565 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.561+0000 7fbf8ffff700 1 --2- 172.21.15.60:0/3457248586 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf7c066f30 0x7fbf7c0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbf90088840 tx=0x7fbf80016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:25.566 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.565+0000 7fbf77fff700 1 -- 172.21.15.60:0/3457248586 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf880513d0 con 0x7fbf90157140 2023-10-06T04:29:25.765 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.763+0000 7fbf9559d700 1 -- 172.21.15.60:0/3457248586 --> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf9005f230 con 0x7fbf7c066f30 2023-10-06T04:29:25.774 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.773+0000 7fbf77fff700 1 -- 172.21.15.60:0/3457248586 <== mgr.4098 v2:172.21.15.60:6832/85285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311190 (secure 0 0 0) 0x7fbf9005f230 con 0x7fbf7c066f30 2023-10-06T04:29:25.778 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:25.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.778+0000 7fbf9559d700 1 -- 172.21.15.60:0/3457248586 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf7c066f30 msgr2=0x7fbf7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:25.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.778+0000 7fbf9559d700 1 --2- 172.21.15.60:0/3457248586 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf7c066f30 0x7fbf7c0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbf90088840 tx=0x7fbf80016000 comp rx=0 tx=0).stop 2023-10-06T04:29:25.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.778+0000 7fbf9559d700 1 -- 172.21.15.60:0/3457248586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90157140 msgr2=0x7fbf90069f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:25.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.778+0000 7fbf9559d700 1 --2- 172.21.15.60:0/3457248586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90157140 0x7fbf90069f60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbf8800c930 tx=0x7fbf880026e0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.778+0000 7fbf9559d700 1 -- 172.21.15.60:0/3457248586 shutdown_connections 2023-10-06T04:29:25.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.778+0000 7fbf9559d700 1 --2- 172.21.15.60:0/3457248586 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf7c066f30 0x7fbf7c0693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.778+0000 7fbf9559d700 1 --2- 172.21.15.60:0/3457248586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf90157140 0x7fbf90069f60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.778+0000 7fbf9559d700 1 --2- 172.21.15.60:0/3457248586 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf900ad260 0x7fbf900cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.778+0000 7fbf9559d700 1 --2- 172.21.15.60:0/3457248586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf900af330 0x7fbf90150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:25.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.778+0000 7fbf9559d700 1 -- 172.21.15.60:0/3457248586 >> 172.21.15.60:0/3457248586 conn(0x7fbf90097410 msgr2=0x7fbf90151ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:25.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.778+0000 7fbf9559d700 1 -- 172.21.15.60:0/3457248586 shutdown_connections 2023-10-06T04:29:25.782 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:25.778+0000 7fbf9559d700 1 -- 172.21.15.60:0/3457248586 wait complete. 2023-10-06T04:29:25.782 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-06T04:29:25.796 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2023-10-06T04:29:25.327086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399508,"kb_used_data":4820,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752575212,"statfs":{"total":773094113280,"available":770637017088,"internally_reserved":0,"allocated":4935680,"data_stored":2844290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001342"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.964213+0000","last_change":"2023-10-06T04:29:20.952943+0000","last_active":"2023-10-06T04:29:20.964213+0000","last_peered":"2023-10-06T04:29:20.964213+0000","last_clean":"2023-10-06T04:29:20.964213+0000","last_became_active":"2023-10-06T04:29:20.952560+0000","last_became_peered":"2023-10-06T04:29:20.952560+0000","last_unstale":"2023-10-06T04:29:20.964213+0000","last_undegraded":"2023-10-06T04:29:20.964213+0000","last_fullsized":"2023-10-06T04:29:20.964213+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:40.463397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.976994+0000","last_change":"2023-10-06T04:29:20.974597+0000","last_active":"2023-10-06T04:29:20.976994+0000","last_peered":"2023-10-06T04:29:20.976994+0000","last_clean":"2023-10-06T04:29:20.976994+0000","last_became_active":"2023-10-06T04:29:20.974180+0000","last_became_peered":"2023-10-06T04:29:20.974180+0000","last_unstale":"2023-10-06T04:29:20.976994+0000","last_undegraded":"2023-10-06T04:29:20.976994+0000","last_fullsized":"2023-10-06T04:29:20.976994+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:40.463397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.965587+0000","last_change":"2023-10-06T04:29:20.962625+0000","last_active":"2023-10-06T04:29:20.965587+0000","last_peered":"2023-10-06T04:29:20.965587+0000","last_clean":"2023-10-06T04:29:20.965587+0000","last_became_active":"2023-10-06T04:29:20.962192+0000","last_became_peered":"2023-10-06T04:29:20.962192+0000","last_unstale":"2023-10-06T04:29:20.965587+0000","last_undegraded":"2023-10-06T04:29:20.965587+0000","last_fullsized":"2023-10-06T04:29:20.965587+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.596259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.982001+0000","last_change":"2023-10-06T04:29:20.979642+0000","last_active":"2023-10-06T04:29:20.982001+0000","last_peered":"2023-10-06T04:29:20.982001+0000","last_clean":"2023-10-06T04:29:20.982001+0000","last_became_active":"2023-10-06T04:29:20.972157+0000","last_became_peered":"2023-10-06T04:29:20.972157+0000","last_unstale":"2023-10-06T04:29:20.982001+0000","last_undegraded":"2023-10-06T04:29:20.982001+0000","last_fullsized":"2023-10-06T04:29:20.982001+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:43.090762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.979647+0000","last_change":"2023-10-06T04:29:20.975156+0000","last_active":"2023-10-06T04:29:20.979647+0000","last_peered":"2023-10-06T04:29:20.979647+0000","last_clean":"2023-10-06T04:29:20.979647+0000","last_became_active":"2023-10-06T04:29:20.974816+0000","last_became_peered":"2023-10-06T04:29:20.974816+0000","last_unstale":"2023-10-06T04:29:20.979647+0000","last_undegraded":"2023-10-06T04:29:20.979647+0000","last_fullsized":"2023-10-06T04:29:20.979647+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:53.723101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.977498+0000","last_change":"2023-10-06T04:29:20.962301+0000","last_active":"2023-10-06T04:29:20.977498+0000","last_peered":"2023-10-06T04:29:20.977498+0000","last_clean":"2023-10-06T04:29:20.977498+0000","last_became_active":"2023-10-06T04:29:20.961996+0000","last_became_peered":"2023-10-06T04:29:20.961996+0000","last_unstale":"2023-10-06T04:29:20.977498+0000","last_undegraded":"2023-10-06T04:29:20.977498+0000","last_fullsized":"2023-10-06T04:29:20.977498+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:42.375978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.968457+0000","last_change":"2023-10-06T04:29:20.960171+0000","last_active":"2023-10-06T04:29:20.968457+0000","last_peered":"2023-10-06T04:29:20.968457+0000","last_clean":"2023-10-06T04:29:20.968457+0000","last_became_active":"2023-10-06T04:29:20.959917+0000","last_became_peered":"2023-10-06T04:29:20.959917+0000","last_unstale":"2023-10-06T04:29:20.968457+0000","last_undegraded":"2023-10-06T04:29:20.968457+0000","last_fullsized":"2023-10-06T04:29:20.968457+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:26.880947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.982381+0000","last_change":"2023-10-06T04:29:20.980674+0000","last_active":"2023-10-06T04:29:20.982381+0000","last_peered":"2023-10-06T04:29:20.982381+0000","last_clean":"2023-10-06T04:29:20.982381+0000","last_became_active":"2023-10-06T04:29:20.980249+0000","last_became_peered":"2023-10-06T04:29:20.980249+0000","last_unstale":"2023-10-06T04:29:20.982381+0000","last_undegraded":"2023-10-06T04:29:20.982381+0000","last_fullsized":"2023-10-06T04:29:20.982381+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:26:00.297355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.977096+0000","last_change":"2023-10-06T04:29:20.972549+0000","last_active":"2023-10-06T04:29:20.977096+0000","last_peered":"2023-10-06T04:29:20.977096+0000","last_clean":"2023-10-06T04:29:20.977096+0000","last_became_active":"2023-10-06T04:29:20.972020+0000","last_became_peered":"2023-10-06T04:29:20.972020+0000","last_unstale":"2023-10-06T04:29:20.977096+0000","last_undegraded":"2023-10-06T04:29:20.977096+0000","last_fullsized":"2023-10-06T04:29:20.977096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:14.636495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.981960+0000","last_change":"2023-10-06T04:29:20.977720+0000","last_active":"2023-10-06T04:29:20.981960+0000","last_peered":"2023-10-06T04:29:20.981960+0000","last_clean":"2023-10-06T04:29:20.981960+0000","last_became_active":"2023-10-06T04:29:20.973769+0000","last_became_peered":"2023-10-06T04:29:20.973769+0000","last_unstale":"2023-10-06T04:29:20.981960+0000","last_undegraded":"2023-10-06T04:29:20.981960+0000","last_fullsized":"2023-10-06T04:29:20.981960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:39.762449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.979838+0000","last_change":"2023-10-06T04:29:20.976638+0000","last_active":"2023-10-06T04:29:20.979838+0000","last_peered":"2023-10-06T04:29:20.979838+0000","last_clean":"2023-10-06T04:29:20.979838+0000","last_became_active":"2023-10-06T04:29:20.973472+0000","last_became_peered":"2023-10-06T04:29:20.973472+0000","last_unstale":"2023-10-06T04:29:20.979838+0000","last_undegraded":"2023-10-06T04:29:20.979838+0000","last_fullsized":"2023-10-06T04:29:20.979838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:43.594556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.961811+0000","last_change":"2023-10-06T04:29:20.955637+0000","last_active":"2023-10-06T04:29:20.961811+0000","last_peered":"2023-10-06T04:29:20.961811+0000","last_clean":"2023-10-06T04:29:20.961811+0000","last_became_active":"2023-10-06T04:29:20.955406+0000","last_became_peered":"2023-10-06T04:29:20.955406+0000","last_unstale":"2023-10-06T04:29:20.961811+0000","last_undegraded":"2023-10-06T04:29:20.961811+0000","last_fullsized":"2023-10-06T04:29:20.961811+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:53.154688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.968144+0000","last_change":"2023-10-06T04:29:20.963847+0000","last_active":"2023-10-06T04:29:20.968144+0000","last_peered":"2023-10-06T04:29:20.968144+0000","last_clean":"2023-10-06T04:29:20.968144+0000","last_became_active":"2023-10-06T04:29:20.963572+0000","last_became_peered":"2023-10-06T04:29:20.963572+0000","last_unstale":"2023-10-06T04:29:20.968144+0000","last_undegraded":"2023-10-06T04:29:20.968144+0000","last_fullsized":"2023-10-06T04:29:20.968144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:02.717283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.977658+0000","last_change":"2023-10-06T04:29:20.973535+0000","last_active":"2023-10-06T04:29:20.977658+0000","last_peered":"2023-10-06T04:29:20.977658+0000","last_clean":"2023-10-06T04:29:20.977658+0000","last_became_active":"2023-10-06T04:29:20.972774+0000","last_became_peered":"2023-10-06T04:29:20.972774+0000","last_unstale":"2023-10-06T04:29:20.977658+0000","last_undegraded":"2023-10-06T04:29:20.977658+0000","last_fullsized":"2023-10-06T04:29:20.977658+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:10.643109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.954817+0000","last_change":"2023-10-06T04:29:20.947359+0000","last_active":"2023-10-06T04:29:20.954817+0000","last_peered":"2023-10-06T04:29:20.954817+0000","last_clean":"2023-10-06T04:29:20.954817+0000","last_became_active":"2023-10-06T04:29:20.947008+0000","last_became_peered":"2023-10-06T04:29:20.947008+0000","last_unstale":"2023-10-06T04:29:20.954817+0000","last_undegraded":"2023-10-06T04:29:20.954817+0000","last_fullsized":"2023-10-06T04:29:20.954817+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:55.458018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.984745+0000","last_change":"2023-10-06T04:29:20.982132+0000","last_active":"2023-10-06T04:29:20.984745+0000","last_peered":"2023-10-06T04:29:20.984745+0000","last_clean":"2023-10-06T04:29:20.984745+0000","last_became_active":"2023-10-06T04:29:20.981840+0000","last_became_peered":"2023-10-06T04:29:20.981840+0000","last_unstale":"2023-10-06T04:29:20.984745+0000","last_undegraded":"2023-10-06T04:29:20.984745+0000","last_fullsized":"2023-10-06T04:29:20.984745+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:40.463397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.953112+0000","last_change":"2023-10-06T04:29:20.948737+0000","last_active":"2023-10-06T04:29:20.953112+0000","last_peered":"2023-10-06T04:29:20.953112+0000","last_clean":"2023-10-06T04:29:20.953112+0000","last_became_active":"2023-10-06T04:29:20.948479+0000","last_became_peered":"2023-10-06T04:29:20.948479+0000","last_unstale":"2023-10-06T04:29:20.953112+0000","last_undegraded":"2023-10-06T04:29:20.953112+0000","last_fullsized":"2023-10-06T04:29:20.953112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:21.986141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.979381+0000","last_change":"2023-10-06T04:29:20.973339+0000","last_active":"2023-10-06T04:29:20.979381+0000","last_peered":"2023-10-06T04:29:20.979381+0000","last_clean":"2023-10-06T04:29:20.979381+0000","last_became_active":"2023-10-06T04:29:20.973040+0000","last_became_peered":"2023-10-06T04:29:20.973040+0000","last_unstale":"2023-10-06T04:29:20.979381+0000","last_undegraded":"2023-10-06T04:29:20.979381+0000","last_fullsized":"2023-10-06T04:29:20.979381+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:11.597592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.975055+0000","last_change":"2023-10-06T04:29:20.973389+0000","last_active":"2023-10-06T04:29:20.975055+0000","last_peered":"2023-10-06T04:29:20.975055+0000","last_clean":"2023-10-06T04:29:20.975055+0000","last_became_active":"2023-10-06T04:29:20.972903+0000","last_became_peered":"2023-10-06T04:29:20.972903+0000","last_unstale":"2023-10-06T04:29:20.975055+0000","last_undegraded":"2023-10-06T04:29:20.975055+0000","last_fullsized":"2023-10-06T04:29:20.975055+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:40.854552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.974478+0000","last_change":"2023-10-06T04:29:20.973164+0000","last_active":"2023-10-06T04:29:20.974478+0000","last_peered":"2023-10-06T04:29:20.974478+0000","last_clean":"2023-10-06T04:29:20.974478+0000","last_became_active":"2023-10-06T04:29:20.972888+0000","last_became_peered":"2023-10-06T04:29:20.972888+0000","last_unstale":"2023-10-06T04:29:20.974478+0000","last_undegraded":"2023-10-06T04:29:20.974478+0000","last_fullsized":"2023-10-06T04:29:20.974478+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:54.797902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.954093+0000","last_change":"2023-10-06T04:29:20.946619+0000","last_active":"2023-10-06T04:29:20.954093+0000","last_peered":"2023-10-06T04:29:20.954093+0000","last_clean":"2023-10-06T04:29:20.954093+0000","last_became_active":"2023-10-06T04:29:20.946267+0000","last_became_peered":"2023-10-06T04:29:20.946267+0000","last_unstale":"2023-10-06T04:29:20.954093+0000","last_undegraded":"2023-10-06T04:29:20.954093+0000","last_fullsized":"2023-10-06T04:29:20.954093+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.596259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.976921+0000","last_change":"2023-10-06T04:29:20.973163+0000","last_active":"2023-10-06T04:29:20.976921+0000","last_peered":"2023-10-06T04:29:20.976921+0000","last_clean":"2023-10-06T04:29:20.976921+0000","last_became_active":"2023-10-06T04:29:20.971350+0000","last_became_peered":"2023-10-06T04:29:20.971350+0000","last_unstale":"2023-10-06T04:29:20.976921+0000","last_undegraded":"2023-10-06T04:29:20.976921+0000","last_fullsized":"2023-10-06T04:29:20.976921+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:52.731879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.964391+0000","last_change":"2023-10-06T04:29:20.960715+0000","last_active":"2023-10-06T04:29:20.964391+0000","last_peered":"2023-10-06T04:29:20.964391+0000","last_clean":"2023-10-06T04:29:20.964391+0000","last_became_active":"2023-10-06T04:29:20.960216+0000","last_became_peered":"2023-10-06T04:29:20.960216+0000","last_unstale":"2023-10-06T04:29:20.964391+0000","last_undegraded":"2023-10-06T04:29:20.964391+0000","last_fullsized":"2023-10-06T04:29:20.964391+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:53.154688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.958452+0000","last_change":"2023-10-06T04:29:20.953528+0000","last_active":"2023-10-06T04:29:20.958452+0000","last_peered":"2023-10-06T04:29:20.958452+0000","last_clean":"2023-10-06T04:29:20.958452+0000","last_became_active":"2023-10-06T04:29:20.953286+0000","last_became_peered":"2023-10-06T04:29:20.953286+0000","last_unstale":"2023-10-06T04:29:20.958452+0000","last_undegraded":"2023-10-06T04:29:20.958452+0000","last_fullsized":"2023-10-06T04:29:20.958452+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:26.880947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.959672+0000","last_change":"2023-10-06T04:29:20.957726+0000","last_active":"2023-10-06T04:29:20.959672+0000","last_peered":"2023-10-06T04:29:20.959672+0000","last_clean":"2023-10-06T04:29:20.959672+0000","last_became_active":"2023-10-06T04:29:20.957380+0000","last_became_peered":"2023-10-06T04:29:20.957380+0000","last_unstale":"2023-10-06T04:29:20.959672+0000","last_undegraded":"2023-10-06T04:29:20.959672+0000","last_fullsized":"2023-10-06T04:29:20.959672+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:25.193855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.962829+0000","last_change":"2023-10-06T04:29:20.961403+0000","last_active":"2023-10-06T04:29:20.962829+0000","last_peered":"2023-10-06T04:29:20.962829+0000","last_clean":"2023-10-06T04:29:20.962829+0000","last_became_active":"2023-10-06T04:29:20.961065+0000","last_became_peered":"2023-10-06T04:29:20.961065+0000","last_unstale":"2023-10-06T04:29:20.962829+0000","last_undegraded":"2023-10-06T04:29:20.962829+0000","last_fullsized":"2023-10-06T04:29:20.962829+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:27.489372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.957612+0000","last_change":"2023-10-06T04:29:20.950263+0000","last_active":"2023-10-06T04:29:20.957612+0000","last_peered":"2023-10-06T04:29:20.957612+0000","last_clean":"2023-10-06T04:29:20.957612+0000","last_became_active":"2023-10-06T04:29:20.949988+0000","last_became_peered":"2023-10-06T04:29:20.949988+0000","last_unstale":"2023-10-06T04:29:20.957612+0000","last_undegraded":"2023-10-06T04:29:20.957612+0000","last_fullsized":"2023-10-06T04:29:20.957612+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:29.436142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.961828+0000","last_change":"2023-10-06T04:29:20.957016+0000","last_active":"2023-10-06T04:29:20.961828+0000","last_peered":"2023-10-06T04:29:20.961828+0000","last_clean":"2023-10-06T04:29:20.961828+0000","last_became_active":"2023-10-06T04:29:20.956568+0000","last_became_peered":"2023-10-06T04:29:20.956568+0000","last_unstale":"2023-10-06T04:29:20.961828+0000","last_undegraded":"2023-10-06T04:29:20.961828+0000","last_fullsized":"2023-10-06T04:29:20.961828+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:26.880947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.959616+0000","last_change":"2023-10-06T04:29:20.957661+0000","last_active":"2023-10-06T04:29:20.959616+0000","last_peered":"2023-10-06T04:29:20.959616+0000","last_clean":"2023-10-06T04:29:20.959616+0000","last_became_active":"2023-10-06T04:29:20.957392+0000","last_became_peered":"2023-10-06T04:29:20.957392+0000","last_unstale":"2023-10-06T04:29:20.959616+0000","last_undegraded":"2023-10-06T04:29:20.959616+0000","last_fullsized":"2023-10-06T04:29:20.959616+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:47.684868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.963758+0000","last_change":"2023-10-06T04:29:20.953588+0000","last_active":"2023-10-06T04:29:20.963758+0000","last_peered":"2023-10-06T04:29:20.963758+0000","last_clean":"2023-10-06T04:29:20.963758+0000","last_became_active":"2023-10-06T04:29:20.953216+0000","last_became_peered":"2023-10-06T04:29:20.953216+0000","last_unstale":"2023-10-06T04:29:20.963758+0000","last_undegraded":"2023-10-06T04:29:20.963758+0000","last_fullsized":"2023-10-06T04:29:20.963758+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:42.375978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.956109+0000","last_change":"2023-10-06T04:29:20.954624+0000","last_active":"2023-10-06T04:29:20.956109+0000","last_peered":"2023-10-06T04:29:20.956109+0000","last_clean":"2023-10-06T04:29:20.956109+0000","last_became_active":"2023-10-06T04:29:20.954320+0000","last_became_peered":"2023-10-06T04:29:20.954320+0000","last_unstale":"2023-10-06T04:29:20.956109+0000","last_undegraded":"2023-10-06T04:29:20.956109+0000","last_fullsized":"2023-10-06T04:29:20.956109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:15:14.636495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.956302+0000","last_change":"2023-10-06T04:29:20.952683+0000","last_active":"2023-10-06T04:29:20.956302+0000","last_peered":"2023-10-06T04:29:20.956302+0000","last_clean":"2023-10-06T04:29:20.956302+0000","last_became_active":"2023-10-06T04:29:20.952360+0000","last_became_peered":"2023-10-06T04:29:20.952360+0000","last_unstale":"2023-10-06T04:29:20.956302+0000","last_undegraded":"2023-10-06T04:29:20.956302+0000","last_fullsized":"2023-10-06T04:29:20.956302+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:04.738765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.969637+0000","last_change":"2023-10-06T04:29:20.967165+0000","last_active":"2023-10-06T04:29:20.969637+0000","last_peered":"2023-10-06T04:29:20.969637+0000","last_clean":"2023-10-06T04:29:20.969637+0000","last_became_active":"2023-10-06T04:29:20.966937+0000","last_became_peered":"2023-10-06T04:29:20.966937+0000","last_unstale":"2023-10-06T04:29:20.969637+0000","last_undegraded":"2023-10-06T04:29:20.969637+0000","last_fullsized":"2023-10-06T04:29:20.969637+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:05.708620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"39'4","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.975466+0000","last_change":"2023-10-06T04:29:19.960343+0000","last_active":"2023-10-06T04:29:20.975466+0000","last_peered":"2023-10-06T04:29:20.975466+0000","last_clean":"2023-10-06T04:29:20.975466+0000","last_became_active":"2023-10-06T04:29:19.960092+0000","last_became_peered":"2023-10-06T04:29:19.960092+0000","last_unstale":"2023-10-06T04:29:20.975466+0000","last_undegraded":"2023-10-06T04:29:20.975466+0000","last_fullsized":"2023-10-06T04:29:20.975466+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:58.041281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.957568+0000","last_change":"2023-10-06T04:29:20.949071+0000","last_active":"2023-10-06T04:29:20.957568+0000","last_peered":"2023-10-06T04:29:20.957568+0000","last_clean":"2023-10-06T04:29:20.957568+0000","last_became_active":"2023-10-06T04:29:20.948778+0000","last_became_peered":"2023-10-06T04:29:20.948778+0000","last_unstale":"2023-10-06T04:29:20.957568+0000","last_undegraded":"2023-10-06T04:29:20.957568+0000","last_fullsized":"2023-10-06T04:29:20.957568+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:59.048514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.971745+0000","last_change":"2023-10-06T04:29:19.955833+0000","last_active":"2023-10-06T04:29:20.971745+0000","last_peered":"2023-10-06T04:29:20.971745+0000","last_clean":"2023-10-06T04:29:20.971745+0000","last_became_active":"2023-10-06T04:29:19.955571+0000","last_became_peered":"2023-10-06T04:29:19.955571+0000","last_unstale":"2023-10-06T04:29:20.971745+0000","last_undegraded":"2023-10-06T04:29:20.971745+0000","last_fullsized":"2023-10-06T04:29:20.971745+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:09.733322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.961844+0000","last_change":"2023-10-06T04:29:20.957179+0000","last_active":"2023-10-06T04:29:20.961844+0000","last_peered":"2023-10-06T04:29:20.961844+0000","last_clean":"2023-10-06T04:29:20.961844+0000","last_became_active":"2023-10-06T04:29:20.956798+0000","last_became_peered":"2023-10-06T04:29:20.956798+0000","last_unstale":"2023-10-06T04:29:20.961844+0000","last_undegraded":"2023-10-06T04:29:20.961844+0000","last_fullsized":"2023-10-06T04:29:20.961844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:40.854552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"39'2","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.974564+0000","last_change":"2023-10-06T04:29:19.956958+0000","last_active":"2023-10-06T04:29:20.974564+0000","last_peered":"2023-10-06T04:29:20.974564+0000","last_clean":"2023-10-06T04:29:20.974564+0000","last_became_active":"2023-10-06T04:29:19.956301+0000","last_became_peered":"2023-10-06T04:29:19.956301+0000","last_unstale":"2023-10-06T04:29:20.974564+0000","last_undegraded":"2023-10-06T04:29:20.974564+0000","last_fullsized":"2023-10-06T04:29:20.974564+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:53.790669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.953316+0000","last_change":"2023-10-06T04:29:20.950925+0000","last_active":"2023-10-06T04:29:20.953316+0000","last_peered":"2023-10-06T04:29:20.953316+0000","last_clean":"2023-10-06T04:29:20.953316+0000","last_became_active":"2023-10-06T04:29:20.950551+0000","last_became_peered":"2023-10-06T04:29:20.950551+0000","last_unstale":"2023-10-06T04:29:20.953316+0000","last_undegraded":"2023-10-06T04:29:20.953316+0000","last_fullsized":"2023-10-06T04:29:20.953316+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:19.209091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"39'2","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.971262+0000","last_change":"2023-10-06T04:29:19.954785+0000","last_active":"2023-10-06T04:29:20.971262+0000","last_peered":"2023-10-06T04:29:20.971262+0000","last_clean":"2023-10-06T04:29:20.971262+0000","last_became_active":"2023-10-06T04:29:19.954501+0000","last_became_peered":"2023-10-06T04:29:19.954501+0000","last_unstale":"2023-10-06T04:29:20.971262+0000","last_undegraded":"2023-10-06T04:29:20.971262+0000","last_fullsized":"2023-10-06T04:29:20.971262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:01.710050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.953464+0000","last_change":"2023-10-06T04:29:20.949580+0000","last_active":"2023-10-06T04:29:20.953464+0000","last_peered":"2023-10-06T04:29:20.953464+0000","last_clean":"2023-10-06T04:29:20.953464+0000","last_became_active":"2023-10-06T04:29:20.949242+0000","last_became_peered":"2023-10-06T04:29:20.949242+0000","last_unstale":"2023-10-06T04:29:20.953464+0000","last_undegraded":"2023-10-06T04:29:20.953464+0000","last_fullsized":"2023-10-06T04:29:20.953464+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:01.675130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.975950+0000","last_change":"2023-10-06T04:29:19.955398+0000","last_active":"2023-10-06T04:29:20.975950+0000","last_peered":"2023-10-06T04:29:20.975950+0000","last_clean":"2023-10-06T04:29:20.975950+0000","last_became_active":"2023-10-06T04:29:19.954572+0000","last_became_peered":"2023-10-06T04:29:19.954572+0000","last_unstale":"2023-10-06T04:29:20.975950+0000","last_undegraded":"2023-10-06T04:29:20.975950+0000","last_fullsized":"2023-10-06T04:29:20.975950+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:25.873714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.980044+0000","last_change":"2023-10-06T04:29:20.977014+0000","last_active":"2023-10-06T04:29:20.980044+0000","last_peered":"2023-10-06T04:29:20.980044+0000","last_clean":"2023-10-06T04:29:20.980044+0000","last_became_active":"2023-10-06T04:29:20.971523+0000","last_became_peered":"2023-10-06T04:29:20.971523+0000","last_unstale":"2023-10-06T04:29:20.980044+0000","last_undegraded":"2023-10-06T04:29:20.980044+0000","last_fullsized":"2023-10-06T04:29:20.980044+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:15.478637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.969036+0000","last_change":"2023-10-06T04:29:19.953629+0000","last_active":"2023-10-06T04:29:20.969036+0000","last_peered":"2023-10-06T04:29:20.969036+0000","last_clean":"2023-10-06T04:29:20.969036+0000","last_became_active":"2023-10-06T04:29:19.953353+0000","last_became_peered":"2023-10-06T04:29:19.953353+0000","last_unstale":"2023-10-06T04:29:20.969036+0000","last_undegraded":"2023-10-06T04:29:20.969036+0000","last_fullsized":"2023-10-06T04:29:20.969036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:14.471404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.982364+0000","last_change":"2023-10-06T04:29:20.980621+0000","last_active":"2023-10-06T04:29:20.982364+0000","last_peered":"2023-10-06T04:29:20.982364+0000","last_clean":"2023-10-06T04:29:20.982364+0000","last_became_active":"2023-10-06T04:29:20.980047+0000","last_became_peered":"2023-10-06T04:29:20.980047+0000","last_unstale":"2023-10-06T04:29:20.982364+0000","last_undegraded":"2023-10-06T04:29:20.982364+0000","last_fullsized":"2023-10-06T04:29:20.982364+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:55.458018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.944102+0000","last_change":"2023-10-06T04:29:19.945919+0000","last_active":"2023-10-06T04:29:20.944102+0000","last_peered":"2023-10-06T04:29:20.944102+0000","last_clean":"2023-10-06T04:29:20.944102+0000","last_became_active":"2023-10-06T04:29:19.945654+0000","last_became_peered":"2023-10-06T04:29:19.945654+0000","last_unstale":"2023-10-06T04:29:20.944102+0000","last_undegraded":"2023-10-06T04:29:20.944102+0000","last_fullsized":"2023-10-06T04:29:20.944102+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:54.212557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.959569+0000","last_change":"2023-10-06T04:29:20.954154+0000","last_active":"2023-10-06T04:29:20.959569+0000","last_peered":"2023-10-06T04:29:20.959569+0000","last_clean":"2023-10-06T04:29:20.959569+0000","last_became_active":"2023-10-06T04:29:20.953890+0000","last_became_peered":"2023-10-06T04:29:20.953890+0000","last_unstale":"2023-10-06T04:29:20.959569+0000","last_undegraded":"2023-10-06T04:29:20.959569+0000","last_fullsized":"2023-10-06T04:29:20.959569+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:32.693860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.950487+0000","last_change":"2023-10-06T04:29:19.948591+0000","last_active":"2023-10-06T04:29:20.950487+0000","last_peered":"2023-10-06T04:29:20.950487+0000","last_clean":"2023-10-06T04:29:20.950487+0000","last_became_active":"2023-10-06T04:29:19.948237+0000","last_became_peered":"2023-10-06T04:29:19.948237+0000","last_unstale":"2023-10-06T04:29:20.950487+0000","last_undegraded":"2023-10-06T04:29:20.950487+0000","last_fullsized":"2023-10-06T04:29:20.950487+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:54.212557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.985387+0000","last_change":"2023-10-06T04:29:20.982986+0000","last_active":"2023-10-06T04:29:20.985387+0000","last_peered":"2023-10-06T04:29:20.985387+0000","last_clean":"2023-10-06T04:29:20.985387+0000","last_became_active":"2023-10-06T04:29:20.982713+0000","last_became_peered":"2023-10-06T04:29:20.982713+0000","last_unstale":"2023-10-06T04:29:20.985387+0000","last_undegraded":"2023-10-06T04:29:20.985387+0000","last_fullsized":"2023-10-06T04:29:20.985387+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:00:08.438332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.940783+0000","last_change":"2023-10-06T04:29:19.944125+0000","last_active":"2023-10-06T04:29:20.940783+0000","last_peered":"2023-10-06T04:29:20.940783+0000","last_clean":"2023-10-06T04:29:20.940783+0000","last_became_active":"2023-10-06T04:29:19.943761+0000","last_became_peered":"2023-10-06T04:29:19.943761+0000","last_unstale":"2023-10-06T04:29:20.940783+0000","last_undegraded":"2023-10-06T04:29:20.940783+0000","last_fullsized":"2023-10-06T04:29:20.940783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:55.055120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.968003+0000","last_change":"2023-10-06T04:29:20.959043+0000","last_active":"2023-10-06T04:29:20.968003+0000","last_peered":"2023-10-06T04:29:20.968003+0000","last_clean":"2023-10-06T04:29:20.968003+0000","last_became_active":"2023-10-06T04:29:20.958633+0000","last_became_peered":"2023-10-06T04:29:20.958633+0000","last_unstale":"2023-10-06T04:29:20.968003+0000","last_undegraded":"2023-10-06T04:29:20.968003+0000","last_fullsized":"2023-10-06T04:29:20.968003+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:12.366347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.954036+0000","last_change":"2023-10-06T04:29:19.951684+0000","last_active":"2023-10-06T04:29:20.954036+0000","last_peered":"2023-10-06T04:29:20.954036+0000","last_clean":"2023-10-06T04:29:20.954036+0000","last_became_active":"2023-10-06T04:29:19.951311+0000","last_became_peered":"2023-10-06T04:29:19.951311+0000","last_unstale":"2023-10-06T04:29:20.954036+0000","last_undegraded":"2023-10-06T04:29:20.954036+0000","last_fullsized":"2023-10-06T04:29:20.954036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:18.201858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.976397+0000","last_change":"2023-10-06T04:29:20.963387+0000","last_active":"2023-10-06T04:29:20.976397+0000","last_peered":"2023-10-06T04:29:20.976397+0000","last_clean":"2023-10-06T04:29:20.976397+0000","last_became_active":"2023-10-06T04:29:20.963042+0000","last_became_peered":"2023-10-06T04:29:20.963042+0000","last_unstale":"2023-10-06T04:29:20.976397+0000","last_undegraded":"2023-10-06T04:29:20.976397+0000","last_fullsized":"2023-10-06T04:29:20.976397+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:43.090762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"39'3","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.971408+0000","last_change":"2023-10-06T04:29:19.954152+0000","last_active":"2023-10-06T04:29:20.971408+0000","last_peered":"2023-10-06T04:29:20.971408+0000","last_clean":"2023-10-06T04:29:20.971408+0000","last_became_active":"2023-10-06T04:29:19.953496+0000","last_became_peered":"2023-10-06T04:29:19.953496+0000","last_unstale":"2023-10-06T04:29:20.971408+0000","last_undegraded":"2023-10-06T04:29:20.971408+0000","last_fullsized":"2023-10-06T04:29:20.971408+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:29:04.701388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.964851+0000","last_change":"2023-10-06T04:29:20.954566+0000","last_active":"2023-10-06T04:29:20.964851+0000","last_peered":"2023-10-06T04:29:20.964851+0000","last_clean":"2023-10-06T04:29:20.964851+0000","last_became_active":"2023-10-06T04:29:20.954288+0000","last_became_peered":"2023-10-06T04:29:20.954288+0000","last_unstale":"2023-10-06T04:29:20.964851+0000","last_undegraded":"2023-10-06T04:29:20.964851+0000","last_fullsized":"2023-10-06T04:29:20.964851+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:53.723101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"39'6","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.980719+0000","last_change":"2023-10-06T04:29:19.945506+0000","last_active":"2023-10-06T04:29:20.980719+0000","last_peered":"2023-10-06T04:29:20.980719+0000","last_clean":"2023-10-06T04:29:20.980719+0000","last_became_active":"2023-10-06T04:29:19.945143+0000","last_became_peered":"2023-10-06T04:29:19.945143+0000","last_unstale":"2023-10-06T04:29:20.980719+0000","last_undegraded":"2023-10-06T04:29:20.980719+0000","last_fullsized":"2023-10-06T04:29:20.980719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:37.559909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.975138+0000","last_change":"2023-10-06T04:29:20.973686+0000","last_active":"2023-10-06T04:29:20.975138+0000","last_peered":"2023-10-06T04:29:20.975138+0000","last_clean":"2023-10-06T04:29:20.975138+0000","last_became_active":"2023-10-06T04:29:20.973458+0000","last_became_peered":"2023-10-06T04:29:20.973458+0000","last_unstale":"2023-10-06T04:29:20.975138+0000","last_undegraded":"2023-10-06T04:29:20.975138+0000","last_fullsized":"2023-10-06T04:29:20.975138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:12.366347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"39'2","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.977866+0000","last_change":"2023-10-06T04:29:19.955038+0000","last_active":"2023-10-06T04:29:20.977866+0000","last_peered":"2023-10-06T04:29:20.977866+0000","last_clean":"2023-10-06T04:29:20.977866+0000","last_became_active":"2023-10-06T04:29:19.951365+0000","last_became_peered":"2023-10-06T04:29:19.951365+0000","last_unstale":"2023-10-06T04:29:20.977866+0000","last_undegraded":"2023-10-06T04:29:20.977866+0000","last_fullsized":"2023-10-06T04:29:20.977866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:52.147455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.979876+0000","last_change":"2023-10-06T04:29:20.976769+0000","last_active":"2023-10-06T04:29:20.979876+0000","last_peered":"2023-10-06T04:29:20.979876+0000","last_clean":"2023-10-06T04:29:20.979876+0000","last_became_active":"2023-10-06T04:29:20.971325+0000","last_became_peered":"2023-10-06T04:29:20.971325+0000","last_unstale":"2023-10-06T04:29:20.979876+0000","last_undegraded":"2023-10-06T04:29:20.979876+0000","last_fullsized":"2023-10-06T04:29:20.979876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:10.740555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.947869+0000","last_change":"2023-10-06T04:29:19.950209+0000","last_active":"2023-10-06T04:29:20.947869+0000","last_peered":"2023-10-06T04:29:20.947869+0000","last_clean":"2023-10-06T04:29:20.947869+0000","last_became_active":"2023-10-06T04:29:19.949884+0000","last_became_peered":"2023-10-06T04:29:19.949884+0000","last_unstale":"2023-10-06T04:29:20.947869+0000","last_undegraded":"2023-10-06T04:29:20.947869+0000","last_fullsized":"2023-10-06T04:29:20.947869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:54.212557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.975932+0000","last_change":"2023-10-06T04:29:20.963404+0000","last_active":"2023-10-06T04:29:20.975932+0000","last_peered":"2023-10-06T04:29:20.975932+0000","last_clean":"2023-10-06T04:29:20.975932+0000","last_became_active":"2023-10-06T04:29:20.963002+0000","last_became_peered":"2023-10-06T04:29:20.963002+0000","last_unstale":"2023-10-06T04:29:20.975932+0000","last_undegraded":"2023-10-06T04:29:20.975932+0000","last_fullsized":"2023-10-06T04:29:20.975932+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:27.472749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.935976+0000","last_change":"2023-10-06T04:29:19.958147+0000","last_active":"2023-10-06T04:29:20.935976+0000","last_peered":"2023-10-06T04:29:20.935976+0000","last_clean":"2023-10-06T04:29:20.935976+0000","last_became_active":"2023-10-06T04:29:19.956815+0000","last_became_peered":"2023-10-06T04:29:19.956815+0000","last_unstale":"2023-10-06T04:29:20.935976+0000","last_undegraded":"2023-10-06T04:29:20.935976+0000","last_fullsized":"2023-10-06T04:29:20.935976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:52.715868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.968438+0000","last_change":"2023-10-06T04:29:20.959996+0000","last_active":"2023-10-06T04:29:20.968438+0000","last_peered":"2023-10-06T04:29:20.968438+0000","last_clean":"2023-10-06T04:29:20.968438+0000","last_became_active":"2023-10-06T04:29:20.959718+0000","last_became_peered":"2023-10-06T04:29:20.959718+0000","last_unstale":"2023-10-06T04:29:20.968438+0000","last_undegraded":"2023-10-06T04:29:20.968438+0000","last_fullsized":"2023-10-06T04:29:20.968438+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:40.854552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"39'8","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.985370+0000","last_change":"2023-10-06T04:29:19.950121+0000","last_active":"2023-10-06T04:29:20.985370+0000","last_peered":"2023-10-06T04:29:20.985370+0000","last_clean":"2023-10-06T04:29:20.985370+0000","last_became_active":"2023-10-06T04:29:19.949878+0000","last_became_peered":"2023-10-06T04:29:19.949878+0000","last_unstale":"2023-10-06T04:29:20.985370+0000","last_undegraded":"2023-10-06T04:29:20.985370+0000","last_fullsized":"2023-10-06T04:29:20.985370+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:20.170553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.962316+0000","last_change":"2023-10-06T04:29:20.960213+0000","last_active":"2023-10-06T04:29:20.962316+0000","last_peered":"2023-10-06T04:29:20.962316+0000","last_clean":"2023-10-06T04:29:20.962316+0000","last_became_active":"2023-10-06T04:29:20.959928+0000","last_became_peered":"2023-10-06T04:29:20.959928+0000","last_unstale":"2023-10-06T04:29:20.962316+0000","last_undegraded":"2023-10-06T04:29:20.962316+0000","last_fullsized":"2023-10-06T04:29:20.962316+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:03:10.766242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.978138+0000","last_change":"2023-10-06T04:29:19.959459+0000","last_active":"2023-10-06T04:29:20.978138+0000","last_peered":"2023-10-06T04:29:20.978138+0000","last_clean":"2023-10-06T04:29:20.978138+0000","last_became_active":"2023-10-06T04:29:19.959142+0000","last_became_peered":"2023-10-06T04:29:19.959142+0000","last_unstale":"2023-10-06T04:29:20.978138+0000","last_undegraded":"2023-10-06T04:29:20.978138+0000","last_fullsized":"2023-10-06T04:29:20.978138+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:34.124443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.981885+0000","last_change":"2023-10-06T04:29:20.977358+0000","last_active":"2023-10-06T04:29:20.981885+0000","last_peered":"2023-10-06T04:29:20.981885+0000","last_clean":"2023-10-06T04:29:20.981885+0000","last_became_active":"2023-10-06T04:29:20.971495+0000","last_became_peered":"2023-10-06T04:29:20.971495+0000","last_unstale":"2023-10-06T04:29:20.981885+0000","last_undegraded":"2023-10-06T04:29:20.981885+0000","last_fullsized":"2023-10-06T04:29:20.981885+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:21.596259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"39'2","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.971853+0000","last_change":"2023-10-06T04:29:19.945663+0000","last_active":"2023-10-06T04:29:20.971853+0000","last_peered":"2023-10-06T04:29:20.971853+0000","last_clean":"2023-10-06T04:29:20.971853+0000","last_became_active":"2023-10-06T04:29:19.945385+0000","last_became_peered":"2023-10-06T04:29:19.945385+0000","last_unstale":"2023-10-06T04:29:20.971853+0000","last_undegraded":"2023-10-06T04:29:20.971853+0000","last_fullsized":"2023-10-06T04:29:20.971853+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:26.465516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.958132+0000","last_change":"2023-10-06T04:29:20.952127+0000","last_active":"2023-10-06T04:29:20.958132+0000","last_peered":"2023-10-06T04:29:20.958132+0000","last_clean":"2023-10-06T04:29:20.958132+0000","last_became_active":"2023-10-06T04:29:20.951866+0000","last_became_peered":"2023-10-06T04:29:20.951866+0000","last_unstale":"2023-10-06T04:29:20.958132+0000","last_undegraded":"2023-10-06T04:29:20.958132+0000","last_fullsized":"2023-10-06T04:29:20.958132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:56.062352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"39'1","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.968762+0000","last_change":"2023-10-06T04:29:19.952172+0000","last_active":"2023-10-06T04:29:20.968762+0000","last_peered":"2023-10-06T04:29:20.968762+0000","last_clean":"2023-10-06T04:29:20.968762+0000","last_became_active":"2023-10-06T04:29:19.951870+0000","last_became_peered":"2023-10-06T04:29:19.951870+0000","last_unstale":"2023-10-06T04:29:20.968762+0000","last_undegraded":"2023-10-06T04:29:20.968762+0000","last_fullsized":"2023-10-06T04:29:20.968762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:18.201858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.960906+0000","last_change":"2023-10-06T04:29:20.958548+0000","last_active":"2023-10-06T04:29:20.960906+0000","last_peered":"2023-10-06T04:29:20.960906+0000","last_clean":"2023-10-06T04:29:20.960906+0000","last_became_active":"2023-10-06T04:29:20.957459+0000","last_became_peered":"2023-10-06T04:29:20.957459+0000","last_unstale":"2023-10-06T04:29:20.960906+0000","last_undegraded":"2023-10-06T04:29:20.960906+0000","last_fullsized":"2023-10-06T04:29:20.960906+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:21:09.535346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.936925+0000","last_change":"2023-10-06T04:29:19.958039+0000","last_active":"2023-10-06T04:29:20.936925+0000","last_peered":"2023-10-06T04:29:20.936925+0000","last_clean":"2023-10-06T04:29:20.936925+0000","last_became_active":"2023-10-06T04:29:19.956653+0000","last_became_peered":"2023-10-06T04:29:19.956653+0000","last_unstale":"2023-10-06T04:29:20.936925+0000","last_undegraded":"2023-10-06T04:29:20.936925+0000","last_fullsized":"2023-10-06T04:29:20.936925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:31.686627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.977508+0000","last_change":"2023-10-06T04:29:20.964068+0000","last_active":"2023-10-06T04:29:20.977508+0000","last_peered":"2023-10-06T04:29:20.977508+0000","last_clean":"2023-10-06T04:29:20.977508+0000","last_became_active":"2023-10-06T04:29:20.963792+0000","last_became_peered":"2023-10-06T04:29:20.963792+0000","last_unstale":"2023-10-06T04:29:20.977508+0000","last_undegraded":"2023-10-06T04:29:20.977508+0000","last_fullsized":"2023-10-06T04:29:20.977508+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:15.890405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"39'2","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.976208+0000","last_change":"2023-10-06T04:29:19.955237+0000","last_active":"2023-10-06T04:29:20.976208+0000","last_peered":"2023-10-06T04:29:20.976208+0000","last_clean":"2023-10-06T04:29:20.976208+0000","last_became_active":"2023-10-06T04:29:19.954244+0000","last_became_peered":"2023-10-06T04:29:19.954244+0000","last_unstale":"2023-10-06T04:29:20.976208+0000","last_undegraded":"2023-10-06T04:29:20.976208+0000","last_fullsized":"2023-10-06T04:29:20.976208+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:39.847320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.953259+0000","last_change":"2023-10-06T04:29:20.951805+0000","last_active":"2023-10-06T04:29:20.953259+0000","last_peered":"2023-10-06T04:29:20.953259+0000","last_clean":"2023-10-06T04:29:20.953259+0000","last_became_active":"2023-10-06T04:29:20.951392+0000","last_became_peered":"2023-10-06T04:29:20.951392+0000","last_unstale":"2023-10-06T04:29:20.953259+0000","last_undegraded":"2023-10-06T04:29:20.953259+0000","last_fullsized":"2023-10-06T04:29:20.953259+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:04:01.495970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.944262+0000","last_change":"2023-10-06T04:29:19.957127+0000","last_active":"2023-10-06T04:29:20.944262+0000","last_peered":"2023-10-06T04:29:20.944262+0000","last_clean":"2023-10-06T04:29:20.944262+0000","last_became_active":"2023-10-06T04:29:19.956848+0000","last_became_peered":"2023-10-06T04:29:19.956848+0000","last_unstale":"2023-10-06T04:29:20.944262+0000","last_undegraded":"2023-10-06T04:29:20.944262+0000","last_fullsized":"2023-10-06T04:29:20.944262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:20.170553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.957327+0000","last_change":"2023-10-06T04:29:20.953844+0000","last_active":"2023-10-06T04:29:20.957327+0000","last_peered":"2023-10-06T04:29:20.957327+0000","last_clean":"2023-10-06T04:29:20.957327+0000","last_became_active":"2023-10-06T04:29:20.953552+0000","last_became_peered":"2023-10-06T04:29:20.953552+0000","last_unstale":"2023-10-06T04:29:20.957327+0000","last_undegraded":"2023-10-06T04:29:20.957327+0000","last_fullsized":"2023-10-06T04:29:20.957327+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:16.091789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.950540+0000","last_change":"2023-10-06T04:29:19.950907+0000","last_active":"2023-10-06T04:29:20.950540+0000","last_peered":"2023-10-06T04:29:20.950540+0000","last_clean":"2023-10-06T04:29:20.950540+0000","last_became_active":"2023-10-06T04:29:19.950662+0000","last_became_peered":"2023-10-06T04:29:19.950662+0000","last_unstale":"2023-10-06T04:29:20.950540+0000","last_undegraded":"2023-10-06T04:29:20.950540+0000","last_fullsized":"2023-10-06T04:29:20.950540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:03.731532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.976698+0000","last_change":"2023-10-06T04:29:20.956372+0000","last_active":"2023-10-06T04:29:20.976698+0000","last_peered":"2023-10-06T04:29:20.976698+0000","last_clean":"2023-10-06T04:29:20.976698+0000","last_became_active":"2023-10-06T04:29:20.956070+0000","last_became_peered":"2023-10-06T04:29:20.956070+0000","last_unstale":"2023-10-06T04:29:20.976698+0000","last_undegraded":"2023-10-06T04:29:20.976698+0000","last_fullsized":"2023-10-06T04:29:20.976698+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:27.472749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.946603+0000","last_change":"2023-10-06T04:29:19.948477+0000","last_active":"2023-10-06T04:29:20.946603+0000","last_peered":"2023-10-06T04:29:20.946603+0000","last_clean":"2023-10-06T04:29:20.946603+0000","last_became_active":"2023-10-06T04:29:19.947560+0000","last_became_peered":"2023-10-06T04:29:19.947560+0000","last_unstale":"2023-10-06T04:29:20.946603+0000","last_undegraded":"2023-10-06T04:29:20.946603+0000","last_fullsized":"2023-10-06T04:29:20.946603+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:20.170553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.976291+0000","last_change":"2023-10-06T04:29:20.962584+0000","last_active":"2023-10-06T04:29:20.976291+0000","last_peered":"2023-10-06T04:29:20.976291+0000","last_clean":"2023-10-06T04:29:20.976291+0000","last_became_active":"2023-10-06T04:29:20.962190+0000","last_became_peered":"2023-10-06T04:29:20.962190+0000","last_unstale":"2023-10-06T04:29:20.976291+0000","last_undegraded":"2023-10-06T04:29:20.976291+0000","last_fullsized":"2023-10-06T04:29:20.976291+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:46.300365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.940281+0000","last_change":"2023-10-06T04:29:19.957600+0000","last_active":"2023-10-06T04:29:20.940281+0000","last_peered":"2023-10-06T04:29:20.940281+0000","last_clean":"2023-10-06T04:29:20.940281+0000","last_became_active":"2023-10-06T04:29:19.957339+0000","last_became_peered":"2023-10-06T04:29:19.957339+0000","last_unstale":"2023-10-06T04:29:20.940281+0000","last_undegraded":"2023-10-06T04:29:20.940281+0000","last_fullsized":"2023-10-06T04:29:20.940281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:58:34.467453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.940309+0000","last_change":"2023-10-06T04:28:00.325832+0000","last_active":"2023-10-06T04:29:20.940309+0000","last_peered":"2023-10-06T04:29:20.940309+0000","last_clean":"2023-10-06T04:29:20.940309+0000","last_became_active":"2023-10-06T04:28:00.325466+0000","last_became_peered":"2023-10-06T04:28:00.325466+0000","last_unstale":"2023-10-06T04:29:20.940309+0000","last_undegraded":"2023-10-06T04:29:20.940309+0000","last_fullsized":"2023-10-06T04:29:20.940309+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.977486+0000","last_change":"2023-10-06T04:29:20.960307+0000","last_active":"2023-10-06T04:29:20.977486+0000","last_peered":"2023-10-06T04:29:20.977486+0000","last_clean":"2023-10-06T04:29:20.977486+0000","last_became_active":"2023-10-06T04:29:20.960030+0000","last_became_peered":"2023-10-06T04:29:20.960030+0000","last_unstale":"2023-10-06T04:29:20.977486+0000","last_undegraded":"2023-10-06T04:29:20.977486+0000","last_fullsized":"2023-10-06T04:29:20.977486+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:39.762449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.945525+0000","last_change":"2023-10-06T04:29:19.954482+0000","last_active":"2023-10-06T04:29:20.945525+0000","last_peered":"2023-10-06T04:29:20.945525+0000","last_clean":"2023-10-06T04:29:20.945525+0000","last_became_active":"2023-10-06T04:29:19.954173+0000","last_became_peered":"2023-10-06T04:29:19.954173+0000","last_unstale":"2023-10-06T04:29:20.945525+0000","last_undegraded":"2023-10-06T04:29:20.945525+0000","last_fullsized":"2023-10-06T04:29:20.945525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:53.790669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":31,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.937019+0000","last_change":"2023-10-06T04:28:00.175241+0000","last_active":"2023-10-06T04:29:20.937019+0000","last_peered":"2023-10-06T04:29:20.937019+0000","last_clean":"2023-10-06T04:29:20.937019+0000","last_became_active":"2023-10-06T04:28:00.174814+0000","last_became_peered":"2023-10-06T04:28:00.174814+0000","last_unstale":"2023-10-06T04:29:20.937019+0000","last_undegraded":"2023-10-06T04:29:20.937019+0000","last_fullsized":"2023-10-06T04:29:20.937019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.964838+0000","last_change":"2023-10-06T04:29:20.953782+0000","last_active":"2023-10-06T04:29:20.964838+0000","last_peered":"2023-10-06T04:29:20.964838+0000","last_clean":"2023-10-06T04:29:20.964838+0000","last_became_active":"2023-10-06T04:29:20.953542+0000","last_became_peered":"2023-10-06T04:29:20.953542+0000","last_unstale":"2023-10-06T04:29:20.964838+0000","last_undegraded":"2023-10-06T04:29:20.964838+0000","last_fullsized":"2023-10-06T04:29:20.964838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:53.154688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.942077+0000","last_change":"2023-10-06T04:29:19.953598+0000","last_active":"2023-10-06T04:29:20.942077+0000","last_peered":"2023-10-06T04:29:20.942077+0000","last_clean":"2023-10-06T04:29:20.942077+0000","last_became_active":"2023-10-06T04:29:19.953341+0000","last_became_peered":"2023-10-06T04:29:19.953341+0000","last_unstale":"2023-10-06T04:29:20.942077+0000","last_undegraded":"2023-10-06T04:29:20.942077+0000","last_fullsized":"2023-10-06T04:29:20.942077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:28:26.482139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.941990+0000","last_change":"2023-10-06T04:28:00.175086+0000","last_active":"2023-10-06T04:29:20.941990+0000","last_peered":"2023-10-06T04:29:20.941990+0000","last_clean":"2023-10-06T04:29:20.941990+0000","last_became_active":"2023-10-06T04:28:00.174735+0000","last_became_peered":"2023-10-06T04:28:00.174735+0000","last_unstale":"2023-10-06T04:29:20.941990+0000","last_undegraded":"2023-10-06T04:29:20.941990+0000","last_fullsized":"2023-10-06T04:29:20.941990+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":180,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.946749+0000","last_change":"2023-10-06T04:28:01.176177+0000","last_active":"2023-10-06T04:29:20.946749+0000","last_peered":"2023-10-06T04:29:20.946749+0000","last_clean":"2023-10-06T04:29:20.946749+0000","last_became_active":"2023-10-06T04:28:01.175255+0000","last_became_peered":"2023-10-06T04:28:01.175255+0000","last_unstale":"2023-10-06T04:29:20.946749+0000","last_undegraded":"2023-10-06T04:29:20.946749+0000","last_fullsized":"2023-10-06T04:29:20.946749+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:00.161020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:00.161020+0000","last_clean_scrub_stamp":"2023-10-06T04:28:00.161020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:29.208067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.981927+0000","last_change":"2023-10-06T04:29:20.977552+0000","last_active":"2023-10-06T04:29:20.981927+0000","last_peered":"2023-10-06T04:29:20.981927+0000","last_clean":"2023-10-06T04:29:20.981927+0000","last_became_active":"2023-10-06T04:29:20.971310+0000","last_became_peered":"2023-10-06T04:29:20.971310+0000","last_unstale":"2023-10-06T04:29:20.981927+0000","last_undegraded":"2023-10-06T04:29:20.981927+0000","last_fullsized":"2023-10-06T04:29:20.981927+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:15.890405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.946409+0000","last_change":"2023-10-06T04:29:19.954369+0000","last_active":"2023-10-06T04:29:20.946409+0000","last_peered":"2023-10-06T04:29:20.946409+0000","last_clean":"2023-10-06T04:29:20.946409+0000","last_became_active":"2023-10-06T04:29:19.953864+0000","last_became_peered":"2023-10-06T04:29:19.953864+0000","last_unstale":"2023-10-06T04:29:20.946409+0000","last_undegraded":"2023-10-06T04:29:20.946409+0000","last_fullsized":"2023-10-06T04:29:20.946409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:18.201858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":31,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.947959+0000","last_change":"2023-10-06T04:28:00.344573+0000","last_active":"2023-10-06T04:29:20.947959+0000","last_peered":"2023-10-06T04:29:20.947959+0000","last_clean":"2023-10-06T04:29:20.947959+0000","last_became_active":"2023-10-06T04:28:00.344324+0000","last_became_peered":"2023-10-06T04:28:00.344324+0000","last_unstale":"2023-10-06T04:29:20.947959+0000","last_undegraded":"2023-10-06T04:29:20.947959+0000","last_fullsized":"2023-10-06T04:29:20.947959+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:24.184826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.977826+0000","last_change":"2023-10-06T04:29:20.973298+0000","last_active":"2023-10-06T04:29:20.977826+0000","last_peered":"2023-10-06T04:29:20.977826+0000","last_clean":"2023-10-06T04:29:20.977826+0000","last_became_active":"2023-10-06T04:29:20.973008+0000","last_became_peered":"2023-10-06T04:29:20.973008+0000","last_unstale":"2023-10-06T04:29:20.977826+0000","last_undegraded":"2023-10-06T04:29:20.977826+0000","last_fullsized":"2023-10-06T04:29:20.977826+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:46.300365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"39'2","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.976334+0000","last_change":"2023-10-06T04:29:19.960521+0000","last_active":"2023-10-06T04:29:20.976334+0000","last_peered":"2023-10-06T04:29:20.976334+0000","last_clean":"2023-10-06T04:29:20.976334+0000","last_became_active":"2023-10-06T04:29:19.960208+0000","last_became_peered":"2023-10-06T04:29:19.960208+0000","last_unstale":"2023-10-06T04:29:20.976334+0000","last_undegraded":"2023-10-06T04:29:20.976334+0000","last_fullsized":"2023-10-06T04:29:20.976334+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:01.710050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.946690+0000","last_change":"2023-10-06T04:28:00.343571+0000","last_active":"2023-10-06T04:29:20.946690+0000","last_peered":"2023-10-06T04:29:20.946690+0000","last_clean":"2023-10-06T04:29:20.946690+0000","last_became_active":"2023-10-06T04:28:00.343268+0000","last_became_peered":"2023-10-06T04:28:00.343268+0000","last_unstale":"2023-10-06T04:29:20.946690+0000","last_undegraded":"2023-10-06T04:29:20.946690+0000","last_fullsized":"2023-10-06T04:29:20.946690+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:00.931419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.975007+0000","last_change":"2023-10-06T04:29:20.973137+0000","last_active":"2023-10-06T04:29:20.975007+0000","last_peered":"2023-10-06T04:29:20.975007+0000","last_clean":"2023-10-06T04:29:20.975007+0000","last_became_active":"2023-10-06T04:29:20.972862+0000","last_became_peered":"2023-10-06T04:29:20.972862+0000","last_unstale":"2023-10-06T04:29:20.975007+0000","last_undegraded":"2023-10-06T04:29:20.975007+0000","last_fullsized":"2023-10-06T04:29:20.975007+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:53.723101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.936623+0000","last_change":"2023-10-06T04:29:19.950465+0000","last_active":"2023-10-06T04:29:20.936623+0000","last_peered":"2023-10-06T04:29:20.936623+0000","last_clean":"2023-10-06T04:29:20.936623+0000","last_became_active":"2023-10-06T04:29:19.950136+0000","last_became_peered":"2023-10-06T04:29:19.950136+0000","last_unstale":"2023-10-06T04:29:20.936623+0000","last_undegraded":"2023-10-06T04:29:20.936623+0000","last_fullsized":"2023-10-06T04:29:20.936623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:24.186622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.944051+0000","last_change":"2023-10-06T04:28:00.344460+0000","last_active":"2023-10-06T04:29:20.944051+0000","last_peered":"2023-10-06T04:29:20.944051+0000","last_clean":"2023-10-06T04:29:20.944051+0000","last_became_active":"2023-10-06T04:28:00.343280+0000","last_became_peered":"2023-10-06T04:28:00.343280+0000","last_unstale":"2023-10-06T04:29:20.944051+0000","last_undegraded":"2023-10-06T04:29:20.944051+0000","last_fullsized":"2023-10-06T04:29:20.944051+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.961779+0000","last_change":"2023-10-06T04:29:20.953345+0000","last_active":"2023-10-06T04:29:20.961779+0000","last_peered":"2023-10-06T04:29:20.961779+0000","last_clean":"2023-10-06T04:29:20.961779+0000","last_became_active":"2023-10-06T04:29:20.953095+0000","last_became_peered":"2023-10-06T04:29:20.953095+0000","last_unstale":"2023-10-06T04:29:20.961779+0000","last_undegraded":"2023-10-06T04:29:20.961779+0000","last_fullsized":"2023-10-06T04:29:20.961779+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:59.534059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.941529+0000","last_change":"2023-10-06T04:29:19.955782+0000","last_active":"2023-10-06T04:29:20.941529+0000","last_peered":"2023-10-06T04:29:20.941529+0000","last_clean":"2023-10-06T04:29:20.941529+0000","last_became_active":"2023-10-06T04:29:19.955515+0000","last_became_peered":"2023-10-06T04:29:19.955515+0000","last_unstale":"2023-10-06T04:29:20.941529+0000","last_undegraded":"2023-10-06T04:29:20.941529+0000","last_fullsized":"2023-10-06T04:29:20.941529+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:14:03.731532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.941311+0000","last_change":"2023-10-06T04:28:00.343592+0000","last_active":"2023-10-06T04:29:20.941311+0000","last_peered":"2023-10-06T04:29:20.941311+0000","last_clean":"2023-10-06T04:29:20.941311+0000","last_became_active":"2023-10-06T04:28:00.343313+0000","last_became_peered":"2023-10-06T04:28:00.343313+0000","last_unstale":"2023-10-06T04:29:20.941311+0000","last_undegraded":"2023-10-06T04:29:20.941311+0000","last_fullsized":"2023-10-06T04:29:20.941311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:24.184826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.963718+0000","last_change":"2023-10-06T04:29:20.956035+0000","last_active":"2023-10-06T04:29:20.963718+0000","last_peered":"2023-10-06T04:29:20.963718+0000","last_clean":"2023-10-06T04:29:20.963718+0000","last_became_active":"2023-10-06T04:29:20.955652+0000","last_became_peered":"2023-10-06T04:29:20.955652+0000","last_unstale":"2023-10-06T04:29:20.963718+0000","last_undegraded":"2023-10-06T04:29:20.963718+0000","last_fullsized":"2023-10-06T04:29:20.963718+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:19.923876+0000","last_clean_scrub_stamp":"2023-10-06T04:29:19.923876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:52:03.168373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.953754+0000","last_change":"2023-10-06T04:29:19.960614+0000","last_active":"2023-10-06T04:29:20.953754+0000","last_peered":"2023-10-06T04:29:20.953754+0000","last_clean":"2023-10-06T04:29:20.953754+0000","last_became_active":"2023-10-06T04:29:19.960207+0000","last_became_peered":"2023-10-06T04:29:19.960207+0000","last_unstale":"2023-10-06T04:29:20.953754+0000","last_undegraded":"2023-10-06T04:29:20.953754+0000","last_fullsized":"2023-10-06T04:29:20.953754+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:29:18.916643+0000","last_clean_scrub_stamp":"2023-10-06T04:29:18.916643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:01.710050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T04:29:20.942366+0000","last_change":"2023-10-06T04:28:00.174563+0000","last_active":"2023-10-06T04:29:20.942366+0000","last_peered":"2023-10-06T04:29:20.942366+0000","last_clean":"2023-10-06T04:29:20.942366+0000","last_became_active":"2023-10-06T04:28:00.174265+0000","last_became_peered":"2023-10-06T04:28:00.174265+0000","last_unstale":"2023-10-06T04:29:20.942366+0000","last_undegraded":"2023-10-06T04:29:20.942366+0000","last_fullsized":"2023-10-06T04:29:20.942366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:00.931419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298320,"kb_used_data":1032,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073520,"statfs":{"total":96636764160,"available":96331284480,"internally_reserved":0,"allocated":1056768,"data_stored":797459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:28:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":4.3070000000000004,"5min":4.3070000000000004,"15min":4.3070000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":8.1609999999999996,"5min":8.1609999999999996,"15min":8.1609999999999996},"last":0.71999999999999997}]},{"osd":1,"last update":"Fri Oct 6 04:28:58 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":5.0730000000000004,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":6.3079999999999998,"5min":6.3079999999999998,"15min":6.3079999999999998},"last":0.67800000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:28:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":4.4619999999999997,"5min":4.4619999999999997,"15min":4.4619999999999997},"last":0.747},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":8.2840000000000007,"5min":8.2840000000000007,"15min":8.2840000000000007},"last":0.60999999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:28:58 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.7130000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.80600000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:28:58 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":8.0890000000000004,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":3.3980000000000001,"5min":3.3980000000000001,"15min":3.3980000000000001},"last":0.73899999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:28:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":6.8200000000000003,"5min":6.8200000000000003,"15min":6.8200000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":8.3439999999999994,"5min":8.3439999999999994,"15min":8.3439999999999994},"last":0.77900000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:28:58 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":6.2839999999999998,"5min":6.2839999999999998,"15min":6.2839999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":4.1420000000000003,"5min":4.1420000000000003,"15min":4.1420000000000003},"last":0.60199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297748,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074092,"statfs":{"total":96636764160,"available":96331870208,"internally_reserved":0,"allocated":471040,"data_stored":208623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.54300000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1,"5min":1,"15min":1},"last":0.69499999999999995}]},{"osd":2,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.66600000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.751}]},{"osd":5,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.79600000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":6.6139999999999999,"5min":6.6139999999999999,"15min":6.6139999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":165.47,"5min":165.47,"15min":165.47},"last":0.81799999999999995},{"interface":"front","average":{"1min":6.6020000000000003,"5min":6.6020000000000003,"15min":6.6020000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":165.51300000000001,"5min":165.51300000000001,"15min":165.51300000000001},"last":0.879}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302420,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069420,"statfs":{"total":96636764160,"available":96327086080,"internally_reserved":0,"allocated":1060864,"data_stored":798417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.38100000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.437},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.40200000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.42799999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.504},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.63600000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:28:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.67200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301836,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070004,"statfs":{"total":96636764160,"available":96327684096,"internally_reserved":0,"allocated":462848,"data_stored":207035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.35499999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.40699999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.38100000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.81000000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.871}]},{"osd":7,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.83899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301848,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069992,"statfs":{"total":96636764160,"available":96327671808,"internally_reserved":0,"allocated":475136,"data_stored":208559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.503}]},{"osd":1,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.45300000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.82299999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.84899999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.95399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301844,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069996,"statfs":{"total":96636764160,"available":96327675904,"internally_reserved":0,"allocated":471040,"data_stored":207611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.55900000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.49399999999999999}]},{"osd":2,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.44},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.60799999999999998}]},{"osd":4,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.66300000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:29:01 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.54800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297752,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074088,"statfs":{"total":96636764160,"available":96331866112,"internally_reserved":0,"allocated":475136,"data_stored":209515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.016},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.82599999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.095},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.96199999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.89500000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.873}]},{"osd":5,"last update":"Fri Oct 6 04:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":0.497}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":462848,"data_stored":207071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.60199999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.77100000000000002}]},{"osd":3,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.69299999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:29:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.75600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:29:25.804 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T04:29:25.804 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T04:29:26.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.032+0000 7f5c05f9d700 1 Processor -- start 2023-10-06T04:29:26.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.032+0000 7f5c05f9d700 1 -- start start 2023-10-06T04:29:26.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.034+0000 7f5c05f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5c00067bd0 0x7f5c0015c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:26.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.034+0000 7f5c05f9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c000ac8a0 con 0x7f5c0015ca70 2023-10-06T04:29:26.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.034+0000 7f5c05f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c000acb40 con 0x7f5c00067800 2023-10-06T04:29:26.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.034+0000 7f5c05f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c000b2e40 con 0x7f5c00067bd0 2023-10-06T04:29:26.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.034+0000 7f5c0579c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5c0015ca70 0x7f5c000adbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41382/0 (socket says 172.21.15.60:41382) 2023-10-06T04:29:26.035 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.034+0000 7f5c0579c700 1 -- 172.21.15.60:0/2573564758 learned_addr learned my addr 172.21.15.60:0/2573564758 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:29:26.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.034+0000 7f5bfffff700 1 --2- 172.21.15.60:0/2573564758 >> v2:172.21.15.135:3300/0 conn(0x7f5c00067bd0 0x7f5c0015c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:26.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.034+0000 7f5bff7fe700 1 -- 172.21.15.60:0/2573564758 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 454976809 0 0) 0x7f5c000ac8a0 con 0x7f5c0015ca70 2023-10-06T04:29:26.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.034+0000 7f5bff7fe700 1 -- 172.21.15.60:0/2573564758 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bf0003570 con 0x7f5c0015ca70 2023-10-06T04:29:26.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.035+0000 7f5bfffff700 1 -- 172.21.15.60:0/2573564758 >> v1:172.21.15.135:6789/0 conn(0x7f5c00067800 legacy=0x7f5c000afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:26.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.035+0000 7f5bff7fe700 1 -- 172.21.15.60:0/2573564758 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3636802138 0 0) 0x7f5bf0003570 con 0x7f5c0015ca70 2023-10-06T04:29:26.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.035+0000 7f5bfffff700 1 -- 172.21.15.60:0/2573564758 >> v1:172.21.15.60:6789/0 conn(0x7f5c0015ca70 legacy=0x7f5c000adbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:26.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.035+0000 7f5bfffff700 1 -- 172.21.15.60:0/2573564758 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c000ace20 con 0x7f5c00067bd0 2023-10-06T04:29:26.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.035+0000 7f5bfffff700 1 --2- 172.21.15.60:0/2573564758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c00067bd0 0x7f5c0015c530 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0098e0 tx=0x7f5bec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1849a098b2b1cb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:26.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.035+0000 7f5bff7fe700 1 -- 172.21.15.60:0/2573564758 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf80017f0 con 0x7f5c00067bd0 2023-10-06T04:29:26.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.035+0000 7f5bff7fe700 1 -- 172.21.15.60:0/2573564758 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bec011420 con 0x7f5c00067bd0 2023-10-06T04:29:26.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.035+0000 7f5bff7fe700 1 -- 172.21.15.60:0/2573564758 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec0117c0 con 0x7f5c00067bd0 2023-10-06T04:29:26.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.036+0000 7f5c05f9d700 1 -- 172.21.15.60:0/2573564758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c00067bd0 msgr2=0x7f5c0015c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:26.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.036+0000 7f5c05f9d700 1 --2- 172.21.15.60:0/2573564758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c00067bd0 0x7f5c0015c530 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0098e0 tx=0x7f5bec0091a0 comp rx=0 tx=0).stop 2023-10-06T04:29:26.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.036+0000 7f5c05f9d700 1 -- 172.21.15.60:0/2573564758 shutdown_connections 2023-10-06T04:29:26.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.036+0000 7f5c05f9d700 1 --2- 172.21.15.60:0/2573564758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c00067bd0 0x7f5c0015c530 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:26.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.036+0000 7f5c05f9d700 1 -- 172.21.15.60:0/2573564758 >> 172.21.15.60:0/2573564758 conn(0x7f5c00069190 msgr2=0x7f5c000ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:26.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.036+0000 7f5c05f9d700 1 -- 172.21.15.60:0/2573564758 shutdown_connections 2023-10-06T04:29:26.039 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.036+0000 7f5c05f9d700 1 -- 172.21.15.60:0/2573564758 wait complete. 2023-10-06T04:29:26.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.037+0000 7f5c05f9d700 1 Processor -- start 2023-10-06T04:29:26.040 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.038+0000 7f5c05f9d700 1 -- start start 2023-10-06T04:29:26.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.038+0000 7f5c05f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c00067800 0x7f5c00159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:26.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.039+0000 7f5c05f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c00067bd0 0x7f5c000c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:26.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.039+0000 7f5c05f9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c0015ca70 0x7f5c00169830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:26.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.039+0000 7f5c05f9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0015ce40 con 0x7f5c0015ca70 2023-10-06T04:29:26.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.039+0000 7f5c05f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0015d9c0 con 0x7f5c00067800 2023-10-06T04:29:26.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.039+0000 7f5c05f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0015d090 con 0x7f5c00067bd0 2023-10-06T04:29:26.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.039+0000 7f5c0579c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c0015ca70 0x7f5c00169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:26.041 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.039+0000 7f5c0579c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c0015ca70 0x7f5c00169830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42604/0 (socket says 172.21.15.60:42604) 2023-10-06T04:29:26.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.039+0000 7f5c0579c700 1 -- 172.21.15.60:0/1770155501 learned_addr learned my addr 172.21.15.60:0/1770155501 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:26.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.039+0000 7f5c04f9b700 1 --2- 172.21.15.60:0/1770155501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c00067800 0x7f5c00159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:26.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.039+0000 7f5bfffff700 1 --2- 172.21.15.60:0/1770155501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c00067bd0 0x7f5c000c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:26.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.039+0000 7f5c0579c700 1 -- 172.21.15.60:0/1770155501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c00067bd0 msgr2=0x7f5c000c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:26.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.039+0000 7f5c0579c700 1 --2- 172.21.15.60:0/1770155501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c00067bd0 0x7f5c000c4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:26.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.039+0000 7f5c0579c700 1 -- 172.21.15.60:0/1770155501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c00067800 msgr2=0x7f5c00159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:26.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.039+0000 7f5c0579c700 1 --2- 172.21.15.60:0/1770155501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c00067800 0x7f5c00159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:26.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.039+0000 7f5c0579c700 1 -- 172.21.15.60:0/1770155501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec009420 con 0x7f5c0015ca70 2023-10-06T04:29:26.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.040+0000 7f5c0579c700 1 --2- 172.21.15.60:0/1770155501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c0015ca70 0x7f5c00169830 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800cae0 tx=0x7f5bf8007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:26.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.040+0000 7f5bfcff9700 1 -- 172.21.15.60:0/1770155501 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8004dc0 con 0x7f5c0015ca70 2023-10-06T04:29:26.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.040+0000 7f5bfcff9700 1 -- 172.21.15.60:0/1770155501 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf800a5d0 con 0x7f5c0015ca70 2023-10-06T04:29:26.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.040+0000 7f5bfcff9700 1 -- 172.21.15.60:0/1770155501 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf800a990 con 0x7f5c0015ca70 2023-10-06T04:29:26.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.040+0000 7f5c05f9d700 1 -- 172.21.15.60:0/1770155501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0015d370 con 0x7f5c0015ca70 2023-10-06T04:29:26.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.040+0000 7f5c05f9d700 1 -- 172.21.15.60:0/1770155501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c00159eb0 con 0x7f5c0015ca70 2023-10-06T04:29:26.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.041+0000 7f5c05f9d700 1 -- 172.21.15.60:0/1770155501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0015db30 con 0x7f5c0015ca70 2023-10-06T04:29:26.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.042+0000 7f5bfcff9700 1 -- 172.21.15.60:0/1770155501 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5bf8007150 con 0x7f5c0015ca70 2023-10-06T04:29:26.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.043+0000 7f5bfcff9700 1 --2- 172.21.15.60:0/1770155501 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5be4066f30 0x7f5be40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:26.045 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.043+0000 7f5bfcff9700 1 -- 172.21.15.60:0/1770155501 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5bf8084200 con 0x7f5c0015ca70 2023-10-06T04:29:26.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.043+0000 7f5c04f9b700 1 --2- 172.21.15.60:0/1770155501 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5be4066f30 0x7f5be40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:26.046 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.043+0000 7f5c04f9b700 1 --2- 172.21.15.60:0/1770155501 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5be4066f30 0x7f5be40693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4003a80 tx=0x7f5bf4007ec0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:26.048 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.047+0000 7f5bfcff9700 1 -- 172.21.15.60:0/1770155501 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5bf80511b0 con 0x7f5c0015ca70 2023-10-06T04:29:26.329 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.328+0000 7f5c05f9d700 1 -- 172.21.15.60:0/1770155501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5c0005f230 con 0x7f5c0015ca70 2023-10-06T04:29:26.333 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.332+0000 7f5bfcff9700 1 -- 172.21.15.60:0/1770155501 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f5bf80547d0 con 0x7f5c0015ca70 2023-10-06T04:29:26.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.334+0000 7f5c05f9d700 1 -- 172.21.15.60:0/1770155501 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5be4066f30 msgr2=0x7f5be40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:26.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.334+0000 7f5c05f9d700 1 --2- 172.21.15.60:0/1770155501 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5be4066f30 0x7f5be40693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4003a80 tx=0x7f5bf4007ec0 comp rx=0 tx=0).stop 2023-10-06T04:29:26.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.334+0000 7f5c05f9d700 1 -- 172.21.15.60:0/1770155501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c0015ca70 msgr2=0x7f5c00169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:26.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.334+0000 7f5c05f9d700 1 --2- 172.21.15.60:0/1770155501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c0015ca70 0x7f5c00169830 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800cae0 tx=0x7f5bf8007ca0 comp rx=0 tx=0).stop 2023-10-06T04:29:26.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.334+0000 7f5c05f9d700 1 -- 172.21.15.60:0/1770155501 shutdown_connections 2023-10-06T04:29:26.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.334+0000 7f5c05f9d700 1 --2- 172.21.15.60:0/1770155501 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5be4066f30 0x7f5be40693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:26.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.334+0000 7f5c05f9d700 1 --2- 172.21.15.60:0/1770155501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c0015ca70 0x7f5c00169830 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:26.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.334+0000 7f5c05f9d700 1 --2- 172.21.15.60:0/1770155501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c00067800 0x7f5c00159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:26.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.334+0000 7f5c05f9d700 1 --2- 172.21.15.60:0/1770155501 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c00067bd0 0x7f5c000c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:26.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.334+0000 7f5c05f9d700 1 -- 172.21.15.60:0/1770155501 >> 172.21.15.60:0/1770155501 conn(0x7f5c00069190 msgr2=0x7f5c0015a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:26.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.334+0000 7f5c05f9d700 1 -- 172.21.15.60:0/1770155501 shutdown_connections 2023-10-06T04:29:26.338 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.334+0000 7f5c05f9d700 1 -- 172.21.15.60:0/1770155501 wait complete. 2023-10-06T04:29:26.338 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2023-10-06T04:29:26.353 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:29:26.540 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.539+0000 7fb7bd19d700 1 Processor -- start 2023-10-06T04:29:26.541 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.539+0000 7fb7bd19d700 1 -- start start 2023-10-06T04:29:26.542 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.540+0000 7fb7bd19d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb7b806a590 0x7fb7b81536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:26.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.540+0000 7fb7bd19d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb7b806a960 0x7fb7b8153c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:26.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.540+0000 7fb7bd19d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b80c9cc0 con 0x7fb7b806df50 2023-10-06T04:29:26.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.540+0000 7fb7bd19d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b806f560 con 0x7fb7b806a960 2023-10-06T04:29:26.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.540+0000 7fb7bd19d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b806eaa0 con 0x7fb7b806a590 2023-10-06T04:29:26.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.541+0000 7fb7b77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb7b806a960 0x7fb7b8153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:26.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.541+0000 7fb7bc99c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb7b806df50 0x7fb7b806e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41384/0 (socket says 172.21.15.60:41384) 2023-10-06T04:29:26.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.541+0000 7fb7bc99c700 1 -- 172.21.15.60:0/4153657668 learned_addr learned my addr 172.21.15.60:0/4153657668 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:29:26.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.541+0000 7fb7b7fff700 1 --2- 172.21.15.60:0/4153657668 >> v2:172.21.15.135:3300/0 conn(0x7fb7b806a590 0x7fb7b81536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:26.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.541+0000 7fb7b77fe700 1 -- 172.21.15.60:0/4153657668 >> v2:172.21.15.135:3300/0 conn(0x7fb7b806a590 msgr2=0x7fb7b81536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:26.543 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.541+0000 7fb7b77fe700 1 --2- 172.21.15.60:0/4153657668 >> v2:172.21.15.135:3300/0 conn(0x7fb7b806a590 0x7fb7b81536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:26.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.541+0000 7fb7b77fe700 1 -- 172.21.15.60:0/4153657668 >> v1:172.21.15.60:6789/0 conn(0x7fb7b806df50 legacy=0x7fb7b806e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:26.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.541+0000 7fb7b77fe700 1 -- 172.21.15.60:0/4153657668 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b80c6710 con 0x7fb7b806a960 2023-10-06T04:29:26.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.541+0000 7fb7b6ffd700 1 -- 172.21.15.60:0/4153657668 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045721958 0 0) 0x7fb7b80c9cc0 con 0x7fb7b806df50 2023-10-06T04:29:26.544 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.541+0000 7fb7b77fe700 1 --2- 172.21.15.60:0/4153657668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b806a960 0x7fb7b8153c30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb7b806c660 tx=0x7fb7ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd78cbbb952ee7f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:26.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.542+0000 7fb7b6ffd700 1 -- 172.21.15.60:0/4153657668 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac009e80 con 0x7fb7b806a960 2023-10-06T04:29:26.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.542+0000 7fb7b6ffd700 1 -- 172.21.15.60:0/4153657668 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ac00b820 con 0x7fb7b806a960 2023-10-06T04:29:26.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.542+0000 7fb7b6ffd700 1 -- 172.21.15.60:0/4153657668 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac00bba0 con 0x7fb7b806a960 2023-10-06T04:29:26.545 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.542+0000 7fb7bd19d700 1 -- 172.21.15.60:0/4153657668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b806a960 msgr2=0x7fb7b8153c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:26.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.542+0000 7fb7bd19d700 1 --2- 172.21.15.60:0/4153657668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b806a960 0x7fb7b8153c30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb7b806c660 tx=0x7fb7ac0091a0 comp rx=0 tx=0).stop 2023-10-06T04:29:26.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.542+0000 7fb7bd19d700 1 -- 172.21.15.60:0/4153657668 shutdown_connections 2023-10-06T04:29:26.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.542+0000 7fb7bd19d700 1 --2- 172.21.15.60:0/4153657668 >> v2:172.21.15.135:3300/0 conn(0x7fb7b806a590 0x7fb7b81536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:26.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.542+0000 7fb7bd19d700 1 --2- 172.21.15.60:0/4153657668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b806a960 0x7fb7b8153c30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:26.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.542+0000 7fb7bd19d700 1 -- 172.21.15.60:0/4153657668 >> 172.21.15.60:0/4153657668 conn(0x7fb7b8068080 msgr2=0x7fb7b80cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:26.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.542+0000 7fb7bd19d700 1 -- 172.21.15.60:0/4153657668 shutdown_connections 2023-10-06T04:29:26.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.542+0000 7fb7bd19d700 1 -- 172.21.15.60:0/4153657668 wait complete. 2023-10-06T04:29:26.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.544+0000 7fb7bd19d700 1 Processor -- start 2023-10-06T04:29:26.546 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.544+0000 7fb7bd19d700 1 -- start start 2023-10-06T04:29:26.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.545+0000 7fb7bd19d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7b806a590 0x7fb7b80adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:26.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.545+0000 7fb7bd19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7b806a960 0x7fb7b8157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:26.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.545+0000 7fb7bd19d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b806df50 0x7fb7b8152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:26.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.545+0000 7fb7bd19d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b8157700 con 0x7fb7b806df50 2023-10-06T04:29:26.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.545+0000 7fb7bd19d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b816ce00 con 0x7fb7b806a590 2023-10-06T04:29:26.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.545+0000 7fb7bd19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b816d0e0 con 0x7fb7b806a960 2023-10-06T04:29:26.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.545+0000 7fb7bc99c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b806df50 0x7fb7b8152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:26.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.545+0000 7fb7bc99c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b806df50 0x7fb7b8152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42618/0 (socket says 172.21.15.60:42618) 2023-10-06T04:29:26.548 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.545+0000 7fb7bc99c700 1 -- 172.21.15.60:0/1013972592 learned_addr learned my addr 172.21.15.60:0/1013972592 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:26.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.546+0000 7fb7bc99c700 1 -- 172.21.15.60:0/1013972592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7b806a960 msgr2=0x7fb7b8157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:26.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.546+0000 7fb7bc99c700 1 --2- 172.21.15.60:0/1013972592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7b806a960 0x7fb7b8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:26.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.546+0000 7fb7bc99c700 1 -- 172.21.15.60:0/1013972592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7b806a590 msgr2=0x7fb7b80adec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:26.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.546+0000 7fb7bc99c700 1 --2- 172.21.15.60:0/1013972592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7b806a590 0x7fb7b80adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:26.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.546+0000 7fb7bc99c700 1 -- 172.21.15.60:0/1013972592 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ac009420 con 0x7fb7b806df50 2023-10-06T04:29:26.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.546+0000 7fb7bc99c700 1 --2- 172.21.15.60:0/1013972592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b806df50 0x7fb7b8152af0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000cc90 tx=0x7fb7b0001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:26.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.546+0000 7fb79ffff700 1 -- 172.21.15.60:0/1013972592 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b000cea0 con 0x7fb7b806df50 2023-10-06T04:29:26.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.546+0000 7fb79ffff700 1 -- 172.21.15.60:0/1013972592 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b000ab70 con 0x7fb7b806df50 2023-10-06T04:29:26.549 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.546+0000 7fb7bd19d700 1 -- 172.21.15.60:0/1013972592 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b816d3c0 con 0x7fb7b806df50 2023-10-06T04:29:26.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.546+0000 7fb79ffff700 1 -- 172.21.15.60:0/1013972592 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b00070f0 con 0x7fb7b806df50 2023-10-06T04:29:26.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.546+0000 7fb7bd19d700 1 -- 172.21.15.60:0/1013972592 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b8153030 con 0x7fb7b806df50 2023-10-06T04:29:26.550 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.547+0000 7fb7bd19d700 1 -- 172.21.15.60:0/1013972592 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b805f230 con 0x7fb7b806df50 2023-10-06T04:29:26.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.548+0000 7fb79ffff700 1 -- 172.21.15.60:0/1013972592 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb7b00074a0 con 0x7fb7b806df50 2023-10-06T04:29:26.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.549+0000 7fb79ffff700 1 --2- 172.21.15.60:0/1013972592 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb7a4066f30 0x7fb7a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:26.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.549+0000 7fb79ffff700 1 -- 172.21.15.60:0/1013972592 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb7b0084cf0 con 0x7fb7b806df50 2023-10-06T04:29:26.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.549+0000 7fb7b7fff700 1 --2- 172.21.15.60:0/1013972592 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb7a4066f30 0x7fb7a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:26.551 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.550+0000 7fb7b7fff700 1 --2- 172.21.15.60:0/1013972592 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb7a4066f30 0x7fb7a40693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8009a40 tx=0x7fb7a8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:26.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.553+0000 7fb79ffff700 1 -- 172.21.15.60:0/1013972592 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7b0051ca0 con 0x7fb7b806df50 2023-10-06T04:29:26.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.801+0000 7fb7bd19d700 1 -- 172.21.15.60:0/1013972592 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7b80c7f40 con 0x7fb7b806df50 2023-10-06T04:29:26.803 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.802+0000 7fb79ffff700 1 -- 172.21.15.60:0/1013972592 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fb7b00552c0 con 0x7fb7b806df50 2023-10-06T04:29:26.803 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:26.804 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1681836371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1681836371},{"type":"v1","addr":"172.21.15.135:6834","nonce":1681836371}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/823204172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":823204172},{"type":"v1","addr":"172.21.15.135:6835","nonce":823204172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4963,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1348379028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1348379028},{"type":"v1","addr":"172.21.15.60:6836","nonce":1348379028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:29:20.429944+0000","modified":"2023-10-06T04:29:23.960780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6837/749877170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":749877170},{"type":"v1","addr":"172.21.15.60:6837","nonce":749877170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:29:26.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.804+0000 7fb7bd19d700 1 -- 172.21.15.60:0/1013972592 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb7a4066f30 msgr2=0x7fb7a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:26.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.804+0000 7fb7bd19d700 1 --2- 172.21.15.60:0/1013972592 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb7a4066f30 0x7fb7a40693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8009a40 tx=0x7fb7a8008040 comp rx=0 tx=0).stop 2023-10-06T04:29:26.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.804+0000 7fb7bd19d700 1 -- 172.21.15.60:0/1013972592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b806df50 msgr2=0x7fb7b8152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:26.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.804+0000 7fb7bd19d700 1 --2- 172.21.15.60:0/1013972592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b806df50 0x7fb7b8152af0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000cc90 tx=0x7fb7b0001a80 comp rx=0 tx=0).stop 2023-10-06T04:29:26.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.804+0000 7fb7bd19d700 1 -- 172.21.15.60:0/1013972592 shutdown_connections 2023-10-06T04:29:26.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.804+0000 7fb7bd19d700 1 --2- 172.21.15.60:0/1013972592 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb7a4066f30 0x7fb7a40693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:26.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.804+0000 7fb7bd19d700 1 --2- 172.21.15.60:0/1013972592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b806df50 0x7fb7b8152af0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:26.806 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.804+0000 7fb7bd19d700 1 --2- 172.21.15.60:0/1013972592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7b806a590 0x7fb7b80adec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:26.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.804+0000 7fb7bd19d700 1 --2- 172.21.15.60:0/1013972592 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb7b806a960 0x7fb7b8157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:26.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.804+0000 7fb7bd19d700 1 -- 172.21.15.60:0/1013972592 >> 172.21.15.60:0/1013972592 conn(0x7fb7b8068080 msgr2=0x7fb7b80c0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:26.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.804+0000 7fb7bd19d700 1 -- 172.21.15.60:0/1013972592 shutdown_connections 2023-10-06T04:29:26.807 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:26.805+0000 7fb7bd19d700 1 -- 172.21.15.60:0/1013972592 wait complete. 2023-10-06T04:29:26.807 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 16 2023-10-06T04:29:27.226 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T04:29:20.429944+0000', 'modified': '2023-10-06T04:29:23.960780+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5082}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5082': {'gid': 5082, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.60:6837/749877170', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6835', 'nonce': 749877170}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 749877170}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T04:29:27.227 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T04:29:27.227 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T04:29:27.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.419+0000 7ff9c899d700 1 Processor -- start 2023-10-06T04:29:27.420 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.419+0000 7ff9c899d700 1 -- start start 2023-10-06T04:29:27.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.420+0000 7ff9c899d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9c4159760 0x7ff9c40aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.420+0000 7ff9c899d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff9c406a120 0x7ff9c40ab240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.420+0000 7ff9c899d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c40686c0 con 0x7ff9c4159390 2023-10-06T04:29:27.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.420+0000 7ff9c899d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c4068c80 con 0x7ff9c406a120 2023-10-06T04:29:27.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.420+0000 7ff9c899d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c40ad0f0 con 0x7ff9c4159760 2023-10-06T04:29:27.422 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.420+0000 7ff9c3fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff9c406a120 0x7ff9c40ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.421+0000 7ff9c3fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff9c406a120 0x7ff9c40ab240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42628/0 (socket says 172.21.15.60:42628) 2023-10-06T04:29:27.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.421+0000 7ff9c3fff700 1 -- 172.21.15.60:0/2123413860 learned_addr learned my addr 172.21.15.60:0/2123413860 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:27.423 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.421+0000 7ff9c2ffd700 1 --2- 172.21.15.60:0/2123413860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9c4159760 0x7ff9c40aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.421+0000 7ff9c3fff700 1 -- 172.21.15.60:0/2123413860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9c4159760 msgr2=0x7ff9c40aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:27.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.421+0000 7ff9c3fff700 1 --2- 172.21.15.60:0/2123413860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9c4159760 0x7ff9c40aad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.421+0000 7ff9c3fff700 1 -- 172.21.15.60:0/2123413860 >> v1:172.21.15.135:6789/0 conn(0x7ff9c4159390 legacy=0x7ff9c40ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:27.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.421+0000 7ff9c3fff700 1 -- 172.21.15.60:0/2123413860 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c40ad3d0 con 0x7ff9c406a120 2023-10-06T04:29:27.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.421+0000 7ff9c3fff700 1 --2- 172.21.15.60:0/2123413860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9c406a120 0x7ff9c40ab240 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009f20 tx=0x7ff9bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23919b3bcab4e09 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:27.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.421+0000 7ff9c27fc700 1 -- 172.21.15.60:0/2123413860 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc00e070 con 0x7ff9c406a120 2023-10-06T04:29:27.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.422+0000 7ff9c27fc700 1 -- 172.21.15.60:0/2123413860 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc00b9d0 con 0x7ff9c406a120 2023-10-06T04:29:27.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.422+0000 7ff9c27fc700 1 -- 172.21.15.60:0/2123413860 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc0092e0 con 0x7ff9c406a120 2023-10-06T04:29:27.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.422+0000 7ff9c899d700 1 -- 172.21.15.60:0/2123413860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9c406a120 msgr2=0x7ff9c40ab240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:27.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.422+0000 7ff9c899d700 1 --2- 172.21.15.60:0/2123413860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9c406a120 0x7ff9c40ab240 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009f20 tx=0x7ff9bc009840 comp rx=0 tx=0).stop 2023-10-06T04:29:27.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.422+0000 7ff9c899d700 1 -- 172.21.15.60:0/2123413860 shutdown_connections 2023-10-06T04:29:27.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.422+0000 7ff9c899d700 1 --2- 172.21.15.60:0/2123413860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9c406a120 0x7ff9c40ab240 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.422+0000 7ff9c899d700 1 --2- 172.21.15.60:0/2123413860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9c4159760 0x7ff9c40aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.422+0000 7ff9c899d700 1 -- 172.21.15.60:0/2123413860 >> 172.21.15.60:0/2123413860 conn(0x7ff9c4097410 msgr2=0x7ff9c4067d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:27.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.422+0000 7ff9c899d700 1 -- 172.21.15.60:0/2123413860 shutdown_connections 2023-10-06T04:29:27.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.422+0000 7ff9c899d700 1 -- 172.21.15.60:0/2123413860 wait complete. 2023-10-06T04:29:27.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.424+0000 7ff9c899d700 1 Processor -- start 2023-10-06T04:29:27.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.424+0000 7ff9c899d700 1 -- start start 2023-10-06T04:29:27.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.425+0000 7ff9c899d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9c406a120 0x7ff9c4159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.425+0000 7ff9c899d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9c4159390 0x7ff9c4155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.425+0000 7ff9c899d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9c4159760 0x7ff9c4169d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.425+0000 7ff9c899d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c4156240 con 0x7ff9c406a120 2023-10-06T04:29:27.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.425+0000 7ff9c899d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c40b1600 con 0x7ff9c4159760 2023-10-06T04:29:27.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.425+0000 7ff9c899d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c416a290 con 0x7ff9c4159390 2023-10-06T04:29:27.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.425+0000 7ff9c37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9c406a120 0x7ff9c4159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.425+0000 7ff9c37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9c406a120 0x7ff9c4159bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42636/0 (socket says 172.21.15.60:42636) 2023-10-06T04:29:27.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.425+0000 7ff9c37fe700 1 -- 172.21.15.60:0/2754461222 learned_addr learned my addr 172.21.15.60:0/2754461222 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:27.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.425+0000 7ff9c2ffd700 1 --2- 172.21.15.60:0/2754461222 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9c4159390 0x7ff9c4155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.425+0000 7ff9c3fff700 1 --2- 172.21.15.60:0/2754461222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9c4159760 0x7ff9c4169d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.425+0000 7ff9c37fe700 1 -- 172.21.15.60:0/2754461222 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9c4159390 msgr2=0x7ff9c4155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:27.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.425+0000 7ff9c37fe700 1 --2- 172.21.15.60:0/2754461222 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9c4159390 0x7ff9c4155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.425+0000 7ff9c37fe700 1 -- 172.21.15.60:0/2754461222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9c4159760 msgr2=0x7ff9c4169d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:27.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.425+0000 7ff9c37fe700 1 --2- 172.21.15.60:0/2754461222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9c4159760 0x7ff9c4169d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.425+0000 7ff9c37fe700 1 -- 172.21.15.60:0/2754461222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc009ae0 con 0x7ff9c406a120 2023-10-06T04:29:27.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.426+0000 7ff9c37fe700 1 --2- 172.21.15.60:0/2754461222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9c406a120 0x7ff9c4159bc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400c590 tx=0x7ff9b400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:27.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.426+0000 7ff9ab7fe700 1 -- 172.21.15.60:0/2754461222 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4011590 con 0x7ff9c406a120 2023-10-06T04:29:27.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.426+0000 7ff9ab7fe700 1 -- 172.21.15.60:0/2754461222 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b40116f0 con 0x7ff9c406a120 2023-10-06T04:29:27.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.426+0000 7ff9c899d700 1 -- 172.21.15.60:0/2754461222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c415c410 con 0x7ff9c406a120 2023-10-06T04:29:27.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.426+0000 7ff9ab7fe700 1 -- 172.21.15.60:0/2754461222 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4011ab0 con 0x7ff9c406a120 2023-10-06T04:29:27.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.426+0000 7ff9c899d700 1 -- 172.21.15.60:0/2754461222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c40b0fb0 con 0x7ff9c406a120 2023-10-06T04:29:27.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.428+0000 7ff9ab7fe700 1 -- 172.21.15.60:0/2754461222 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff9b401b3b0 con 0x7ff9c406a120 2023-10-06T04:29:27.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.429+0000 7ff9ab7fe700 1 --2- 172.21.15.60:0/2754461222 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff9b0066f30 0x7ff9b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.429+0000 7ff9ab7fe700 1 -- 172.21.15.60:0/2754461222 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff9b4083e00 con 0x7ff9c406a120 2023-10-06T04:29:27.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.429+0000 7ff9c2ffd700 1 --2- 172.21.15.60:0/2754461222 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff9b0066f30 0x7ff9b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.432 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.430+0000 7ff9c2ffd700 1 --2- 172.21.15.60:0/2754461222 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff9b0066f30 0x7ff9b00693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff9c416c890 tx=0x7ff9b8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:27.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.431+0000 7ff9d8270b80 1 Processor -- start 2023-10-06T04:29:27.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.431+0000 7ff9d8270b80 1 -- start start 2023-10-06T04:29:27.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.432+0000 7ff9d8270b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a2f950 0x563593a2fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.432+0000 7ff9d8270b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563593a79bc0 0x563593a58920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.432+0000 7ff9d8270b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a58e60 0x563593a2b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.432+0000 7ff9d8270b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635939afc80 con 0x563593a58e60 2023-10-06T04:29:27.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.432+0000 7ff9d8270b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563593986a70 con 0x563593a2f950 2023-10-06T04:29:27.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.432+0000 7ff9d8270b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x563593984270 con 0x563593a79bc0 2023-10-06T04:29:27.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.432+0000 7ff9c3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a58e60 0x563593a2b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.432+0000 7ff9c3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a58e60 0x563593a2b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42652/0 (socket says 172.21.15.60:42652) 2023-10-06T04:29:27.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.432+0000 7ff9c3fff700 1 -- 172.21.15.60:0/2009557127 learned_addr learned my addr 172.21.15.60:0/2009557127 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:27.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.432+0000 7ff9c2ffd700 1 --2- 172.21.15.60:0/2009557127 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563593a79bc0 0x563593a58920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.432+0000 7ff9c37fe700 1 --2- 172.21.15.60:0/2009557127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a2f950 0x563593a2fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.433+0000 7ff9c3fff700 1 -- 172.21.15.60:0/2009557127 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563593a79bc0 msgr2=0x563593a58920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:27.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.433+0000 7ff9c3fff700 1 --2- 172.21.15.60:0/2009557127 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563593a79bc0 0x563593a58920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.433+0000 7ff9c3fff700 1 -- 172.21.15.60:0/2009557127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a2f950 msgr2=0x563593a2fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:27.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.433+0000 7ff9c3fff700 1 --2- 172.21.15.60:0/2009557127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a2f950 0x563593a2fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.433+0000 7ff9c3fff700 1 -- 172.21.15.60:0/2009557127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56359381a270 con 0x563593a58e60 2023-10-06T04:29:27.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.433+0000 7ff9c3fff700 1 --2- 172.21.15.60:0/2009557127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a58e60 0x563593a2b990 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4068590 tx=0x7ff9bc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12441e52235edad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:27.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.433+0000 7ff9a8ff9700 1 -- 172.21.15.60:0/2009557127 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc00bb40 con 0x563593a58e60 2023-10-06T04:29:27.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.433+0000 7ff9a8ff9700 1 -- 172.21.15.60:0/2009557127 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc01e430 con 0x563593a58e60 2023-10-06T04:29:27.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.433+0000 7ff9a8ff9700 1 -- 172.21.15.60:0/2009557127 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc01e7f0 con 0x563593a58e60 2023-10-06T04:29:27.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.434+0000 7ff9d8270b80 1 -- 172.21.15.60:0/2009557127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a58e60 msgr2=0x563593a2b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:27.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.434+0000 7ff9d8270b80 1 --2- 172.21.15.60:0/2009557127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a58e60 0x563593a2b990 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4068590 tx=0x7ff9bc018000 comp rx=0 tx=0).stop 2023-10-06T04:29:27.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.434+0000 7ff9d8270b80 1 -- 172.21.15.60:0/2009557127 shutdown_connections 2023-10-06T04:29:27.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.434+0000 7ff9d8270b80 1 --2- 172.21.15.60:0/2009557127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a58e60 0x563593a2b990 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.434+0000 7ff9d8270b80 1 --2- 172.21.15.60:0/2009557127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a2f950 0x563593a2fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.434+0000 7ff9d8270b80 1 --2- 172.21.15.60:0/2009557127 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563593a79bc0 0x563593a58920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.434+0000 7ff9d8270b80 1 -- 172.21.15.60:0/2009557127 >> 172.21.15.60:0/2009557127 conn(0x563593a31270 msgr2=0x563593a31640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:27.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.434+0000 7ff9d8270b80 1 -- 172.21.15.60:0/2009557127 shutdown_connections 2023-10-06T04:29:27.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.434+0000 7ff9d8270b80 1 -- 172.21.15.60:0/2009557127 wait complete. 2023-10-06T04:29:27.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.435+0000 7ff9d8270b80 1 -- start start 2023-10-06T04:29:27.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.435+0000 7ff9d8270b80 1 Processor -- start 2023-10-06T04:29:27.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.436+0000 7ff9d8270b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563593a2f950 0x563593a56040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.436+0000 7ff9d8270b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a58e60 0x563593a709d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.436+0000 7ff9d8270b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a79bc0 0x563593a6dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.436+0000 7ff9d8270b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563593980060 con 0x563593a58e60 2023-10-06T04:29:27.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.436+0000 7ff9d8270b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56359392b890 con 0x563593a79bc0 2023-10-06T04:29:27.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.436+0000 7ff9d8270b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x563593946ea0 con 0x563593a2f950 2023-10-06T04:29:27.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.436+0000 7ff9d8270b80 10 client.0 _ll_register_callbacks cb 0x56359381cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:29:27.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.436+0000 7ff9c2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a58e60 0x563593a709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.436+0000 7ff9c2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a58e60 0x563593a709d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42656/0 (socket says 172.21.15.60:42656) 2023-10-06T04:29:27.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.436+0000 7ff9c2ffd700 1 -- 172.21.15.60:0/243280011 learned_addr learned my addr 172.21.15.60:0/243280011 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:27.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.436+0000 7ff9c37fe700 1 --2- 172.21.15.60:0/243280011 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563593a2f950 0x563593a56040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.436+0000 7ff9c3fff700 1 --2- 172.21.15.60:0/243280011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a79bc0 0x563593a6dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.437+0000 7ff9c2ffd700 1 -- 172.21.15.60:0/243280011 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563593a2f950 msgr2=0x563593a56040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:27.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.437+0000 7ff9c2ffd700 1 --2- 172.21.15.60:0/243280011 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563593a2f950 0x563593a56040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.437+0000 7ff9c2ffd700 1 -- 172.21.15.60:0/243280011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a79bc0 msgr2=0x563593a6dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:27.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.437+0000 7ff9c2ffd700 1 --2- 172.21.15.60:0/243280011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a79bc0 0x563593a6dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.437+0000 7ff9c2ffd700 1 -- 172.21.15.60:0/243280011 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c40ad3d0 con 0x563593a58e60 2023-10-06T04:29:27.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.437+0000 7ff9c3fff700 1 --2- 172.21.15.60:0/243280011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a79bc0 0x563593a6dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:27.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.437+0000 7ff9c2ffd700 1 --2- 172.21.15.60:0/243280011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a58e60 0x563593a709d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80157c0 tx=0x7ff9b8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1637e35b057fa1bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:27.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.437+0000 7ff9a1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-06T04:29:27.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.437+0000 7ff9a1ffb700 1 -- 172.21.15.60:0/243280011 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8022630 con 0x563593a58e60 2023-10-06T04:29:27.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.437+0000 7ff9a1ffb700 1 -- 172.21.15.60:0/243280011 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff9b8022790 con 0x563593a58e60 2023-10-06T04:29:27.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.437+0000 7ff9d8270b80 1 -- 172.21.15.60:0/243280011 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563593a24690 con 0x563593a58e60 2023-10-06T04:29:27.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.437+0000 7ff9a1ffb700 1 -- 172.21.15.60:0/243280011 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9b8022b60 con 0x563593a58e60 2023-10-06T04:29:27.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.438+0000 7ff9d8270b80 10 client.5274 fetch_fsmap learned FSMap version 16 2023-10-06T04:29:27.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.438+0000 7ff9d8270b80 1 -- 172.21.15.60:0/243280011 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5635937bcfe0 con 0x563593a58e60 2023-10-06T04:29:27.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.438+0000 7ff9a1ffb700 1 -- 172.21.15.60:0/243280011 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563593a24690 con 0x563593a58e60 2023-10-06T04:29:27.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.438+0000 7ff9a1ffb700 1 -- 172.21.15.60:0/243280011 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff9b8022cc0 con 0x563593a58e60 2023-10-06T04:29:27.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.438+0000 7ff9d8270b80 10 client.5274 fetch_fsmap finished waiting for FSMap version 16 2023-10-06T04:29:27.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.438+0000 7ff9d8270b80 10 client.5274 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T04:29:27.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.438+0000 7ff9d8270b80 20 client.5274 populate_metadata read hostname 'smithi060' 2023-10-06T04:29:27.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.438+0000 7ff9d8270b80 1 --2- 172.21.15.60:0/243280011 >> [v2:172.21.15.60:6835/749877170,v1:172.21.15.60:6837/749877170] conn(0x563593a71cf0 0x563593a720c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.438+0000 7ff9d8270b80 4 client.5274 mds_command: new command op to 5082 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T04:29:27.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.438+0000 7ff9d8270b80 1 -- 172.21.15.60:0/243280011 --> [v2:172.21.15.60:6835/749877170,v1:172.21.15.60:6837/749877170] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563593a015c0 con 0x563593a71cf0 2023-10-06T04:29:27.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.438+0000 7ff9c37fe700 1 --2- 172.21.15.60:0/243280011 >> [v2:172.21.15.60:6835/749877170,v1:172.21.15.60:6837/749877170] conn(0x563593a71cf0 0x563593a720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.439+0000 7ff9c37fe700 1 --2- 172.21.15.60:0/243280011 >> [v2:172.21.15.60:6835/749877170,v1:172.21.15.60:6837/749877170] conn(0x563593a71cf0 0x563593a720c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1828d02fde90552 server_cookie=86e7b15b0ebd2b3a in_seq=0 out_seq=0 2023-10-06T04:29:27.444 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.439+0000 7ff9a1ffb700 10 client.5274 ms_handle_connect on v2:172.21.15.60:6835/749877170 2023-10-06T04:29:27.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.439+0000 7ff9a1ffb700 1 -- 172.21.15.60:0/243280011 <== mds.0 v2:172.21.15.60:6835/749877170 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x563593a015c0 con 0x563593a71cf0 2023-10-06T04:29:27.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.439+0000 7ff9a1ffb700 10 client.5274 handle_command_reply: tid=0 2023-10-06T04:29:27.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.439+0000 7ff9d8270b80 1 client.5274 shutdown 2023-10-06T04:29:27.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.440+0000 7ff9d8270b80 1 -- 172.21.15.60:0/243280011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a58e60 msgr2=0x563593a709d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:27.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.440+0000 7ff9d8270b80 1 --2- 172.21.15.60:0/243280011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a58e60 0x563593a709d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80157c0 tx=0x7ff9b8018000 comp rx=0 tx=0).stop 2023-10-06T04:29:27.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.440+0000 7ff9d8270b80 1 -- 172.21.15.60:0/243280011 shutdown_connections 2023-10-06T04:29:27.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.440+0000 7ff9d8270b80 1 --2- 172.21.15.60:0/243280011 >> [v2:172.21.15.60:6835/749877170,v1:172.21.15.60:6837/749877170] conn(0x563593a71cf0 0x563593a720c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.440+0000 7ff9d8270b80 1 --2- 172.21.15.60:0/243280011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a79bc0 0x563593a6dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.440+0000 7ff9d8270b80 1 --2- 172.21.15.60:0/243280011 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563593a2f950 0x563593a56040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.440+0000 7ff9a1ffb700 0 client.5274 ms_handle_reset on v2:172.21.15.60:6835/749877170 2023-10-06T04:29:27.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.440+0000 7ff9d8270b80 1 --2- 172.21.15.60:0/243280011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a58e60 0x563593a709d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.440+0000 7ff9d8270b80 1 -- 172.21.15.60:0/243280011 >> 172.21.15.60:0/243280011 conn(0x563593a31270 msgr2=0x563593a30230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:27.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.440+0000 7ff9d8270b80 1 -- 172.21.15.60:0/243280011 shutdown_connections 2023-10-06T04:29:27.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.440+0000 7ff9d8270b80 1 -- 172.21.15.60:0/243280011 wait complete. 2023-10-06T04:29:27.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.440+0000 7ff9d8270b80 20 client.5274 trim_cache size 0 max 16384 2023-10-06T04:29:27.458 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.457+0000 7ff9d8270b80 1 Processor -- start 2023-10-06T04:29:27.459 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.457+0000 7ff9d8270b80 1 -- start start 2023-10-06T04:29:27.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.458+0000 7ff9d8270b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a2f950 0x563593a721c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.460 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.458+0000 7ff9d8270b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563593a58e60 0x563593a26370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.458+0000 7ff9d8270b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a79bc0 0x563593a268b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.458+0000 7ff9d8270b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563593802e30 con 0x563593a2f950 2023-10-06T04:29:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.458+0000 7ff9d8270b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563593a75920 con 0x563593a79bc0 2023-10-06T04:29:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.458+0000 7ff9d8270b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x563593a6d870 con 0x563593a58e60 2023-10-06T04:29:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.458+0000 7ff9c37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a2f950 0x563593a721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.458+0000 7ff9c37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a2f950 0x563593a721c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42664/0 (socket says 172.21.15.60:42664) 2023-10-06T04:29:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.458+0000 7ff9c37fe700 1 -- 172.21.15.60:0/1408881849 learned_addr learned my addr 172.21.15.60:0/1408881849 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.459+0000 7ff9c37fe700 1 -- 172.21.15.60:0/1408881849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563593a58e60 msgr2=0x563593a26370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.459+0000 7ff9c37fe700 1 --2- 172.21.15.60:0/1408881849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563593a58e60 0x563593a26370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.459+0000 7ff9c37fe700 1 -- 172.21.15.60:0/1408881849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a79bc0 msgr2=0x563593a268b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:27.461 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.459+0000 7ff9c3fff700 1 --2- 172.21.15.60:0/1408881849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a79bc0 0x563593a268b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.459+0000 7ff9c37fe700 1 --2- 172.21.15.60:0/1408881849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a79bc0 0x563593a268b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.459+0000 7ff9c37fe700 1 -- 172.21.15.60:0/1408881849 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56359394e780 con 0x563593a2f950 2023-10-06T04:29:27.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.459+0000 7ff9c3fff700 1 --2- 172.21.15.60:0/1408881849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a79bc0 0x563593a268b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:27.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.459+0000 7ff9c37fe700 1 --2- 172.21.15.60:0/1408881849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a2f950 0x563593a721c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40552a0 tx=0x7ff9b401e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ab0e0d3fa406de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:27.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.459+0000 7ff9a97fa700 1 -- 172.21.15.60:0/1408881849 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b40821c0 con 0x563593a2f950 2023-10-06T04:29:27.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.459+0000 7ff9a97fa700 1 -- 172.21.15.60:0/1408881849 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b4052b30 con 0x563593a2f950 2023-10-06T04:29:27.462 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.459+0000 7ff9a97fa700 1 -- 172.21.15.60:0/1408881849 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4052d90 con 0x563593a2f950 2023-10-06T04:29:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.460+0000 7ff9d8270b80 1 -- 172.21.15.60:0/1408881849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a2f950 msgr2=0x563593a721c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.460+0000 7ff9d8270b80 1 --2- 172.21.15.60:0/1408881849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a2f950 0x563593a721c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40552a0 tx=0x7ff9b401e040 comp rx=0 tx=0).stop 2023-10-06T04:29:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.460+0000 7ff9d8270b80 1 -- 172.21.15.60:0/1408881849 shutdown_connections 2023-10-06T04:29:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.460+0000 7ff9d8270b80 1 --2- 172.21.15.60:0/1408881849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a2f950 0x563593a721c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.460+0000 7ff9d8270b80 1 --2- 172.21.15.60:0/1408881849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a79bc0 0x563593a268b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.460+0000 7ff9d8270b80 1 --2- 172.21.15.60:0/1408881849 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563593a58e60 0x563593a26370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.460+0000 7ff9d8270b80 1 -- 172.21.15.60:0/1408881849 >> 172.21.15.60:0/1408881849 conn(0x563593a31270 msgr2=0x563593a709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.460+0000 7ff9d8270b80 1 -- 172.21.15.60:0/1408881849 shutdown_connections 2023-10-06T04:29:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.460+0000 7ff9d8270b80 1 -- 172.21.15.60:0/1408881849 wait complete. 2023-10-06T04:29:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.461+0000 7ff9d8270b80 1 -- start start 2023-10-06T04:29:27.467 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.461+0000 7ff9d8270b80 1 Processor -- start 2023-10-06T04:29:27.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.462+0000 7ff9d8270b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a2f950 0x563593a30160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.462+0000 7ff9d8270b80 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563593a58e60 0x563593a55fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.462+0000 7ff9d8270b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a79bc0 0x563593ace990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.462+0000 7ff9d8270b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x563593a56510 con 0x563593a2f950 2023-10-06T04:29:27.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.462+0000 7ff9d8270b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563593ad58f0 con 0x563593a79bc0 2023-10-06T04:29:27.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.462+0000 7ff9d8270b80 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x563593a307b0 con 0x563593a58e60 2023-10-06T04:29:27.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.462+0000 7ff9d8270b80 10 client.0 _ll_register_callbacks cb 0x56359381cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T04:29:27.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.462+0000 7ff9c37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a2f950 0x563593a30160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.462+0000 7ff9c37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a2f950 0x563593a30160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42668/0 (socket says 172.21.15.60:42668) 2023-10-06T04:29:27.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.462+0000 7ff9c37fe700 1 -- 172.21.15.60:0/2441088927 learned_addr learned my addr 172.21.15.60:0/2441088927 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:27.468 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.462+0000 7ff9c2ffd700 1 --2- 172.21.15.60:0/2441088927 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563593a58e60 0x563593a55fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.462+0000 7ff9c3fff700 1 --2- 172.21.15.60:0/2441088927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a79bc0 0x563593ace990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.462+0000 7ff9c37fe700 1 -- 172.21.15.60:0/2441088927 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563593a58e60 msgr2=0x563593a55fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:27.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.462+0000 7ff9c37fe700 1 --2- 172.21.15.60:0/2441088927 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563593a58e60 0x563593a55fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.462+0000 7ff9c37fe700 1 -- 172.21.15.60:0/2441088927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a79bc0 msgr2=0x563593ace990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:27.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.462+0000 7ff9c37fe700 1 --2- 172.21.15.60:0/2441088927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a79bc0 0x563593ace990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.462+0000 7ff9c37fe700 1 -- 172.21.15.60:0/2441088927 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c40b0fb0 con 0x563593a2f950 2023-10-06T04:29:27.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.463+0000 7ff9c37fe700 1 --2- 172.21.15.60:0/2441088927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a2f950 0x563593a30160 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4054980 tx=0x7ff9b406e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7594f1b4b4bf3e2d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:27.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.463+0000 7ff9a1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2023-10-06T04:29:27.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.463+0000 7ff9a1ffb700 1 -- 172.21.15.60:0/2441088927 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b405bbe0 con 0x563593a2f950 2023-10-06T04:29:27.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.463+0000 7ff9a1ffb700 1 -- 172.21.15.60:0/2441088927 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff9b405bd40 con 0x563593a2f950 2023-10-06T04:29:27.469 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.463+0000 7ff9d8270b80 1 -- 172.21.15.60:0/2441088927 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff9bc01e430 con 0x563593a2f950 2023-10-06T04:29:27.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.463+0000 7ff9a1ffb700 1 -- 172.21.15.60:0/2441088927 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9b4053ee0 con 0x563593a2f950 2023-10-06T04:29:27.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.463+0000 7ff9d8270b80 10 client.5280 fetch_fsmap learned FSMap version 16 2023-10-06T04:29:27.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.463+0000 7ff9d8270b80 1 -- 172.21.15.60:0/2441088927 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x563593935470 con 0x563593a2f950 2023-10-06T04:29:27.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.463+0000 7ff9a1ffb700 1 -- 172.21.15.60:0/2441088927 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc01e430 con 0x563593a2f950 2023-10-06T04:29:27.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.463+0000 7ff9a1ffb700 1 -- 172.21.15.60:0/2441088927 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff9b4065070 con 0x563593a2f950 2023-10-06T04:29:27.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.463+0000 7ff9d8270b80 10 client.5280 fetch_fsmap finished waiting for FSMap version 16 2023-10-06T04:29:27.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.463+0000 7ff9d8270b80 10 client.5280 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T04:29:27.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.463+0000 7ff9d8270b80 20 client.5280 populate_metadata read hostname 'smithi060' 2023-10-06T04:29:27.470 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.463+0000 7ff9d8270b80 1 --2- 172.21.15.60:0/2441088927 >> [v2:172.21.15.60:6835/749877170,v1:172.21.15.60:6837/749877170] conn(0x563593ae0430 0x563593ae0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.463+0000 7ff9d8270b80 4 client.5280 mds_command: new command op to 5082 tid=0[{"prefix": "status"}] 2023-10-06T04:29:27.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.463+0000 7ff9d8270b80 1 -- 172.21.15.60:0/2441088927 --> [v2:172.21.15.60:6835/749877170,v1:172.21.15.60:6837/749877170] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563593922e00 con 0x563593ae0430 2023-10-06T04:29:27.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.464+0000 7ff9c2ffd700 1 --2- 172.21.15.60:0/2441088927 >> [v2:172.21.15.60:6835/749877170,v1:172.21.15.60:6837/749877170] conn(0x563593ae0430 0x563593ae0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.464+0000 7ff9c2ffd700 1 --2- 172.21.15.60:0/2441088927 >> [v2:172.21.15.60:6835/749877170,v1:172.21.15.60:6837/749877170] conn(0x563593ae0430 0x563593ae0800 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89537ef76c1db273 server_cookie=76689bce41f976e5 in_seq=0 out_seq=0 2023-10-06T04:29:27.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.464+0000 7ff9a1ffb700 10 client.5280 ms_handle_connect on v2:172.21.15.60:6835/749877170 2023-10-06T04:29:27.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.464+0000 7ff9a1ffb700 1 -- 172.21.15.60:0/2441088927 <== mds.0 v2:172.21.15.60:6835/749877170 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x563593922e00 con 0x563593ae0430 2023-10-06T04:29:27.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.464+0000 7ff9a1ffb700 10 client.5280 handle_command_reply: tid=0 2023-10-06T04:29:27.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.464+0000 7ff9d8270b80 1 client.5280 shutdown 2023-10-06T04:29:27.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.465+0000 7ff9d8270b80 1 -- 172.21.15.60:0/2441088927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a2f950 msgr2=0x563593a30160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:27.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.465+0000 7ff9d8270b80 1 --2- 172.21.15.60:0/2441088927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a2f950 0x563593a30160 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4054980 tx=0x7ff9b406e000 comp rx=0 tx=0).stop 2023-10-06T04:29:27.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.465+0000 7ff9d8270b80 1 -- 172.21.15.60:0/2441088927 shutdown_connections 2023-10-06T04:29:27.471 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.465+0000 7ff9d8270b80 1 --2- 172.21.15.60:0/2441088927 >> [v2:172.21.15.60:6835/749877170,v1:172.21.15.60:6837/749877170] conn(0x563593ae0430 0x563593ae0800 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.465+0000 7ff9d8270b80 1 --2- 172.21.15.60:0/2441088927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563593a2f950 0x563593a30160 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.465+0000 7ff9d8270b80 1 --2- 172.21.15.60:0/2441088927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563593a79bc0 0x563593ace990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.465+0000 7ff9a1ffb700 0 client.5280 ms_handle_reset on v2:172.21.15.60:6835/749877170 2023-10-06T04:29:27.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.465+0000 7ff9d8270b80 1 --2- 172.21.15.60:0/2441088927 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x563593a58e60 0x563593a55fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.465+0000 7ff9d8270b80 1 -- 172.21.15.60:0/2441088927 >> 172.21.15.60:0/2441088927 conn(0x563593a31270 msgr2=0x563593a26370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:27.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.465+0000 7ff9d8270b80 1 -- 172.21.15.60:0/2441088927 shutdown_connections 2023-10-06T04:29:27.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.465+0000 7ff9d8270b80 1 -- 172.21.15.60:0/2441088927 wait complete. 2023-10-06T04:29:27.472 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.465+0000 7ff9d8270b80 20 client.5280 trim_cache size 0 max 16384 2023-10-06T04:29:27.472 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-06T04:29:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "caf6a2b8-149e-4228-9a04-404e2d811afd", 2023-10-06T04:29:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2023-10-06T04:29:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 5082, 2023-10-06T04:29:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2023-10-06T04:29:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2023-10-06T04:29:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2023-10-06T04:29:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 6.5325017069999998, 2023-10-06T04:29:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 16, 2023-10-06T04:29:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 40, 2023-10-06T04:29:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 40, 2023-10-06T04:29:27.473 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 16.796950137 2023-10-06T04:29:27.474 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-06T04:29:27.474 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.466+0000 7ff9c899d700 1 -- 172.21.15.60:0/2754461222 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff9b0066f30 msgr2=0x7ff9b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:27.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.466+0000 7ff9c899d700 1 --2- 172.21.15.60:0/2754461222 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff9b0066f30 0x7ff9b00693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff9c416c890 tx=0x7ff9b8008040 comp rx=0 tx=0).stop 2023-10-06T04:29:27.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.466+0000 7ff9c899d700 1 -- 172.21.15.60:0/2754461222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9c406a120 msgr2=0x7ff9c4159bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:27.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.466+0000 7ff9c899d700 1 --2- 172.21.15.60:0/2754461222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9c406a120 0x7ff9c4159bc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400c590 tx=0x7ff9b400c950 comp rx=0 tx=0).stop 2023-10-06T04:29:27.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.466+0000 7ff9c899d700 1 -- 172.21.15.60:0/2754461222 shutdown_connections 2023-10-06T04:29:27.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.466+0000 7ff9c899d700 1 --2- 172.21.15.60:0/2754461222 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff9b0066f30 0x7ff9b00693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.466+0000 7ff9c899d700 1 --2- 172.21.15.60:0/2754461222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9c406a120 0x7ff9c4159bc0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.466+0000 7ff9c899d700 1 --2- 172.21.15.60:0/2754461222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9c4159760 0x7ff9c4169d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.466+0000 7ff9c899d700 1 --2- 172.21.15.60:0/2754461222 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9c4159390 0x7ff9c4155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.466+0000 7ff9c899d700 1 -- 172.21.15.60:0/2754461222 >> 172.21.15.60:0/2754461222 conn(0x7ff9c4097410 msgr2=0x7ff9c40af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:27.475 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.466+0000 7ff9c899d700 1 -- 172.21.15.60:0/2754461222 shutdown_connections 2023-10-06T04:29:27.476 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.466+0000 7ff9c899d700 1 -- 172.21.15.60:0/2754461222 wait complete. 2023-10-06T04:29:27.484 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T04:29:27.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.668+0000 7f4a18b9d700 1 Processor -- start 2023-10-06T04:29:27.670 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.668+0000 7f4a18b9d700 1 -- start start 2023-10-06T04:29:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.670+0000 7f4a18b9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4a1406a590 0x7f4a141536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.670+0000 7f4a18b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a1406a960 0x7f4a14153c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.670+0000 7f4a18b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4a1406df50 0x7f4a1406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.670+0000 7f4a18b9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1406f560 con 0x7f4a1406a590 2023-10-06T04:29:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.670+0000 7f4a18b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a140c9cc0 con 0x7f4a1406df50 2023-10-06T04:29:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.670+0000 7f4a18b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a140c6710 con 0x7f4a1406a960 2023-10-06T04:29:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.670+0000 7f4a137fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4a1406a590 0x7f4a141536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.670+0000 7f4a137fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4a1406a590 0x7f4a141536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42682/0 (socket says 172.21.15.60:42682) 2023-10-06T04:29:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.670+0000 7f4a137fe700 1 -- 172.21.15.60:0/3474202786 learned_addr learned my addr 172.21.15.60:0/3474202786 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.670+0000 7f4a13fff700 1 --2- 172.21.15.60:0/3474202786 >> v2:172.21.15.135:3300/0 conn(0x7f4a1406df50 0x7f4a1406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.670+0000 7f4a12ffd700 1 --2- 172.21.15.60:0/3474202786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a1406a960 0x7f4a14153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.670+0000 7f4a137fe700 1 -- 172.21.15.60:0/3474202786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a1406a960 msgr2=0x7f4a14153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.670+0000 7f4a137fe700 1 --2- 172.21.15.60:0/3474202786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a1406a960 0x7f4a14153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.670+0000 7f4a137fe700 1 -- 172.21.15.60:0/3474202786 >> v2:172.21.15.135:3300/0 conn(0x7f4a1406df50 msgr2=0x7f4a1406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.670+0000 7f4a137fe700 1 --2- 172.21.15.60:0/3474202786 >> v2:172.21.15.135:3300/0 conn(0x7f4a1406df50 0x7f4a1406e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.670+0000 7f4a137fe700 1 -- 172.21.15.60:0/3474202786 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1406ecc0 con 0x7f4a1406a590 2023-10-06T04:29:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.670+0000 7f4a13fff700 1 --2- 172.21.15.60:0/3474202786 >> v2:172.21.15.135:3300/0 conn(0x7f4a1406df50 0x7f4a1406e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.671+0000 7f4a137fe700 1 --2- 172.21.15.60:0/3474202786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a1406a590 0x7f4a141536f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4a1406c920 tx=0x7f4a0400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae65dc5289388d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:27.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.671+0000 7f4a127fc700 1 -- 172.21.15.60:0/3474202786 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0400dc50 con 0x7f4a1406a590 2023-10-06T04:29:27.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.671+0000 7f4a127fc700 1 -- 172.21.15.60:0/3474202786 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0400ddb0 con 0x7f4a1406a590 2023-10-06T04:29:27.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.671+0000 7f4a127fc700 1 -- 172.21.15.60:0/3474202786 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a040196d0 con 0x7f4a1406a590 2023-10-06T04:29:27.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.671+0000 7f4a18b9d700 1 -- 172.21.15.60:0/3474202786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a1406a590 msgr2=0x7f4a141536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:27.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.671+0000 7f4a18b9d700 1 --2- 172.21.15.60:0/3474202786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a1406a590 0x7f4a141536f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4a1406c920 tx=0x7f4a0400b4f0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.672+0000 7f4a18b9d700 1 -- 172.21.15.60:0/3474202786 shutdown_connections 2023-10-06T04:29:27.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.672+0000 7f4a18b9d700 1 --2- 172.21.15.60:0/3474202786 >> v2:172.21.15.135:3300/0 conn(0x7f4a1406df50 0x7f4a1406e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.672+0000 7f4a18b9d700 1 --2- 172.21.15.60:0/3474202786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a1406a590 0x7f4a141536f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.672+0000 7f4a18b9d700 1 --2- 172.21.15.60:0/3474202786 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a1406a960 0x7f4a14153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.672+0000 7f4a18b9d700 1 -- 172.21.15.60:0/3474202786 >> 172.21.15.60:0/3474202786 conn(0x7f4a14068080 msgr2=0x7f4a140cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:27.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.672+0000 7f4a18b9d700 1 -- 172.21.15.60:0/3474202786 shutdown_connections 2023-10-06T04:29:27.675 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.672+0000 7f4a18b9d700 1 -- 172.21.15.60:0/3474202786 wait complete. 2023-10-06T04:29:27.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.673+0000 7f4a18b9d700 1 Processor -- start 2023-10-06T04:29:27.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.673+0000 7f4a18b9d700 1 -- start start 2023-10-06T04:29:27.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.674+0000 7f4a18b9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a1406a590 0x7f4a14169e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.674+0000 7f4a18b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a1406a960 0x7f4a140cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.674+0000 7f4a18b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a1406df50 0x7f4a140cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.674+0000 7f4a18b9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a140b0640 con 0x7f4a1406a590 2023-10-06T04:29:27.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.674+0000 7f4a18b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1416a8d0 con 0x7f4a1406df50 2023-10-06T04:29:27.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.674+0000 7f4a18b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1416abb0 con 0x7f4a1406a960 2023-10-06T04:29:27.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.674+0000 7f4a137fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a1406a590 0x7f4a14169e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.674+0000 7f4a137fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a1406a590 0x7f4a14169e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42686/0 (socket says 172.21.15.60:42686) 2023-10-06T04:29:27.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.674+0000 7f4a137fe700 1 -- 172.21.15.60:0/1388223899 learned_addr learned my addr 172.21.15.60:0/1388223899 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:27.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.675+0000 7f4a12ffd700 1 --2- 172.21.15.60:0/1388223899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a1406a960 0x7f4a140cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.675+0000 7f4a13fff700 1 --2- 172.21.15.60:0/1388223899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a1406df50 0x7f4a140cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.675+0000 7f4a137fe700 1 -- 172.21.15.60:0/1388223899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a1406a960 msgr2=0x7f4a140cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:27.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.675+0000 7f4a137fe700 1 --2- 172.21.15.60:0/1388223899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a1406a960 0x7f4a140cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.675+0000 7f4a137fe700 1 -- 172.21.15.60:0/1388223899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a1406df50 msgr2=0x7f4a140cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:27.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.675+0000 7f4a137fe700 1 --2- 172.21.15.60:0/1388223899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a1406df50 0x7f4a140cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.675+0000 7f4a137fe700 1 -- 172.21.15.60:0/1388223899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0400b790 con 0x7f4a1406a590 2023-10-06T04:29:27.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.675+0000 7f4a12ffd700 1 --2- 172.21.15.60:0/1388223899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a1406a960 0x7f4a140cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:27.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.675+0000 7f4a13fff700 1 --2- 172.21.15.60:0/1388223899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a1406df50 0x7f4a140cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:27.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.675+0000 7f4a137fe700 1 --2- 172.21.15.60:0/1388223899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a1406a590 0x7f4a14169e00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4a1406c780 tx=0x7f4a0401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:27.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.675+0000 7f49fb7fe700 1 -- 172.21.15.60:0/1388223899 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a04010540 con 0x7f4a1406a590 2023-10-06T04:29:27.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.675+0000 7f49fb7fe700 1 -- 172.21.15.60:0/1388223899 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a040106e0 con 0x7f4a1406a590 2023-10-06T04:29:27.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.675+0000 7f4a18b9d700 1 -- 172.21.15.60:0/1388223899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a140b02d0 con 0x7f4a1406a590 2023-10-06T04:29:27.679 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.675+0000 7f49fb7fe700 1 -- 172.21.15.60:0/1388223899 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a04010aa0 con 0x7f4a1406a590 2023-10-06T04:29:27.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.676+0000 7f4a18b9d700 1 -- 172.21.15.60:0/1388223899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1416afd0 con 0x7f4a1406a590 2023-10-06T04:29:27.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.676+0000 7f4a18b9d700 1 -- 172.21.15.60:0/1388223899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a140b0110 con 0x7f4a1406a590 2023-10-06T04:29:27.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.677+0000 7f49fb7fe700 1 -- 172.21.15.60:0/1388223899 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a04020070 con 0x7f4a1406a590 2023-10-06T04:29:27.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.678+0000 7f49fb7fe700 1 --2- 172.21.15.60:0/1388223899 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4a00066f30 0x7f4a000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:27.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.678+0000 7f49fb7fe700 1 -- 172.21.15.60:0/1388223899 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4a04014070 con 0x7f4a1406a590 2023-10-06T04:29:27.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.678+0000 7f4a12ffd700 1 --2- 172.21.15.60:0/1388223899 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4a00066f30 0x7f4a000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:27.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.679+0000 7f4a12ffd700 1 --2- 172.21.15.60:0/1388223899 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4a00066f30 0x7f4a000693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4a140cc840 tx=0x7f4a08008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:27.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.682+0000 7f49fb7fe700 1 -- 172.21.15.60:0/1388223899 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a04052e90 con 0x7f4a1406a590 2023-10-06T04:29:27.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.930+0000 7f4a18b9d700 1 -- 172.21.15.60:0/1388223899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4a1405f230 con 0x7f4a1406a590 2023-10-06T04:29:27.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.931+0000 7f49fb7fe700 1 -- 172.21.15.60:0/1388223899 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4a04027020 con 0x7f4a1406a590 2023-10-06T04:29:27.932 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T04:29:27.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.933+0000 7f4a18b9d700 1 -- 172.21.15.60:0/1388223899 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4a00066f30 msgr2=0x7f4a000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:27.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.933+0000 7f4a18b9d700 1 --2- 172.21.15.60:0/1388223899 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4a00066f30 0x7f4a000693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4a140cc840 tx=0x7f4a08008040 comp rx=0 tx=0).stop 2023-10-06T04:29:27.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.933+0000 7f4a18b9d700 1 -- 172.21.15.60:0/1388223899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a1406a590 msgr2=0x7f4a14169e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:27.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.933+0000 7f4a18b9d700 1 --2- 172.21.15.60:0/1388223899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a1406a590 0x7f4a14169e00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4a1406c780 tx=0x7f4a0401b000 comp rx=0 tx=0).stop 2023-10-06T04:29:27.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.933+0000 7f4a18b9d700 1 -- 172.21.15.60:0/1388223899 shutdown_connections 2023-10-06T04:29:27.935 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.933+0000 7f4a18b9d700 1 --2- 172.21.15.60:0/1388223899 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4a00066f30 0x7f4a000693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.933+0000 7f4a18b9d700 1 --2- 172.21.15.60:0/1388223899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a1406a590 0x7f4a14169e00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.933+0000 7f4a18b9d700 1 --2- 172.21.15.60:0/1388223899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a1406df50 0x7f4a140cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.933+0000 7f4a18b9d700 1 --2- 172.21.15.60:0/1388223899 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4a1406a960 0x7f4a140cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:27.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.933+0000 7f4a18b9d700 1 -- 172.21.15.60:0/1388223899 >> 172.21.15.60:0/1388223899 conn(0x7f4a14068080 msgr2=0x7f4a140c25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:27.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.933+0000 7f4a18b9d700 1 -- 172.21.15.60:0/1388223899 shutdown_connections 2023-10-06T04:29:27.936 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:27.933+0000 7f4a18b9d700 1 -- 172.21.15.60:0/1388223899 wait complete. 2023-10-06T04:29:27.952 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T04:29:27.952 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T04:29:27.952 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2023-10-06T04:29:27.952 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T04:29:27.952 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T04:29:27.953 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T04:29:27.953 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T04:29:27.953 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T04:29:27.953 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:29:27.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:29:27.953 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2023-10-06T04:29:27.991 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T04:29:27.991 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T04:29:27.991 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T04:29:27.991 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:29:27.991 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2023-10-06T04:29:27.992 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:29:27.992 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:29:27.992 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2023-10-06T04:29:27.992 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2023-10-06T04:29:27.992 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:29:27.992 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2023-10-06T04:29:27.992 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2023-10-06T04:29:27.992 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T04:29:27.992 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:29:27.992 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2023-10-06T04:29:27.992 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-06T04:29:27.992 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42206sec preferred_lft 42206sec 2023-10-06T04:29:27.992 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2023-10-06T04:29:27.993 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:29:27.993 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T04:29:27.993 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:29:27.993 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2023-10-06T04:29:27.993 INFO:teuthology.orchestra.run.smithi060.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T04:29:27.993 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether b6:01:cd:7d:bd:12 brd ff:ff:ff:ff:ff:ff 2023-10-06T04:29:27.993 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T04:29:27.993 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:29:27.993 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::60b8:e1ff:feff:b13f/64 scope link 2023-10-06T04:29:27.993 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:29:27.993 INFO:teuthology.orchestra.run.smithi060.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:29:27.993 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether b6:01:cd:7d:bd:12 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:29:27.994 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::b401:cdff:fe7d:bd12/64 scope link 2023-10-06T04:29:27.994 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:29:27.994 INFO:teuthology.orchestra.run.smithi060.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T04:29:27.994 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether f6:0b:d6:f7:c8:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:29:27.994 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::f40b:d6ff:fef7:c800/64 scope link 2023-10-06T04:29:27.994 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2023-10-06T04:29:27.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:29:27.994 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T04:29:28.090 INFO:teuthology.orchestra.run.smithi060.stdout:1 2023-10-06T04:29:28.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:29:28.094 DEBUG:teuthology.orchestra.run.smithi060:> route 2023-10-06T04:29:28.133 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2023-10-06T04:29:28.133 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T04:29:28.134 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-06T04:29:28.134 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-06T04:29:28.134 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T04:29:28.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:29:28.134 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec bash -c ' 2023-10-06T04:29:28.134 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2023-10-06T04:29:28.134 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T04:29:28.134 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T04:29:28.135 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T04:29:28.135 DEBUG:teuthology.orchestra.run.smithi060:> ') 2023-10-06T04:29:28.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:29:28.334 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-06T04:29:28.371 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T04:29:28.371 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:29:28.371 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:29:28.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:29:28.372 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2023-10-06T04:29:28.475 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:29:28.475 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T04:29:28.512 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T04:29:28.512 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T04:29:28.512 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:29:28.588 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T04:29:28.588 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T04:29:28.589 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:29:28.721 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:29:28.721 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:29:28.721 INFO:teuthology.orchestra.run.smithi060.stdout:invalid new device string format 2023-10-06T04:29:28.737 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:29:28.737 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:29:28.737 INFO:teuthology.orchestra.run.smithi060.stdout:invalid new device string format 2023-10-06T04:29:28.737 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-06T04:29:28.737 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:29:28.759 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T04:29:28.759 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T04:29:28.759 INFO:teuthology.orchestra.run.smithi060.stdout:invalid new device string format 2023-10-06T04:29:28.759 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.135:3300,172.21.15.135:3301" 2023-10-06T04:29:28.759 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T04:29:28.759 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:6789,172.21.15.135:6789,172.21.15.135:6790" 2023-10-06T04:29:28.759 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2023-10-06T04:29:28.759 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=caf6a2b8-149e-4228-9a04-404e2d811afd" will pass to kernel 2023-10-06T04:29:28.763 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T04:29:28.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:29:28.764 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T04:29:28.827 DEBUG:teuthology.orchestra.run.smithi060:> mktemp -d --suffix=xfstests-dev 2023-10-06T04:29:28.863 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.cHkpSAqJTKxfstests-dev 2023-10-06T04:29:28.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:29:28.863 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.cHkpSAqJTKxfstests-dev) 2023-10-06T04:29:28.945 INFO:teuthology.orchestra.run.smithi060.stderr:Cloning into '/tmp/tmp.cHkpSAqJTKxfstests-dev'... 2023-10-06T04:29:29.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:29:29.912 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-10-06T04:29:29.996 DEBUG:teuthology.orchestra.run.smithi060:> mktemp -d --suffix=test 2023-10-06T04:29:30.073 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.z2GYIdStE6test 2023-10-06T04:29:30.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:29:30.074 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo ln -s /home/ubuntu/cephtest/mnt.0/test /tmp/tmp.z2GYIdStE6test) 2023-10-06T04:29:30.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:29:30.190 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-10-06T04:29:30.228 DEBUG:teuthology.orchestra.run.smithi060:> mktemp -d --suffix=scratch 2023-10-06T04:29:30.305 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.JLdtAG10Ujscratch 2023-10-06T04:29:30.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:29:30.306 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo ln -s /home/ubuntu/cephtest/mnt.0/scratch /tmp/tmp.JLdtAG10Ujscratch) 2023-10-06T04:29:30.413 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.4". 2023-10-06T04:29:30.413 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-10-06T04:29:30.940 INFO:teuthology.orchestra.run.smithi060.stdout:Updating Subscription Management repositories. 2023-10-06T04:29:31.960 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:04:26 ago on Fri 06 Oct 2023 04:25:05 AM UTC. 2023-10-06T04:29:33.468 INFO:teuthology.orchestra.run.smithi060.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T04:29:33.468 INFO:teuthology.orchestra.run.smithi060.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T04:29:33.469 INFO:teuthology.orchestra.run.smithi060.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-10-06T04:29:33.470 INFO:teuthology.orchestra.run.smithi060.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-10-06T04:29:33.471 INFO:teuthology.orchestra.run.smithi060.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-10-06T04:29:33.473 INFO:teuthology.orchestra.run.smithi060.stdout:Package e2fsprogs-1.45.6-1.el8.x86_64 is already installed. 2023-10-06T04:29:33.475 INFO:teuthology.orchestra.run.smithi060.stdout:Package gawk-4.2.1-2.el8.x86_64 is already installed. 2023-10-06T04:29:33.476 INFO:teuthology.orchestra.run.smithi060.stdout:Package gcc-8.4.1-1.el8.x86_64 is already installed. 2023-10-06T04:29:33.477 INFO:teuthology.orchestra.run.smithi060.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-10-06T04:29:33.478 INFO:teuthology.orchestra.run.smithi060.stdout:Package lvm2-8:2.03.11-5.el8.x86_64 is already installed. 2023-10-06T04:29:33.479 INFO:teuthology.orchestra.run.smithi060.stdout:Package make-1:4.2.1-10.el8.x86_64 is already installed. 2023-10-06T04:29:33.480 INFO:teuthology.orchestra.run.smithi060.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-10-06T04:29:33.481 INFO:teuthology.orchestra.run.smithi060.stdout:Package quota-1:4.04-12.el8.x86_64 is already installed. 2023-10-06T04:29:33.482 INFO:teuthology.orchestra.run.smithi060.stdout:Package sed-4.5-2.el8.x86_64 is already installed. 2023-10-06T04:29:33.483 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T04:29:33.484 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T04:29:33.485 INFO:teuthology.orchestra.run.smithi060.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T04:29:33.486 INFO:teuthology.orchestra.run.smithi060.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T04:29:33.486 INFO:teuthology.orchestra.run.smithi060.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-10-06T04:29:33.487 INFO:teuthology.orchestra.run.smithi060.stdout:Package libuuid-devel-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T04:29:33.488 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsprogs-devel-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T04:29:33.490 INFO:teuthology.orchestra.run.smithi060.stdout:Package sqlite-3.26.0-13.el8.x86_64 is already installed. 2023-10-06T04:29:33.494 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T04:29:34.009 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2023-10-06T04:29:34.010 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================================================== 2023-10-06T04:29:34.010 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2023-10-06T04:29:34.010 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================================================== 2023-10-06T04:29:34.010 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2023-10-06T04:29:34.011 INFO:teuthology.orchestra.run.smithi060.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-10-06T04:29:34.011 INFO:teuthology.orchestra.run.smithi060.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T04:29:34.011 INFO:teuthology.orchestra.run.smithi060.stdout: indent x86_64 2.2.13-4.el8 epel 187 k 2023-10-06T04:29:34.011 INFO:teuthology.orchestra.run.smithi060.stdout: python2 x86_64 2.7.18-4.module+el8.4.0+9577+0b56c8de rhel-8-for-x86_64-appstream-rpms 109 k 2023-10-06T04:29:34.011 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2023-10-06T04:29:34.011 INFO:teuthology.orchestra.run.smithi060.stdout: daxctl-libs x86_64 71.1-2.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-10-06T04:29:34.011 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-10-06T04:29:34.011 INFO:teuthology.orchestra.run.smithi060.stdout: ndctl-libs x86_64 71.1-2.el8 rhel-8-for-x86_64-baseos-rpms 78 k 2023-10-06T04:29:34.011 INFO:teuthology.orchestra.run.smithi060.stdout: python2-libs x86_64 2.7.18-4.module+el8.4.0+9577+0b56c8de rhel-8-for-x86_64-appstream-rpms 6.0 M 2023-10-06T04:29:34.012 INFO:teuthology.orchestra.run.smithi060.stdout: python2-pip-wheel noarch 9.0.3-18.module+el8.3.0+7707+eb4bba01 rhel-8-for-x86_64-appstream-rpms 1.0 M 2023-10-06T04:29:34.012 INFO:teuthology.orchestra.run.smithi060.stdout: python2-setuptools-wheel noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 287 k 2023-10-06T04:29:34.012 INFO:teuthology.orchestra.run.smithi060.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-10-06T04:29:34.012 INFO:teuthology.orchestra.run.smithi060.stdout:Installing weak dependencies: 2023-10-06T04:29:34.012 INFO:teuthology.orchestra.run.smithi060.stdout: python2-pip noarch 9.0.3-18.module+el8.3.0+7707+eb4bba01 rhel-8-for-x86_64-appstream-rpms 1.7 M 2023-10-06T04:29:34.012 INFO:teuthology.orchestra.run.smithi060.stdout: python2-setuptools noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 642 k 2023-10-06T04:29:34.013 INFO:teuthology.orchestra.run.smithi060.stdout:Enabling module streams: 2023-10-06T04:29:34.013 INFO:teuthology.orchestra.run.smithi060.stdout: python27 2.7 2023-10-06T04:29:34.013 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:34.013 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2023-10-06T04:29:34.013 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================================================== 2023-10-06T04:29:34.013 INFO:teuthology.orchestra.run.smithi060.stdout:Install 13 Packages 2023-10-06T04:29:34.013 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:34.014 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 11 M 2023-10-06T04:29:34.014 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 41 M 2023-10-06T04:29:34.014 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2023-10-06T04:29:34.251 INFO:teuthology.orchestra.run.smithi060.stdout:(1/13): python2-pip-wheel-9.0.3-18.module+el8.3 12 MB/s | 1.0 MB 00:00 2023-10-06T04:29:34.259 INFO:teuthology.orchestra.run.smithi060.stdout:(2/13): python2-pip-9.0.3-18.module+el8.3.0+770 19 MB/s | 1.7 MB 00:00 2023-10-06T04:29:34.290 INFO:teuthology.orchestra.run.smithi060.stdout:(3/13): libpmemblk-1.6.1-1.el8.x86_64.rpm 2.3 MB/s | 92 kB 00:00 2023-10-06T04:29:34.308 INFO:teuthology.orchestra.run.smithi060.stdout:(4/13): fio-3.19-3.el8.x86_64.rpm 11 MB/s | 538 kB 00:00 2023-10-06T04:29:34.318 INFO:teuthology.orchestra.run.smithi060.stdout:(5/13): python2-2.7.18-4.module+el8.4.0+9577+0b 3.9 MB/s | 109 kB 00:00 2023-10-06T04:29:34.345 INFO:teuthology.orchestra.run.smithi060.stdout:(6/13): python2-setuptools-39.0.1-13.module+el8 17 MB/s | 642 kB 00:00 2023-10-06T04:29:34.375 INFO:teuthology.orchestra.run.smithi060.stdout:(7/13): python2-setuptools-wheel-39.0.1-13.modu 9.4 MB/s | 287 kB 00:00 2023-10-06T04:29:34.403 INFO:teuthology.orchestra.run.smithi060.stdout:(8/13): dump-0.4-0.36.b46.el8.x86_64.rpm 5.8 MB/s | 164 kB 00:00 2023-10-06T04:29:34.428 INFO:teuthology.orchestra.run.smithi060.stdout:(9/13): rmt-1.5.3-13.el8.x86_64.rpm 2.0 MB/s | 51 kB 00:00 2023-10-06T04:29:34.457 INFO:teuthology.orchestra.run.smithi060.stdout:(10/13): python2-libs-2.7.18-4.module+el8.4.0+9 43 MB/s | 6.0 MB 00:00 2023-10-06T04:29:34.458 INFO:teuthology.orchestra.run.smithi060.stdout:(11/13): daxctl-libs-71.1-2.el8.x86_64.rpm 1.4 MB/s | 42 kB 00:00 2023-10-06T04:29:34.481 INFO:teuthology.orchestra.run.smithi060.stdout:(12/13): ndctl-libs-71.1-2.el8.x86_64.rpm 3.2 MB/s | 78 kB 00:00 2023-10-06T04:29:34.534 INFO:teuthology.orchestra.run.smithi060.stdout:(13/13): indent-2.2.13-4.el8.x86_64.rpm 508 kB/s | 187 kB 00:00 2023-10-06T04:29:34.536 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2023-10-06T04:29:34.536 INFO:teuthology.orchestra.run.smithi060.stdout:Total 21 MB/s | 11 MB 00:00 2023-10-06T04:29:34.557 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2023-10-06T04:29:34.589 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2023-10-06T04:29:34.589 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2023-10-06T04:29:34.867 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2023-10-06T04:29:34.873 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2023-10-06T04:29:35.508 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2023-10-06T04:29:35.629 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : daxctl-libs-71.1-2.el8.x86_64 1/13 2023-10-06T04:29:35.731 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: daxctl-libs-71.1-2.el8.x86_64 1/13 2023-10-06T04:29:35.862 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ndctl-libs-71.1-2.el8.x86_64 2/13 2023-10-06T04:29:36.000 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ndctl-libs-71.1-2.el8.x86_64 2/13 2023-10-06T04:29:36.162 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 3/13 2023-10-06T04:29:36.271 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 3/13 2023-10-06T04:29:36.461 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 4/13 2023-10-06T04:29:36.748 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 5/13 2023-10-06T04:29:37.131 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python2-pip-wheel-9.0.3-18.module+el8.3.0+7707+eb4 6/13 2023-10-06T04:29:38.952 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 7/13 2023-10-06T04:29:38.991 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:29:38.996 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:29:39.279 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python2-libs-2.7.18-4.module+el8.4.0+9577+0b56c8de 8/13 2023-10-06T04:29:39.481 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python2-2.7.18-4.module+el8.4.0+9577+0b56c8de.x86_ 9/13 2023-10-06T04:29:40.072 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: python2-2.7.18-4.module+el8.4.0+9577+0b56c8de.x86_ 9/13 2023-10-06T04:29:40.410 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python2-pip-9.0.3-18.module+el8.3.0+7707+eb4bba01. 10/13 2023-10-06T04:29:40.730 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 11/13 2023-10-06T04:29:41.032 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fio-3.19-3.el8.x86_64 12/13 2023-10-06T04:29:41.229 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : indent-2.2.13-4.el8.x86_64 13/13 2023-10-06T04:29:41.681 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: indent-2.2.13-4.el8.x86_64 13/13 2023-10-06T04:29:41.681 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : indent-2.2.13-4.el8.x86_64 1/13 2023-10-06T04:29:41.681 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python2-pip-9.0.3-18.module+el8.3.0+7707+eb4bba01. 2/13 2023-10-06T04:29:41.681 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python2-pip-wheel-9.0.3-18.module+el8.3.0+7707+eb4 3/13 2023-10-06T04:29:41.681 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 4/13 2023-10-06T04:29:41.681 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fio-3.19-3.el8.x86_64 5/13 2023-10-06T04:29:41.681 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python2-2.7.18-4.module+el8.4.0+9577+0b56c8de.x86_ 6/13 2023-10-06T04:29:41.681 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 7/13 2023-10-06T04:29:41.682 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python2-libs-2.7.18-4.module+el8.4.0+9577+0b56c8de 8/13 2023-10-06T04:29:41.682 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 9/13 2023-10-06T04:29:41.682 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 10/13 2023-10-06T04:29:41.682 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 11/13 2023-10-06T04:29:41.682 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : daxctl-libs-71.1-2.el8.x86_64 12/13 2023-10-06T04:29:43.077 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ndctl-libs-71.1-2.el8.x86_64 13/13 2023-10-06T04:29:43.077 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:04:38 ago on Fri 06 Oct 2023 04:25:05 AM UTC. 2023-10-06T04:29:45.281 INFO:teuthology.orchestra.run.smithi060.stdout:Installed products updated. 2023-10-06T04:29:45.395 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:45.395 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2023-10-06T04:29:45.395 INFO:teuthology.orchestra.run.smithi060.stdout: daxctl-libs-71.1-2.el8.x86_64 2023-10-06T04:29:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-10-06T04:29:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: fio-3.19-3.el8.x86_64 2023-10-06T04:29:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: indent-2.2.13-4.el8.x86_64 2023-10-06T04:29:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-10-06T04:29:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: ndctl-libs-71.1-2.el8.x86_64 2023-10-06T04:29:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: python2-2.7.18-4.module+el8.4.0+9577+0b56c8de.x86_64 2023-10-06T04:29:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: python2-libs-2.7.18-4.module+el8.4.0+9577+0b56c8de.x86_64 2023-10-06T04:29:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: python2-pip-9.0.3-18.module+el8.3.0+7707+eb4bba01.noarch 2023-10-06T04:29:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: python2-pip-wheel-9.0.3-18.module+el8.3.0+7707+eb4bba01.noarch 2023-10-06T04:29:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: python2-setuptools-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-10-06T04:29:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: python2-setuptools-wheel-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-10-06T04:29:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-10-06T04:29:45.397 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:45.397 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2023-10-06T04:29:45.567 DEBUG:teuthology.orchestra.run.smithi060:> sudo useradd fsgqa 2023-10-06T04:29:45.630 INFO:teuthology.orchestra.run.smithi060.stderr:useradd: user 'fsgqa' already exists 2023-10-06T04:29:45.633 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-10-06T04:29:45.634 DEBUG:teuthology.orchestra.run.smithi060:> sudo groupadd fsgqa 2023-10-06T04:29:45.695 INFO:teuthology.orchestra.run.smithi060.stderr:groupadd: group 'fsgqa' already exists 2023-10-06T04:29:45.697 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-10-06T04:29:45.698 DEBUG:teuthology.orchestra.run.smithi060:> sudo useradd 123456-fsgqa 2023-10-06T04:29:48.691 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-10-06T04:29:48.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.903+0000 7ffbe759d700 1 Processor -- start 2023-10-06T04:29:48.905 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.904+0000 7ffbe759d700 1 -- start start 2023-10-06T04:29:48.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.905+0000 7ffbe759d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffbe006f150 0x7ffbe00c7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:48.906 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.905+0000 7ffbe759d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbe00c1e40 0x7ffbe00c22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:48.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.905+0000 7ffbe759d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe00c19b0 con 0x7ffbe0140b30 2023-10-06T04:29:48.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.905+0000 7ffbe759d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe00c0da0 con 0x7ffbe006f150 2023-10-06T04:29:48.907 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.905+0000 7ffbe759d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe00c1080 con 0x7ffbe00c1e40 2023-10-06T04:29:48.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.906+0000 7ffbe5d9a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffbe006f150 0x7ffbe00c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:48.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.906+0000 7ffbe6d9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbe00c1e40 0x7ffbe00c22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:48.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.906+0000 7ffbe5d9a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffbe006f150 0x7ffbe00c7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:47884/0 (socket says 172.21.15.60:47884) 2023-10-06T04:29:48.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.906+0000 7ffbe6d9c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbe00c1e40 0x7ffbe00c22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:44696/0 (socket says 172.21.15.60:44696) 2023-10-06T04:29:48.908 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.906+0000 7ffbe5d9a700 1 -- 172.21.15.60:0/4282746577 learned_addr learned my addr 172.21.15.60:0/4282746577 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:48.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.906+0000 7ffbe659b700 1 --1- 172.21.15.60:0/4282746577 >> v1:172.21.15.135:6789/0 conn(0x7ffbe0140b30 0x7ffbe00aed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.60:45216/0 (socket says 172.21.15.60:45216) 2023-10-06T04:29:48.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.906+0000 7ffbe5d9a700 1 -- 172.21.15.60:0/4282746577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbe00c1e40 msgr2=0x7ffbe00c22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:48.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.906+0000 7ffbe5d9a700 1 --2- 172.21.15.60:0/4282746577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbe00c1e40 0x7ffbe00c22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:48.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.906+0000 7ffbe5d9a700 1 -- 172.21.15.60:0/4282746577 >> v1:172.21.15.135:6789/0 conn(0x7ffbe0140b30 legacy=0x7ffbe00aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:48.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.906+0000 7ffbe5d9a700 1 -- 172.21.15.60:0/4282746577 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe00c1360 con 0x7ffbe006f150 2023-10-06T04:29:48.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.906+0000 7ffbe5d9a700 1 --2- 172.21.15.60:0/4282746577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbe006f150 0x7ffbe00c7770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00099b0 tx=0x7ffbd0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81aee0f179aaeae0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:48.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.907+0000 7ffbe5599700 1 -- 172.21.15.60:0/4282746577 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0009ea0 con 0x7ffbe006f150 2023-10-06T04:29:48.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.907+0000 7ffbe5599700 1 -- 172.21.15.60:0/4282746577 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd000b860 con 0x7ffbe006f150 2023-10-06T04:29:48.909 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.907+0000 7ffbe5599700 1 -- 172.21.15.60:0/4282746577 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd000bc00 con 0x7ffbe006f150 2023-10-06T04:29:48.910 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.907+0000 7ffbe759d700 1 -- 172.21.15.60:0/4282746577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbe006f150 msgr2=0x7ffbe00c7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.907+0000 7ffbe759d700 1 --2- 172.21.15.60:0/4282746577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbe006f150 0x7ffbe00c7770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00099b0 tx=0x7ffbd0009250 comp rx=0 tx=0).stop 2023-10-06T04:29:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.907+0000 7ffbe759d700 1 -- 172.21.15.60:0/4282746577 shutdown_connections 2023-10-06T04:29:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.907+0000 7ffbe759d700 1 --2- 172.21.15.60:0/4282746577 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbe00c1e40 0x7ffbe00c22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.907+0000 7ffbe759d700 1 --2- 172.21.15.60:0/4282746577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbe006f150 0x7ffbe00c7770 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.907+0000 7ffbe759d700 1 -- 172.21.15.60:0/4282746577 >> 172.21.15.60:0/4282746577 conn(0x7ffbe00cbeb0 msgr2=0x7ffbe00cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.908+0000 7ffbe759d700 1 -- 172.21.15.60:0/4282746577 shutdown_connections 2023-10-06T04:29:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.908+0000 7ffbe759d700 1 -- 172.21.15.60:0/4282746577 wait complete. 2023-10-06T04:29:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.909+0000 7ffbe759d700 1 Processor -- start 2023-10-06T04:29:48.911 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.909+0000 7ffbe759d700 1 -- start start 2023-10-06T04:29:48.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.910+0000 7ffbe759d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbe006f150 0x7ffbe00c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:48.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.910+0000 7ffbe759d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbe00c1e40 0x7ffbe016a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:48.913 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.910+0000 7ffbe759d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbe0140b30 0x7ffbe006a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.910+0000 7ffbe759d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe00a6ef0 con 0x7ffbe00c1e40 2023-10-06T04:29:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.910+0000 7ffbe759d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe016b750 con 0x7ffbe0140b30 2023-10-06T04:29:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.910+0000 7ffbe759d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe016aac0 con 0x7ffbe006f150 2023-10-06T04:29:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.910+0000 7ffbe5d9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbe00c1e40 0x7ffbe016a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.910+0000 7ffbe5d9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbe00c1e40 0x7ffbe016a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48706/0 (socket says 172.21.15.60:48706) 2023-10-06T04:29:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.910+0000 7ffbe5d9a700 1 -- 172.21.15.60:0/3993634219 learned_addr learned my addr 172.21.15.60:0/3993634219 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.911+0000 7ffbe6d9c700 1 --2- 172.21.15.60:0/3993634219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbe0140b30 0x7ffbe006a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.911+0000 7ffbe659b700 1 --2- 172.21.15.60:0/3993634219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbe006f150 0x7ffbe00c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.911+0000 7ffbe5d9a700 1 -- 172.21.15.60:0/3993634219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbe006f150 msgr2=0x7ffbe00c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.911+0000 7ffbe5d9a700 1 --2- 172.21.15.60:0/3993634219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbe006f150 0x7ffbe00c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:48.914 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.911+0000 7ffbe5d9a700 1 -- 172.21.15.60:0/3993634219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbe0140b30 msgr2=0x7ffbe006a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.911+0000 7ffbe5d9a700 1 --2- 172.21.15.60:0/3993634219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbe0140b30 0x7ffbe006a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.911+0000 7ffbe5d9a700 1 -- 172.21.15.60:0/3993634219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd00094f0 con 0x7ffbe00c1e40 2023-10-06T04:29:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.911+0000 7ffbe6d9c700 1 --2- 172.21.15.60:0/3993634219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbe0140b30 0x7ffbe006a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.911+0000 7ffbe5d9a700 1 --2- 172.21.15.60:0/3993634219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbe00c1e40 0x7ffbe016a040 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0071750 tx=0x7ffbd0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.911+0000 7ffbd67fc700 1 -- 172.21.15.60:0/3993634219 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd000bbe0 con 0x7ffbe00c1e40 2023-10-06T04:29:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.911+0000 7ffbd67fc700 1 -- 172.21.15.60:0/3993634219 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd0011420 con 0x7ffbe00c1e40 2023-10-06T04:29:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.911+0000 7ffbd67fc700 1 -- 172.21.15.60:0/3993634219 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd00117c0 con 0x7ffbe00c1e40 2023-10-06T04:29:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.911+0000 7ffbe759d700 1 -- 172.21.15.60:0/3993634219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe016ada0 con 0x7ffbe00c1e40 2023-10-06T04:29:48.915 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.912+0000 7ffbe759d700 1 -- 172.21.15.60:0/3993634219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe016b0e0 con 0x7ffbe00c1e40 2023-10-06T04:29:48.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.913+0000 7ffbe759d700 1 -- 172.21.15.60:0/3993634219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe016b8c0 con 0x7ffbe00c1e40 2023-10-06T04:29:48.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.913+0000 7ffbd67fc700 1 -- 172.21.15.60:0/3993634219 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffbd0011bf0 con 0x7ffbe00c1e40 2023-10-06T04:29:48.916 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.915+0000 7ffbd67fc700 1 --2- 172.21.15.60:0/3993634219 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ffbc4066f30 0x7ffbc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:48.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.915+0000 7ffbd67fc700 1 -- 172.21.15.60:0/3993634219 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ffbd0086200 con 0x7ffbe00c1e40 2023-10-06T04:29:48.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.915+0000 7ffbe659b700 1 --2- 172.21.15.60:0/3993634219 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ffbc4066f30 0x7ffbc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:48.917 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.916+0000 7ffbe659b700 1 --2- 172.21.15.60:0/3993634219 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ffbc4066f30 0x7ffbc40693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc007fd0 tx=0x7ffbdc007d70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:48.921 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:48.919+0000 7ffbd67fc700 1 -- 172.21.15.60:0/3993634219 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffbd0053130 con 0x7ffbe00c1e40 2023-10-06T04:29:49.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.209+0000 7ffbe759d700 1 -- 172.21.15.60:0/3993634219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ffbe005f230 con 0x7ffbe00c1e40 2023-10-06T04:29:49.211 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.209+0000 7ffbd67fc700 1 -- 172.21.15.60:0/3993634219 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1271 (secure 0 0 0) 0x7ffbd0056750 con 0x7ffbe00c1e40 2023-10-06T04:29:49.211 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:29:49.211 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":1,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","modified":"2023-10-06T04:27:10.821300Z","created":"2023-10-06T04:27:10.821300Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3301","nonce":0},{"type":"v1","addr":"172.21.15.135:6790","nonce":0}]},"addr":"172.21.15.135:6790/0","public_addr":"172.21.15.135:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-10-06T04:29:49.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.211+0000 7ffbe759d700 1 -- 172.21.15.60:0/3993634219 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ffbc4066f30 msgr2=0x7ffbc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:49.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.211+0000 7ffbe759d700 1 --2- 172.21.15.60:0/3993634219 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ffbc4066f30 0x7ffbc40693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc007fd0 tx=0x7ffbdc007d70 comp rx=0 tx=0).stop 2023-10-06T04:29:49.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.211+0000 7ffbe759d700 1 -- 172.21.15.60:0/3993634219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbe00c1e40 msgr2=0x7ffbe016a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:49.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.212+0000 7ffbe759d700 1 --2- 172.21.15.60:0/3993634219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbe00c1e40 0x7ffbe016a040 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0071750 tx=0x7ffbd0017000 comp rx=0 tx=0).stop 2023-10-06T04:29:49.213 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.212+0000 7ffbe759d700 1 -- 172.21.15.60:0/3993634219 shutdown_connections 2023-10-06T04:29:49.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.212+0000 7ffbe759d700 1 --2- 172.21.15.60:0/3993634219 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ffbc4066f30 0x7ffbc40693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:49.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.212+0000 7ffbe759d700 1 --2- 172.21.15.60:0/3993634219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbe0140b30 0x7ffbe006a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:49.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.212+0000 7ffbe759d700 1 --2- 172.21.15.60:0/3993634219 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffbe006f150 0x7ffbe00c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:49.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.212+0000 7ffbe759d700 1 --2- 172.21.15.60:0/3993634219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbe00c1e40 0x7ffbe016a040 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:49.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.212+0000 7ffbe759d700 1 -- 172.21.15.60:0/3993634219 >> 172.21.15.60:0/3993634219 conn(0x7ffbe00cbeb0 msgr2=0x7ffbe00b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:49.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.212+0000 7ffbe759d700 1 -- 172.21.15.60:0/3993634219 shutdown_connections 2023-10-06T04:29:49.214 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.212+0000 7ffbe759d700 1 -- 172.21.15.60:0/3993634219 wait complete. 2023-10-06T04:29:49.214 INFO:teuthology.orchestra.run.smithi060.stderr:dumped monmap epoch 1 2023-10-06T04:29:49.231 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-10-06T04:29:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.436+0000 7fbd2d39d700 1 Processor -- start 2023-10-06T04:29:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.437+0000 7fbd2d39d700 1 -- start start 2023-10-06T04:29:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.438+0000 7fbd2d39d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbd2813f9f0 0x7fbd280c0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.438+0000 7fbd2d39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbd2815a5f0 0x7fbd280c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.438+0000 7fbd2d39d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd280c1240 con 0x7fbd280ca490 2023-10-06T04:29:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.438+0000 7fbd2d39d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd280cb4d0 con 0x7fbd2813f9f0 2023-10-06T04:29:49.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.438+0000 7fbd2d39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2806f480 con 0x7fbd2815a5f0 2023-10-06T04:29:49.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.438+0000 7fbd27fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbd2813f9f0 0x7fbd280c0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:49.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.438+0000 7fbd277fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbd280ca490 0x7fbd28159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56076/0 (socket says 172.21.15.60:56076) 2023-10-06T04:29:49.440 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.438+0000 7fbd277fe700 1 -- 172.21.15.60:0/2228994076 learned_addr learned my addr 172.21.15.60:0/2228994076 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:29:49.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.438+0000 7fbd2cb9c700 1 --2- 172.21.15.60:0/2228994076 >> v2:172.21.15.135:3300/0 conn(0x7fbd2815a5f0 0x7fbd280c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:49.441 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.438+0000 7fbd27fff700 1 -- 172.21.15.60:0/2228994076 >> v2:172.21.15.135:3300/0 conn(0x7fbd2815a5f0 msgr2=0x7fbd280c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:29:49.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.438+0000 7fbd27fff700 1 --2- 172.21.15.60:0/2228994076 >> v2:172.21.15.135:3300/0 conn(0x7fbd2815a5f0 0x7fbd280c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:49.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.438+0000 7fbd27fff700 1 -- 172.21.15.60:0/2228994076 >> v1:172.21.15.60:6789/0 conn(0x7fbd280ca490 legacy=0x7fbd28159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:49.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.438+0000 7fbd26ffd700 1 -- 172.21.15.60:0/2228994076 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035567228 0 0) 0x7fbd280c1240 con 0x7fbd280ca490 2023-10-06T04:29:49.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.439+0000 7fbd27fff700 1 -- 172.21.15.60:0/2228994076 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd280ca950 con 0x7fbd2813f9f0 2023-10-06T04:29:49.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.439+0000 7fbd2cb9c700 1 --2- 172.21.15.60:0/2228994076 >> v2:172.21.15.135:3300/0 conn(0x7fbd2815a5f0 0x7fbd280c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:29:49.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.439+0000 7fbd27fff700 1 --2- 172.21.15.60:0/2228994076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd2813f9f0 0x7fbd280c0d00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbd28068990 tx=0x7fbd180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe1ef8eece940d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:49.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.439+0000 7fbd26ffd700 1 -- 172.21.15.60:0/2228994076 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1800b6b0 con 0x7fbd2813f9f0 2023-10-06T04:29:49.442 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.439+0000 7fbd26ffd700 1 -- 172.21.15.60:0/2228994076 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1800b810 con 0x7fbd2813f9f0 2023-10-06T04:29:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.439+0000 7fbd26ffd700 1 -- 172.21.15.60:0/2228994076 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1800bbb0 con 0x7fbd2813f9f0 2023-10-06T04:29:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.439+0000 7fbd2d39d700 1 -- 172.21.15.60:0/2228994076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd2813f9f0 msgr2=0x7fbd280c0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.439+0000 7fbd2d39d700 1 --2- 172.21.15.60:0/2228994076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd2813f9f0 0x7fbd280c0d00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbd28068990 tx=0x7fbd180091a0 comp rx=0 tx=0).stop 2023-10-06T04:29:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.440+0000 7fbd2d39d700 1 -- 172.21.15.60:0/2228994076 shutdown_connections 2023-10-06T04:29:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.440+0000 7fbd2d39d700 1 --2- 172.21.15.60:0/2228994076 >> v2:172.21.15.135:3300/0 conn(0x7fbd2815a5f0 0x7fbd280c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.440+0000 7fbd2d39d700 1 --2- 172.21.15.60:0/2228994076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd2813f9f0 0x7fbd280c0d00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.440+0000 7fbd2d39d700 1 -- 172.21.15.60:0/2228994076 >> 172.21.15.60:0/2228994076 conn(0x7fbd280cbeb0 msgr2=0x7fbd280cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.440+0000 7fbd2d39d700 1 -- 172.21.15.60:0/2228994076 shutdown_connections 2023-10-06T04:29:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.440+0000 7fbd2d39d700 1 -- 172.21.15.60:0/2228994076 wait complete. 2023-10-06T04:29:49.445 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.441+0000 7fbd2d39d700 1 Processor -- start 2023-10-06T04:29:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.441+0000 7fbd2d39d700 1 -- start start 2023-10-06T04:29:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.442+0000 7fbd2d39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd280ca490 0x7fbd28155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.442+0000 7fbd2d39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbd2813f9f0 0x7fbd2816d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.442+0000 7fbd2d39d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd2815a5f0 0x7fbd2816d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.442+0000 7fbd2d39d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd280c5910 con 0x7fbd2815a5f0 2023-10-06T04:29:49.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.442+0000 7fbd2d39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2816b440 con 0x7fbd280ca490 2023-10-06T04:29:49.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.442+0000 7fbd2d39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd28156460 con 0x7fbd2813f9f0 2023-10-06T04:29:49.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.442+0000 7fbd2cb9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd2815a5f0 0x7fbd2816d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:49.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.442+0000 7fbd2cb9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd2815a5f0 0x7fbd2816d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48732/0 (socket says 172.21.15.60:48732) 2023-10-06T04:29:49.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.442+0000 7fbd2cb9c700 1 -- 172.21.15.60:0/2981407108 learned_addr learned my addr 172.21.15.60:0/2981407108 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:29:49.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.443+0000 7fbd27fff700 1 --2- 172.21.15.60:0/2981407108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd280ca490 0x7fbd28155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:49.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.443+0000 7fbd277fe700 1 --2- 172.21.15.60:0/2981407108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbd2813f9f0 0x7fbd2816d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:49.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.443+0000 7fbd2cb9c700 1 -- 172.21.15.60:0/2981407108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbd2813f9f0 msgr2=0x7fbd2816d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:49.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.443+0000 7fbd2cb9c700 1 --2- 172.21.15.60:0/2981407108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbd2813f9f0 0x7fbd2816d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:49.447 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.443+0000 7fbd2cb9c700 1 -- 172.21.15.60:0/2981407108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd280ca490 msgr2=0x7fbd28155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:49.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.443+0000 7fbd2cb9c700 1 --2- 172.21.15.60:0/2981407108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd280ca490 0x7fbd28155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:49.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.443+0000 7fbd2cb9c700 1 -- 172.21.15.60:0/2981407108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd18009420 con 0x7fbd2815a5f0 2023-10-06T04:29:49.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.443+0000 7fbd27fff700 1 --2- 172.21.15.60:0/2981407108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd280ca490 0x7fbd28155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:29:49.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.443+0000 7fbd2cb9c700 1 --2- 172.21.15.60:0/2981407108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd2815a5f0 0x7fbd2816d5c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000cef0 tx=0x7fbd20007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:49.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.443+0000 7fbd0ffff700 1 -- 172.21.15.60:0/2981407108 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2000ae00 con 0x7fbd2815a5f0 2023-10-06T04:29:49.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.443+0000 7fbd0ffff700 1 -- 172.21.15.60:0/2981407108 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd20016420 con 0x7fbd2815a5f0 2023-10-06T04:29:49.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.443+0000 7fbd0ffff700 1 -- 172.21.15.60:0/2981407108 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd200167e0 con 0x7fbd2815a5f0 2023-10-06T04:29:49.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.443+0000 7fbd2d39d700 1 -- 172.21.15.60:0/2981407108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd280c5630 con 0x7fbd2815a5f0 2023-10-06T04:29:49.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.444+0000 7fbd2d39d700 1 -- 172.21.15.60:0/2981407108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2816b0d0 con 0x7fbd2815a5f0 2023-10-06T04:29:49.448 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.444+0000 7fbd2d39d700 1 -- 172.21.15.60:0/2981407108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2816ac50 con 0x7fbd2815a5f0 2023-10-06T04:29:49.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.445+0000 7fbd0ffff700 1 -- 172.21.15.60:0/2981407108 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd20016bd0 con 0x7fbd2815a5f0 2023-10-06T04:29:49.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.446+0000 7fbd0ffff700 1 --2- 172.21.15.60:0/2981407108 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbd14066f30 0x7fbd140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:29:49.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.446+0000 7fbd0ffff700 1 -- 172.21.15.60:0/2981407108 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fbd20012070 con 0x7fbd2815a5f0 2023-10-06T04:29:49.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.446+0000 7fbd27fff700 1 --2- 172.21.15.60:0/2981407108 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbd14066f30 0x7fbd140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:29:49.449 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.447+0000 7fbd27fff700 1 --2- 172.21.15.60:0/2981407108 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbd14066f30 0x7fbd140693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbd180093f0 tx=0x7fbd18017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:29:49.452 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.451+0000 7fbd0ffff700 1 -- 172.21.15.60:0/2981407108 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd2004e5a0 con 0x7fbd2815a5f0 2023-10-06T04:29:49.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.730+0000 7fbd2d39d700 1 -- 172.21.15.60:0/2981407108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7fbd2805f230 con 0x7fbd2815a5f0 2023-10-06T04:29:49.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.731+0000 7fbd0ffff700 1 -- 172.21.15.60:0/2981407108 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7fbd2816ac50 con 0x7fbd2815a5f0 2023-10-06T04:29:49.732 INFO:teuthology.orchestra.run.smithi060.stdout:[client.admin] 2023-10-06T04:29:49.732 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQCfjB9l4MLwCBAAeWWOdyyVGWObCY83qRs1oQ== 2023-10-06T04:29:49.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.733+0000 7fbd2d39d700 1 -- 172.21.15.60:0/2981407108 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbd14066f30 msgr2=0x7fbd140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:49.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.733+0000 7fbd2d39d700 1 --2- 172.21.15.60:0/2981407108 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbd14066f30 0x7fbd140693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbd180093f0 tx=0x7fbd18017000 comp rx=0 tx=0).stop 2023-10-06T04:29:49.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.733+0000 7fbd2d39d700 1 -- 172.21.15.60:0/2981407108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd2815a5f0 msgr2=0x7fbd2816d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:29:49.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.733+0000 7fbd2d39d700 1 --2- 172.21.15.60:0/2981407108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd2815a5f0 0x7fbd2816d5c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000cef0 tx=0x7fbd20007860 comp rx=0 tx=0).stop 2023-10-06T04:29:49.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.733+0000 7fbd2d39d700 1 -- 172.21.15.60:0/2981407108 shutdown_connections 2023-10-06T04:29:49.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.733+0000 7fbd2d39d700 1 --2- 172.21.15.60:0/2981407108 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbd14066f30 0x7fbd140693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:49.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.733+0000 7fbd2d39d700 1 --2- 172.21.15.60:0/2981407108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd2815a5f0 0x7fbd2816d5c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:49.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.733+0000 7fbd2d39d700 1 --2- 172.21.15.60:0/2981407108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd280ca490 0x7fbd28155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:49.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.733+0000 7fbd2d39d700 1 --2- 172.21.15.60:0/2981407108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbd2813f9f0 0x7fbd2816d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:29:49.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.733+0000 7fbd2d39d700 1 -- 172.21.15.60:0/2981407108 >> 172.21.15.60:0/2981407108 conn(0x7fbd280cbeb0 msgr2=0x7fbd280c9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:29:49.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.733+0000 7fbd2d39d700 1 -- 172.21.15.60:0/2981407108 shutdown_connections 2023-10-06T04:29:49.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:29:49.733+0000 7fbd2d39d700 1 -- 172.21.15.60:0/2981407108 wait complete. 2023-10-06T04:29:49.754 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2023-10-06T04:29:49.754 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/tmp/tmp.cHkpSAqJTKxfstests-dev/local.config 2023-10-06T04:29:49.816 DEBUG:teuthology.orchestra.run.smithi060:> (cd /tmp/tmp.cHkpSAqJTKxfstests-dev && exec sudo make) 2023-10-06T04:29:49.930 INFO:teuthology.orchestra.run.smithi060.stdout:libtoolize -cfi 2023-10-06T04:29:50.467 INFO:teuthology.orchestra.run.smithi060.stdout:libtoolize: putting auxiliary files in '.'. 2023-10-06T04:29:50.468 INFO:teuthology.orchestra.run.smithi060.stdout:libtoolize: copying file './config.guess' 2023-10-06T04:29:50.477 INFO:teuthology.orchestra.run.smithi060.stdout:libtoolize: copying file './config.sub' 2023-10-06T04:29:50.487 INFO:teuthology.orchestra.run.smithi060.stdout:libtoolize: copying file './install-sh' 2023-10-06T04:29:50.498 INFO:teuthology.orchestra.run.smithi060.stdout:libtoolize: copying file './ltmain.sh' 2023-10-06T04:29:50.558 INFO:teuthology.orchestra.run.smithi060.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-10-06T04:29:50.558 INFO:teuthology.orchestra.run.smithi060.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-10-06T04:29:50.571 INFO:teuthology.orchestra.run.smithi060.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-10-06T04:29:50.583 INFO:teuthology.orchestra.run.smithi060.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-10-06T04:29:50.596 INFO:teuthology.orchestra.run.smithi060.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-10-06T04:29:50.608 INFO:teuthology.orchestra.run.smithi060.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-10-06T04:29:50.624 INFO:teuthology.orchestra.run.smithi060.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-10-06T04:29:50.627 INFO:teuthology.orchestra.run.smithi060.stdout:cp include/install-sh . 2023-10-06T04:29:50.630 INFO:teuthology.orchestra.run.smithi060.stdout:aclocal -I m4 2023-10-06T04:29:51.923 INFO:teuthology.orchestra.run.smithi060.stdout:autoheader 2023-10-06T04:29:52.301 INFO:teuthology.orchestra.run.smithi060.stdout:autoconf 2023-10-06T04:29:52.515 INFO:teuthology.orchestra.run.smithi060.stdout:./configure \ 2023-10-06T04:29:52.516 INFO:teuthology.orchestra.run.smithi060.stdout: --libexecdir=/usr/lib \ 2023-10-06T04:29:52.516 INFO:teuthology.orchestra.run.smithi060.stdout: --exec_prefix=/var/lib 2023-10-06T04:29:53.127 INFO:teuthology.orchestra.run.smithi060.stdout:checking build system type... x86_64-pc-linux-gnu 2023-10-06T04:29:53.127 INFO:teuthology.orchestra.run.smithi060.stdout:checking host system type... x86_64-pc-linux-gnu 2023-10-06T04:29:53.131 INFO:teuthology.orchestra.run.smithi060.stdout:checking how to print strings... printf 2023-10-06T04:29:53.132 INFO:teuthology.orchestra.run.smithi060.stdout:checking for gcc... gcc 2023-10-06T04:29:53.286 INFO:teuthology.orchestra.run.smithi060.stdout:checking whether the C compiler works... yes 2023-10-06T04:29:53.286 INFO:teuthology.orchestra.run.smithi060.stdout:checking for C compiler default output file name... a.out 2023-10-06T04:29:53.337 INFO:teuthology.orchestra.run.smithi060.stdout:checking for suffix of executables... 2023-10-06T04:29:53.421 INFO:teuthology.orchestra.run.smithi060.stdout:checking whether we are cross compiling... no 2023-10-06T04:29:53.459 INFO:teuthology.orchestra.run.smithi060.stdout:checking for suffix of object files... o 2023-10-06T04:29:53.493 INFO:teuthology.orchestra.run.smithi060.stdout:checking whether we are using the GNU C compiler... yes 2023-10-06T04:29:53.527 INFO:teuthology.orchestra.run.smithi060.stdout:checking whether gcc accepts -g... yes 2023-10-06T04:29:53.575 INFO:teuthology.orchestra.run.smithi060.stdout:checking for gcc option to accept ISO C89... none needed 2023-10-06T04:29:53.583 INFO:teuthology.orchestra.run.smithi060.stdout:checking for a sed that does not truncate output... /bin/sed 2023-10-06T04:29:53.588 INFO:teuthology.orchestra.run.smithi060.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-10-06T04:29:53.591 INFO:teuthology.orchestra.run.smithi060.stdout:checking for egrep... /bin/grep -E 2023-10-06T04:29:53.594 INFO:teuthology.orchestra.run.smithi060.stdout:checking for fgrep... /bin/grep -F 2023-10-06T04:29:53.602 INFO:teuthology.orchestra.run.smithi060.stdout:checking for ld used by gcc... /bin/ld 2023-10-06T04:29:53.606 INFO:teuthology.orchestra.run.smithi060.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-10-06T04:29:53.615 INFO:teuthology.orchestra.run.smithi060.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-10-06T04:29:53.655 INFO:teuthology.orchestra.run.smithi060.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-10-06T04:29:53.656 INFO:teuthology.orchestra.run.smithi060.stdout:checking whether ln -s works... yes 2023-10-06T04:29:53.668 INFO:teuthology.orchestra.run.smithi060.stdout:checking the maximum length of command line arguments... 1572864 2023-10-06T04:29:53.675 INFO:teuthology.orchestra.run.smithi060.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-10-06T04:29:53.675 INFO:teuthology.orchestra.run.smithi060.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-10-06T04:29:53.675 INFO:teuthology.orchestra.run.smithi060.stdout:checking for /bin/ld option to reload object files... -r 2023-10-06T04:29:53.675 INFO:teuthology.orchestra.run.smithi060.stdout:checking for objdump... objdump 2023-10-06T04:29:53.676 INFO:teuthology.orchestra.run.smithi060.stdout:checking how to recognize dependent libraries... pass_all 2023-10-06T04:29:53.676 INFO:teuthology.orchestra.run.smithi060.stdout:checking for dlltool... no 2023-10-06T04:29:53.676 INFO:teuthology.orchestra.run.smithi060.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-10-06T04:29:53.677 INFO:teuthology.orchestra.run.smithi060.stdout:checking for ar... ar 2023-10-06T04:29:53.729 INFO:teuthology.orchestra.run.smithi060.stdout:checking for archiver @FILE support... @ 2023-10-06T04:29:53.729 INFO:teuthology.orchestra.run.smithi060.stdout:checking for strip... strip 2023-10-06T04:29:53.729 INFO:teuthology.orchestra.run.smithi060.stdout:checking for ranlib... ranlib 2023-10-06T04:29:53.730 INFO:teuthology.orchestra.run.smithi060.stdout:checking for gawk... gawk 2023-10-06T04:29:53.839 INFO:teuthology.orchestra.run.smithi060.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-10-06T04:29:53.842 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sysroot... no 2023-10-06T04:29:53.849 INFO:teuthology.orchestra.run.smithi060.stdout:checking for a working dd... /bin/dd 2023-10-06T04:29:53.857 INFO:teuthology.orchestra.run.smithi060.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-10-06T04:29:53.885 INFO:teuthology.orchestra.run.smithi060.stdout:checking for mt... no 2023-10-06T04:29:53.891 INFO:teuthology.orchestra.run.smithi060.stdout:checking if : is a manifest tool... no 2023-10-06T04:29:53.943 INFO:teuthology.orchestra.run.smithi060.stdout:checking how to run the C preprocessor... gcc -E 2023-10-06T04:29:54.166 INFO:teuthology.orchestra.run.smithi060.stdout:checking for ANSI C header files... yes 2023-10-06T04:29:54.210 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sys/types.h... yes 2023-10-06T04:29:54.277 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sys/stat.h... yes 2023-10-06T04:29:54.330 INFO:teuthology.orchestra.run.smithi060.stdout:checking for stdlib.h... yes 2023-10-06T04:29:54.385 INFO:teuthology.orchestra.run.smithi060.stdout:checking for string.h... yes 2023-10-06T04:29:54.439 INFO:teuthology.orchestra.run.smithi060.stdout:checking for memory.h... yes 2023-10-06T04:29:54.495 INFO:teuthology.orchestra.run.smithi060.stdout:checking for strings.h... yes 2023-10-06T04:29:54.552 INFO:teuthology.orchestra.run.smithi060.stdout:checking for inttypes.h... yes 2023-10-06T04:29:54.605 INFO:teuthology.orchestra.run.smithi060.stdout:checking for stdint.h... yes 2023-10-06T04:29:54.664 INFO:teuthology.orchestra.run.smithi060.stdout:checking for unistd.h... yes 2023-10-06T04:29:54.725 INFO:teuthology.orchestra.run.smithi060.stdout:checking for dlfcn.h... yes 2023-10-06T04:29:54.733 INFO:teuthology.orchestra.run.smithi060.stdout:checking for objdir... .libs 2023-10-06T04:29:54.869 INFO:teuthology.orchestra.run.smithi060.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-10-06T04:29:54.869 INFO:teuthology.orchestra.run.smithi060.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-10-06T04:29:54.907 INFO:teuthology.orchestra.run.smithi060.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-10-06T04:29:54.946 INFO:teuthology.orchestra.run.smithi060.stdout:checking if gcc static flag -static works... no 2023-10-06T04:29:55.001 INFO:teuthology.orchestra.run.smithi060.stdout:checking if gcc supports -c -o file.o... yes 2023-10-06T04:29:55.001 INFO:teuthology.orchestra.run.smithi060.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-10-06T04:29:55.016 INFO:teuthology.orchestra.run.smithi060.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-10-06T04:29:55.065 INFO:teuthology.orchestra.run.smithi060.stdout:checking whether -lc should be explicitly linked in... no 2023-10-06T04:29:55.165 INFO:teuthology.orchestra.run.smithi060.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-10-06T04:29:55.166 INFO:teuthology.orchestra.run.smithi060.stdout:checking how to hardcode library paths into programs... immediate 2023-10-06T04:29:55.169 INFO:teuthology.orchestra.run.smithi060.stdout:checking whether stripping libraries is possible... yes 2023-10-06T04:29:55.169 INFO:teuthology.orchestra.run.smithi060.stdout:checking if libtool supports shared libraries... yes 2023-10-06T04:29:55.170 INFO:teuthology.orchestra.run.smithi060.stdout:checking whether to build shared libraries... yes 2023-10-06T04:29:55.170 INFO:teuthology.orchestra.run.smithi060.stdout:checking whether to build static libraries... yes 2023-10-06T04:29:55.182 INFO:teuthology.orchestra.run.smithi060.stdout:checking for gcc... (cached) gcc 2023-10-06T04:29:55.222 INFO:teuthology.orchestra.run.smithi060.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-10-06T04:29:55.222 INFO:teuthology.orchestra.run.smithi060.stdout:checking whether gcc accepts -g... (cached) yes 2023-10-06T04:29:55.222 INFO:teuthology.orchestra.run.smithi060.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-10-06T04:29:55.222 INFO:teuthology.orchestra.run.smithi060.stdout:checking for gmake... /usr/bin/gmake 2023-10-06T04:29:55.223 INFO:teuthology.orchestra.run.smithi060.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-10-06T04:29:55.223 INFO:teuthology.orchestra.run.smithi060.stdout:checking for tar... /bin/tar 2023-10-06T04:29:55.223 INFO:teuthology.orchestra.run.smithi060.stdout:checking for gzip... /bin/gzip 2023-10-06T04:29:55.239 INFO:teuthology.orchestra.run.smithi060.stdout:checking whether gcc -MM is supported... yes 2023-10-06T04:29:55.240 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sort... /bin/sort 2023-10-06T04:29:55.240 INFO:teuthology.orchestra.run.smithi060.stdout:checking whether ln -s works... yes 2023-10-06T04:29:55.240 INFO:teuthology.orchestra.run.smithi060.stdout:checking for rpm... /bin/rpm 2023-10-06T04:29:55.248 INFO:teuthology.orchestra.run.smithi060.stdout:checking for rpmbuild... no 2023-10-06T04:29:55.308 INFO:teuthology.orchestra.run.smithi060.stdout:checking assert.h usability... yes 2023-10-06T04:29:55.324 INFO:teuthology.orchestra.run.smithi060.stdout:checking assert.h presence... yes 2023-10-06T04:29:55.324 INFO:teuthology.orchestra.run.smithi060.stdout:checking for assert.h... yes 2023-10-06T04:29:55.382 INFO:teuthology.orchestra.run.smithi060.stdout:checking bstring.h usability... no 2023-10-06T04:29:55.407 INFO:teuthology.orchestra.run.smithi060.stdout:checking bstring.h presence... no 2023-10-06T04:29:55.407 INFO:teuthology.orchestra.run.smithi060.stdout:checking for bstring.h... no 2023-10-06T04:29:55.457 INFO:teuthology.orchestra.run.smithi060.stdout:checking libgen.h usability... yes 2023-10-06T04:29:55.473 INFO:teuthology.orchestra.run.smithi060.stdout:checking libgen.h presence... yes 2023-10-06T04:29:55.473 INFO:teuthology.orchestra.run.smithi060.stdout:checking for libgen.h... yes 2023-10-06T04:29:55.533 INFO:teuthology.orchestra.run.smithi060.stdout:checking dirent.h usability... yes 2023-10-06T04:29:55.550 INFO:teuthology.orchestra.run.smithi060.stdout:checking dirent.h presence... yes 2023-10-06T04:29:55.550 INFO:teuthology.orchestra.run.smithi060.stdout:checking for dirent.h... yes 2023-10-06T04:29:55.638 INFO:teuthology.orchestra.run.smithi060.stdout:checking errno.h usability... yes 2023-10-06T04:29:55.654 INFO:teuthology.orchestra.run.smithi060.stdout:checking errno.h presence... yes 2023-10-06T04:29:55.655 INFO:teuthology.orchestra.run.smithi060.stdout:checking for errno.h... yes 2023-10-06T04:29:55.712 INFO:teuthology.orchestra.run.smithi060.stdout:checking malloc.h usability... yes 2023-10-06T04:29:55.731 INFO:teuthology.orchestra.run.smithi060.stdout:checking malloc.h presence... yes 2023-10-06T04:29:55.731 INFO:teuthology.orchestra.run.smithi060.stdout:checking for malloc.h... yes 2023-10-06T04:29:55.788 INFO:teuthology.orchestra.run.smithi060.stdout:checking uuid.h usability... no 2023-10-06T04:29:55.813 INFO:teuthology.orchestra.run.smithi060.stdout:checking uuid.h presence... no 2023-10-06T04:29:55.813 INFO:teuthology.orchestra.run.smithi060.stdout:checking for uuid.h... no 2023-10-06T04:29:55.864 INFO:teuthology.orchestra.run.smithi060.stdout:checking uuid/uuid.h usability... yes 2023-10-06T04:29:55.884 INFO:teuthology.orchestra.run.smithi060.stdout:checking uuid/uuid.h presence... yes 2023-10-06T04:29:55.884 INFO:teuthology.orchestra.run.smithi060.stdout:checking for uuid/uuid.h... yes 2023-10-06T04:29:55.941 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/uuid.h usability... no 2023-10-06T04:29:55.965 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/uuid.h presence... no 2023-10-06T04:29:55.966 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sys/uuid.h... no 2023-10-06T04:29:56.017 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/file.h usability... yes 2023-10-06T04:29:56.034 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/file.h presence... yes 2023-10-06T04:29:56.034 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sys/file.h... yes 2023-10-06T04:29:56.092 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/fcntl.h usability... yes 2023-10-06T04:29:56.110 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/fcntl.h presence... yes 2023-10-06T04:29:56.110 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sys/fcntl.h... yes 2023-10-06T04:29:56.168 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/syssgi.h usability... no 2023-10-06T04:29:56.192 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/syssgi.h presence... no 2023-10-06T04:29:56.192 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sys/syssgi.h... no 2023-10-06T04:29:56.263 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/param.h usability... yes 2023-10-06T04:29:56.284 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/param.h presence... yes 2023-10-06T04:29:56.284 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sys/param.h... yes 2023-10-06T04:29:56.299 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sys/stat.h... (cached) yes 2023-10-06T04:29:56.358 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/statvfs.h usability... yes 2023-10-06T04:29:56.374 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/statvfs.h presence... yes 2023-10-06T04:29:56.375 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sys/statvfs.h... yes 2023-10-06T04:29:56.433 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/time.h usability... yes 2023-10-06T04:29:56.450 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/time.h presence... yes 2023-10-06T04:29:56.450 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sys/time.h... yes 2023-10-06T04:29:56.534 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/ioctl.h usability... yes 2023-10-06T04:29:56.551 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/ioctl.h presence... yes 2023-10-06T04:29:56.551 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sys/ioctl.h... yes 2023-10-06T04:29:56.612 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/wait.h usability... yes 2023-10-06T04:29:56.631 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/wait.h presence... yes 2023-10-06T04:29:56.631 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sys/wait.h... yes 2023-10-06T04:29:56.646 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sys/types.h... (cached) yes 2023-10-06T04:29:56.660 INFO:teuthology.orchestra.run.smithi060.stdout:checking for strings.h... (cached) yes 2023-10-06T04:29:56.718 INFO:teuthology.orchestra.run.smithi060.stdout:checking err.h usability... yes 2023-10-06T04:29:56.734 INFO:teuthology.orchestra.run.smithi060.stdout:checking err.h presence... yes 2023-10-06T04:29:56.734 INFO:teuthology.orchestra.run.smithi060.stdout:checking for err.h... yes 2023-10-06T04:29:56.792 INFO:teuthology.orchestra.run.smithi060.stdout:checking linux/falloc.h usability... yes 2023-10-06T04:29:56.807 INFO:teuthology.orchestra.run.smithi060.stdout:checking linux/falloc.h presence... yes 2023-10-06T04:29:56.807 INFO:teuthology.orchestra.run.smithi060.stdout:checking for linux/falloc.h... yes 2023-10-06T04:29:56.864 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-10-06T04:29:56.888 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-10-06T04:29:56.888 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sys/fs/xfs_fsops.h... no 2023-10-06T04:29:56.937 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/fs/xfs_itable.h usability... no 2023-10-06T04:29:56.961 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/fs/xfs_itable.h presence... no 2023-10-06T04:29:56.961 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sys/fs/xfs_itable.h... no 2023-10-06T04:29:57.010 INFO:teuthology.orchestra.run.smithi060.stdout:checking xfs/platform_defs.h usability... no 2023-10-06T04:29:57.034 INFO:teuthology.orchestra.run.smithi060.stdout:checking xfs/platform_defs.h presence... no 2023-10-06T04:29:57.034 INFO:teuthology.orchestra.run.smithi060.stdout:checking for xfs/platform_defs.h... no 2023-10-06T04:29:57.083 INFO:teuthology.orchestra.run.smithi060.stdout:checking btrfs/ioctl.h usability... no 2023-10-06T04:29:57.107 INFO:teuthology.orchestra.run.smithi060.stdout:checking btrfs/ioctl.h presence... no 2023-10-06T04:29:57.107 INFO:teuthology.orchestra.run.smithi060.stdout:checking for btrfs/ioctl.h... no 2023-10-06T04:29:57.156 INFO:teuthology.orchestra.run.smithi060.stdout:checking cifs/ioctl.h usability... no 2023-10-06T04:29:57.180 INFO:teuthology.orchestra.run.smithi060.stdout:checking cifs/ioctl.h presence... no 2023-10-06T04:29:57.180 INFO:teuthology.orchestra.run.smithi060.stdout:checking for cifs/ioctl.h... no 2023-10-06T04:29:57.231 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/mman.h usability... yes 2023-10-06T04:29:57.248 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/mman.h presence... yes 2023-10-06T04:29:57.248 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sys/mman.h... yes 2023-10-06T04:29:57.287 INFO:teuthology.orchestra.run.smithi060.stdout:checking for xfs/xfs_log_format.h... no 2023-10-06T04:29:57.355 INFO:teuthology.orchestra.run.smithi060.stdout:checking for uuid_compare... no 2023-10-06T04:29:57.413 INFO:teuthology.orchestra.run.smithi060.stdout:checking for uuid_compare in -luuid... yes 2023-10-06T04:29:57.492 INFO:teuthology.orchestra.run.smithi060.stdout:checking for xfs/xfs.h... yes 2023-10-06T04:29:57.524 INFO:teuthology.orchestra.run.smithi060.stdout:checking for xfs/libxfs.h... no 2023-10-06T04:29:57.564 INFO:teuthology.orchestra.run.smithi060.stdout:checking whether xlog_assign_lsn is declared... no 2023-10-06T04:29:57.616 INFO:teuthology.orchestra.run.smithi060.stdout:checking for xfs/xqm.h... yes 2023-10-06T04:29:57.697 INFO:teuthology.orchestra.run.smithi060.stdout:checking xfsctl from xfs/xfs.h... ok 2023-10-06T04:29:57.742 INFO:teuthology.orchestra.run.smithi060.stdout:checking xfs/handle.h usability... yes 2023-10-06T04:29:57.757 INFO:teuthology.orchestra.run.smithi060.stdout:checking xfs/handle.h presence... yes 2023-10-06T04:29:57.757 INFO:teuthology.orchestra.run.smithi060.stdout:checking for xfs/handle.h... yes 2023-10-06T04:29:57.827 INFO:teuthology.orchestra.run.smithi060.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-10-06T04:29:57.874 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/acl.h usability... yes 2023-10-06T04:29:57.892 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/acl.h presence... yes 2023-10-06T04:29:57.892 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sys/acl.h... yes 2023-10-06T04:29:57.943 INFO:teuthology.orchestra.run.smithi060.stdout:checking acl/libacl.h usability... yes 2023-10-06T04:29:57.961 INFO:teuthology.orchestra.run.smithi060.stdout:checking acl/libacl.h presence... yes 2023-10-06T04:29:57.961 INFO:teuthology.orchestra.run.smithi060.stdout:checking for acl/libacl.h... yes 2023-10-06T04:29:58.021 INFO:teuthology.orchestra.run.smithi060.stdout:checking for acl_init in -lacl... yes 2023-10-06T04:29:58.066 INFO:teuthology.orchestra.run.smithi060.stdout:checking gdbm-ndbm.h usability... no 2023-10-06T04:29:58.091 INFO:teuthology.orchestra.run.smithi060.stdout:checking gdbm-ndbm.h presence... no 2023-10-06T04:29:58.091 INFO:teuthology.orchestra.run.smithi060.stdout:checking for gdbm-ndbm.h... no 2023-10-06T04:29:58.135 INFO:teuthology.orchestra.run.smithi060.stdout:checking gdbm/ndbm.h usability... no 2023-10-06T04:29:58.159 INFO:teuthology.orchestra.run.smithi060.stdout:checking gdbm/ndbm.h presence... no 2023-10-06T04:29:58.159 INFO:teuthology.orchestra.run.smithi060.stdout:checking for gdbm/ndbm.h... no 2023-10-06T04:29:58.202 INFO:teuthology.orchestra.run.smithi060.stdout:checking ndbm.h usability... no 2023-10-06T04:29:58.226 INFO:teuthology.orchestra.run.smithi060.stdout:checking ndbm.h presence... no 2023-10-06T04:29:58.226 INFO:teuthology.orchestra.run.smithi060.stdout:checking for ndbm.h... no 2023-10-06T04:29:58.275 INFO:teuthology.orchestra.run.smithi060.stdout:checking libaio.h usability... yes 2023-10-06T04:29:58.296 INFO:teuthology.orchestra.run.smithi060.stdout:checking libaio.h presence... yes 2023-10-06T04:29:58.296 INFO:teuthology.orchestra.run.smithi060.stdout:checking for libaio.h... yes 2023-10-06T04:29:58.342 INFO:teuthology.orchestra.run.smithi060.stdout:checking liburing.h usability... no 2023-10-06T04:29:58.366 INFO:teuthology.orchestra.run.smithi060.stdout:checking liburing.h presence... no 2023-10-06T04:29:58.367 INFO:teuthology.orchestra.run.smithi060.stdout:checking for liburing.h... no 2023-10-06T04:29:58.410 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/capability.h usability... no 2023-10-06T04:29:58.435 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/capability.h presence... no 2023-10-06T04:29:58.435 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sys/capability.h... no 2023-10-06T04:29:58.481 INFO:teuthology.orchestra.run.smithi060.stdout:checking linux/fiemap.h usability... yes 2023-10-06T04:29:58.496 INFO:teuthology.orchestra.run.smithi060.stdout:checking linux/fiemap.h presence... yes 2023-10-06T04:29:58.497 INFO:teuthology.orchestra.run.smithi060.stdout:checking for linux/fiemap.h... yes 2023-10-06T04:29:58.558 INFO:teuthology.orchestra.run.smithi060.stdout:checking for fallocate... yes 2023-10-06T04:29:58.619 INFO:teuthology.orchestra.run.smithi060.stdout:checking for open_by_handle_at... yes 2023-10-06T04:29:58.665 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/prctl.h usability... yes 2023-10-06T04:29:58.683 INFO:teuthology.orchestra.run.smithi060.stdout:checking sys/prctl.h presence... yes 2023-10-06T04:29:58.683 INFO:teuthology.orchestra.run.smithi060.stdout:checking for sys/prctl.h... yes 2023-10-06T04:29:58.730 INFO:teuthology.orchestra.run.smithi060.stdout:checking linux/fs.h usability... yes 2023-10-06T04:29:58.747 INFO:teuthology.orchestra.run.smithi060.stdout:checking linux/fs.h presence... yes 2023-10-06T04:29:58.747 INFO:teuthology.orchestra.run.smithi060.stdout:checking for linux/fs.h... yes 2023-10-06T04:29:58.790 INFO:teuthology.orchestra.run.smithi060.stdout:checking btrfsutil.h usability... no 2023-10-06T04:29:58.815 INFO:teuthology.orchestra.run.smithi060.stdout:checking btrfsutil.h presence... no 2023-10-06T04:29:58.815 INFO:teuthology.orchestra.run.smithi060.stdout:checking for btrfsutil.h... no 2023-10-06T04:29:58.877 INFO:teuthology.orchestra.run.smithi060.stdout:checking for copy_file_range... yes 2023-10-06T04:29:58.941 INFO:teuthology.orchestra.run.smithi060.stdout:checking for SEEK_DATA... yes 2023-10-06T04:29:59.021 INFO:teuthology.orchestra.run.smithi060.stdout:checking for BMV_OF_SHARED... yes 2023-10-06T04:29:59.086 INFO:teuthology.orchestra.run.smithi060.stdout:checking for nftw... yes 2023-10-06T04:29:59.149 INFO:teuthology.orchestra.run.smithi060.stdout:checking for RLIMIT_NOFILE... yes 2023-10-06T04:29:59.187 INFO:teuthology.orchestra.run.smithi060.stdout:checking for FIEXCHANGE_RANGE... no 2023-10-06T04:29:59.248 INFO:teuthology.orchestra.run.smithi060.stdout:checking for renameat2... yes 2023-10-06T04:29:59.310 INFO:teuthology.orchestra.run.smithi060.stdout:checking for reallocarray... yes 2023-10-06T04:29:59.343 INFO:teuthology.orchestra.run.smithi060.stdout:checking for struct mount_attr... no 2023-10-06T04:29:59.444 INFO:teuthology.orchestra.run.smithi060.stdout:checking for struct btrfs_qgroup_limit... yes 2023-10-06T04:29:59.518 INFO:teuthology.orchestra.run.smithi060.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-10-06T04:29:59.591 INFO:teuthology.orchestra.run.smithi060.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-10-06T04:29:59.666 INFO:teuthology.orchestra.run.smithi060.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-10-06T04:29:59.739 INFO:teuthology.orchestra.run.smithi060.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-10-06T04:29:59.814 INFO:teuthology.orchestra.run.smithi060.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-10-06T04:29:59.887 INFO:teuthology.orchestra.run.smithi060.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-10-06T04:29:59.941 INFO:teuthology.orchestra.run.smithi060.stdout:checking linux/btrfs.h usability... yes 2023-10-06T04:29:59.959 INFO:teuthology.orchestra.run.smithi060.stdout:checking linux/btrfs.h presence... yes 2023-10-06T04:29:59.959 INFO:teuthology.orchestra.run.smithi060.stdout:checking for linux/btrfs.h... yes 2023-10-06T04:30:00.021 INFO:teuthology.orchestra.run.smithi060.stdout:checking linux/btrfs_tree.h usability... yes 2023-10-06T04:30:00.039 INFO:teuthology.orchestra.run.smithi060.stdout:checking linux/btrfs_tree.h presence... yes 2023-10-06T04:30:00.039 INFO:teuthology.orchestra.run.smithi060.stdout:checking for linux/btrfs_tree.h... yes 2023-10-06T04:30:00.112 INFO:teuthology.orchestra.run.smithi060.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-10-06T04:30:00.142 INFO:teuthology.orchestra.run.smithi060.stdout:configure: creating ./config.status 2023-10-06T04:30:01.075 INFO:teuthology.orchestra.run.smithi060.stdout:config.status: creating include/builddefs 2023-10-06T04:30:01.103 INFO:teuthology.orchestra.run.smithi060.stdout:config.status: creating include/config.h 2023-10-06T04:30:01.125 INFO:teuthology.orchestra.run.smithi060.stdout:config.status: executing libtool commands 2023-10-06T04:30:01.205 INFO:teuthology.orchestra.run.smithi060.stdout:Building include 2023-10-06T04:30:01.212 INFO:teuthology.orchestra.run.smithi060.stdout:Building lib 2023-10-06T04:30:01.219 INFO:teuthology.orchestra.run.smithi060.stdout: [LTDEP] 2023-10-06T04:30:01.421 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] dataascii.lo 2023-10-06T04:30:01.625 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] databin.lo 2023-10-06T04:30:01.861 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] datapid.lo 2023-10-06T04:30:02.051 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] file_lock.lo 2023-10-06T04:30:02.289 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] forker.lo 2023-10-06T04:30:02.511 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] pattern.lo 2023-10-06T04:30:02.714 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] open_flags.lo 2023-10-06T04:30:02.945 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] random_range.lo 2023-10-06T04:30:03.258 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] string_to_tokens.lo 2023-10-06T04:30:03.446 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] str_to_bytes.lo 2023-10-06T04:30:03.663 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] tlibio.lo 2023-10-06T04:30:03.991 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] write_log.lo 2023-10-06T04:30:04.324 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] random.lo 2023-10-06T04:30:04.528 INFO:teuthology.orchestra.run.smithi060.stdout: [LD] 2023-10-06T04:30:04.657 INFO:teuthology.orchestra.run.smithi060.stdout:Building ltp 2023-10-06T04:30:04.664 INFO:teuthology.orchestra.run.smithi060.stdout: [DEP] 2023-10-06T04:30:04.889 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] doio 2023-10-06T04:30:05.660 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] fsstress 2023-10-06T04:30:07.100 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] fsx 2023-10-06T04:30:08.080 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] growfiles 2023-10-06T04:30:08.697 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] iogen 2023-10-06T04:30:09.139 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:30:09.144 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:30:09.161 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] aio-stress 2023-10-06T04:30:09.695 INFO:teuthology.orchestra.run.smithi060.stdout:Building src 2023-10-06T04:30:09.704 INFO:teuthology.orchestra.run.smithi060.stdout: [DEP] 2023-10-06T04:30:12.319 INFO:teuthology.orchestra.run.smithi060.stdout: [DEP] 2023-10-06T04:30:12.370 INFO:teuthology.orchestra.run.smithi060.stdout: [DEP] 2023-10-06T04:30:12.386 INFO:teuthology.orchestra.run.smithi060.stdout: [DEP] 2023-10-06T04:30:12.732 INFO:teuthology.orchestra.run.smithi060.stdout: [DEP] 2023-10-06T04:30:12.772 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] dirstress 2023-10-06T04:30:13.117 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] fill 2023-10-06T04:30:13.370 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] fill2 2023-10-06T04:30:13.705 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] getpagesize 2023-10-06T04:30:13.939 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] holes 2023-10-06T04:30:14.240 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] lstat64 2023-10-06T04:30:14.525 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] nametest 2023-10-06T04:30:14.870 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] permname 2023-10-06T04:30:15.174 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] randholes 2023-10-06T04:30:15.528 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] runas 2023-10-06T04:30:15.810 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] truncfile 2023-10-06T04:30:16.095 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] usemem 2023-10-06T04:30:16.347 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] mmapcat 2023-10-06T04:30:16.598 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] append_reader 2023-10-06T04:30:16.850 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] append_writer 2023-10-06T04:30:17.106 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] dirperf 2023-10-06T04:30:17.434 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] metaperf 2023-10-06T04:30:17.791 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] devzero 2023-10-06T04:30:18.070 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] feature 2023-10-06T04:30:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] alloc 2023-10-06T04:30:18.707 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] fault 2023-10-06T04:30:18.975 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] fstest 2023-10-06T04:30:19.316 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_access_root 2023-10-06T04:30:19.572 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] godown 2023-10-06T04:30:19.846 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] resvtest 2023-10-06T04:30:20.137 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] writemod 2023-10-06T04:30:20.382 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] writev_on_pagefault 2023-10-06T04:30:20.644 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] makeextents 2023-10-06T04:30:20.934 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] itrash 2023-10-06T04:30:21.189 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] rename 2023-10-06T04:30:21.428 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] multi_open_unlink 2023-10-06T04:30:21.695 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] unwritten_sync 2023-10-06T04:30:21.981 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] genhashnames 2023-10-06T04:30:22.268 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_holes 2023-10-06T04:30:22.516 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_mmap_writev 2023-10-06T04:30:22.764 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_truncate_cmtime 2023-10-06T04:30:23.025 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] dirhash_collide 2023-10-06T04:30:23.307 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_rename_overwrite 2023-10-06T04:30:23.550 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] holetest 2023-10-06T04:30:23.870 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_truncate_self 2023-10-06T04:30:24.112 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] af_unix 2023-10-06T04:30:24.364 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_mmap_stale_pmd 2023-10-06T04:30:24.619 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_mmap_cow_race 2023-10-06T04:30:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_mmap_fallocate 2023-10-06T04:30:25.139 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] fsync-err 2023-10-06T04:30:25.426 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_mmap_write_ro 2023-10-06T04:30:25.678 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_ext4_dax_journal_corruption 2023-10-06T04:30:25.938 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_ext4_dax_inline_corruption 2023-10-06T04:30:26.195 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_ofd_locks 2023-10-06T04:30:26.495 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_mmap_collision 2023-10-06T04:30:26.795 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] mmap-write-concurrent 2023-10-06T04:30:27.068 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_get_file_time 2023-10-06T04:30:27.316 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_create_short_dirs 2023-10-06T04:30:27.584 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_create_long_dirs 2023-10-06T04:30:27.850 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_enospc 2023-10-06T04:30:28.138 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_mmap_writev_overlap 2023-10-06T04:30:28.411 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] checkpoint_journal 2023-10-06T04:30:28.668 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] mmap-rw-fault 2023-10-06T04:30:28.955 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] allocstale 2023-10-06T04:30:29.229 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_mmap_cow_memory_failure 2023-10-06T04:30:29.502 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] fake-dump-rootino 2023-10-06T04:30:29.753 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] dio-buf-fault 2023-10-06T04:30:30.008 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] xfsctl 2023-10-06T04:30:30.300 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] bstat 2023-10-06T04:30:30.611 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_mtab 2023-10-06T04:30:30.900 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] getdevicesize 2023-10-06T04:30:31.141 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] preallo_rw_pattern_reader 2023-10-06T04:30:31.408 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] preallo_rw_pattern_writer 2023-10-06T04:30:31.671 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] ftrunc 2023-10-06T04:30:31.920 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] trunc 2023-10-06T04:30:32.185 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] fs_perms 2023-10-06T04:30:32.453 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] testx 2023-10-06T04:30:32.682 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] looptest 2023-10-06T04:30:32.979 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] locktest 2023-10-06T04:30:33.391 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] unwritten_mmap 2023-10-06T04:30:33.659 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] bulkstat_unlink_test 2023-10-06T04:30:33.964 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] deduperace 2023-10-06T04:30:34.261 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] bulkstat_unlink_test_modified 2023-10-06T04:30:34.563 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_dir_offset 2023-10-06T04:30:34.813 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_futimens 2023-10-06T04:30:35.054 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_immutable 2023-10-06T04:30:35.771 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] stale_handle 2023-10-06T04:30:36.046 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] pwrite_mmap_blocked 2023-10-06T04:30:36.302 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_dir_offset2 2023-10-06T04:30:36.598 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] seek_sanity_test 2023-10-06T04:30:37.117 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] seek_copy_test 2023-10-06T04:30:37.399 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_readdir_1 2023-10-06T04:30:37.652 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_readdir_2 2023-10-06T04:30:37.904 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] fsync-tester 2023-10-06T04:30:38.254 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] nsexec 2023-10-06T04:30:38.534 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] cloner 2023-10-06T04:30:38.814 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] renameat2 2023-10-06T04:30:39.084 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_getcwd 2023-10-06T04:30:39.243 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:30:39.247 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:30:39.346 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] e4compact 2023-10-06T04:30:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] test-nextquota 2023-10-06T04:30:39.927 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] punch-alternating 2023-10-06T04:30:40.204 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] attr-list-by-handle-cursor-test 2023-10-06T04:30:40.477 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] listxattr 2023-10-06T04:30:40.725 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] dio-interleaved 2023-10-06T04:30:40.991 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_dir_type 2023-10-06T04:30:41.249 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] dio-invalidate-cache 2023-10-06T04:30:41.557 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] stat_test 2023-10-06T04:30:41.957 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_encrypted_d_revalidate 2023-10-06T04:30:42.227 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] attr_replace_test 2023-10-06T04:30:42.493 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] swapon 2023-10-06T04:30:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] mkswap 2023-10-06T04:30:43.012 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_attr_corruption 2023-10-06T04:30:43.265 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_open_tmpfiles 2023-10-06T04:30:43.551 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] fscrypt-crypt-util 2023-10-06T04:30:44.293 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] bulkstat_null_ocount 2023-10-06T04:30:44.557 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] splice-test 2023-10-06T04:30:44.841 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] chprojid_fail 2023-10-06T04:30:45.108 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] detached_mounts_propagation 2023-10-06T04:30:45.399 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] ext4_resize 2023-10-06T04:30:45.650 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_readdir_3 2023-10-06T04:30:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] splice2pipe 2023-10-06T04:30:46.212 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] uuid_ioctl 2023-10-06T04:30:46.470 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] fiemap-tester 2023-10-06T04:30:46.841 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_stripealign 2023-10-06T04:30:47.096 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] open_by_handle 2023-10-06T04:30:47.456 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] t_mmap_dio 2023-10-06T04:30:47.733 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] xfsfind 2023-10-06T04:30:48.034 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] fssum 2023-10-06T04:30:48.575 INFO:teuthology.orchestra.run.smithi060.stdout:Building log-writes 2023-10-06T04:30:48.585 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] replay-log 2023-10-06T04:30:49.007 INFO:teuthology.orchestra.run.smithi060.stdout:Building perf 2023-10-06T04:30:49.014 INFO:teuthology.orchestra.run.smithi060.stdout:Building aio-dio-regress 2023-10-06T04:30:49.026 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] aio-dio-append-write-fallocate-race 2023-10-06T04:30:49.305 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] aio-dio-fcntl-race 2023-10-06T04:30:49.575 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] aio-dio-subblock-eof-read 2023-10-06T04:30:49.823 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] aio-dio-append-write-read-race 2023-10-06T04:30:50.105 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] aio-dio-invalidate-readahead 2023-10-06T04:30:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] aio-dio-hole-filling-race 2023-10-06T04:30:50.630 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-10-06T04:30:50.871 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] aio-last-ref-held-by-io 2023-10-06T04:30:51.151 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] aio-dio-cycle-write 2023-10-06T04:30:51.443 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] aio-dio-extend-stat 2023-10-06T04:30:51.715 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-10-06T04:30:51.951 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] aiocp 2023-10-06T04:30:52.282 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] aio-dio-invalidate-failure 2023-10-06T04:30:52.548 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] aiodio_sparse2 2023-10-06T04:30:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] aio-dio-cow-race 2023-10-06T04:30:53.130 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] aio-dio-write-verify 2023-10-06T04:30:53.438 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] aio-dio-eof-race 2023-10-06T04:30:53.728 INFO:teuthology.orchestra.run.smithi060.stdout:Building vfs 2023-10-06T04:30:53.739 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] vfstest 2023-10-06T04:30:55.813 INFO:teuthology.orchestra.run.smithi060.stdout: [CC] mount-idmapped 2023-10-06T04:30:56.324 INFO:teuthology.orchestra.run.smithi060.stdout:Building m4 2023-10-06T04:30:56.331 INFO:teuthology.orchestra.run.smithi060.stdout:Building common 2023-10-06T04:30:56.339 INFO:teuthology.orchestra.run.smithi060.stdout:Building tests 2023-10-06T04:30:56.349 INFO:teuthology.orchestra.run.smithi060.stdout:Building perf 2023-10-06T04:30:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/perf/group.list 2023-10-06T04:30:56.397 INFO:teuthology.orchestra.run.smithi060.stdout:Building ext4 2023-10-06T04:30:56.407 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/ext4/group.list 2023-10-06T04:30:56.501 INFO:teuthology.orchestra.run.smithi060.stdout:Building ocfs2 2023-10-06T04:30:56.511 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/ocfs2/group.list 2023-10-06T04:30:56.545 INFO:teuthology.orchestra.run.smithi060.stdout:Building overlay 2023-10-06T04:30:56.555 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/overlay/group.list 2023-10-06T04:30:56.653 INFO:teuthology.orchestra.run.smithi060.stdout:Building cifs 2023-10-06T04:30:56.663 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/cifs/group.list 2023-10-06T04:30:56.694 INFO:teuthology.orchestra.run.smithi060.stdout:Building generic 2023-10-06T04:30:56.706 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/generic/group.list 2023-10-06T04:30:56.955 INFO:teuthology.orchestra.run.smithi060.stdout:Building shared 2023-10-06T04:30:56.966 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/shared/group.list 2023-10-06T04:30:57.011 INFO:teuthology.orchestra.run.smithi060.stdout:Building xfs 2023-10-06T04:30:57.023 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/xfs/group.list 2023-10-06T04:30:57.271 INFO:teuthology.orchestra.run.smithi060.stdout:Building f2fs 2023-10-06T04:30:57.281 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/f2fs/group.list 2023-10-06T04:30:57.325 INFO:teuthology.orchestra.run.smithi060.stdout:Building udf 2023-10-06T04:30:57.335 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/udf/group.list 2023-10-06T04:30:57.364 INFO:teuthology.orchestra.run.smithi060.stdout:Building ceph 2023-10-06T04:30:57.374 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/ceph/group.list 2023-10-06T04:30:57.411 INFO:teuthology.orchestra.run.smithi060.stdout:Building nfs 2023-10-06T04:30:57.420 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/nfs/group.list 2023-10-06T04:30:57.456 INFO:teuthology.orchestra.run.smithi060.stdout:Building btrfs 2023-10-06T04:30:57.467 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/btrfs/group.list 2023-10-06T04:30:57.618 INFO:teuthology.orchestra.run.smithi060.stdout:Building tmpfs 2023-10-06T04:30:57.628 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/tmpfs/group.list 2023-10-06T04:30:57.662 INFO:teuthology.orchestra.run.smithi060.stdout:Building selftest 2023-10-06T04:30:57.671 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/selftest/group.list 2023-10-06T04:30:57.706 DEBUG:teuthology.orchestra.run.smithi060:> (cd /tmp/tmp.cHkpSAqJTKxfstests-dev && exec sudo make install) 2023-10-06T04:30:57.791 INFO:teuthology.orchestra.run.smithi060.stdout:Building include 2023-10-06T04:30:57.798 INFO:teuthology.orchestra.run.smithi060.stdout:Building lib 2023-10-06T04:30:57.806 INFO:teuthology.orchestra.run.smithi060.stdout:Building ltp 2023-10-06T04:30:57.814 INFO:teuthology.orchestra.run.smithi060.stdout:Building src 2023-10-06T04:30:57.876 INFO:teuthology.orchestra.run.smithi060.stdout:Building log-writes 2023-10-06T04:30:57.883 INFO:teuthology.orchestra.run.smithi060.stdout:Building perf 2023-10-06T04:30:57.890 INFO:teuthology.orchestra.run.smithi060.stdout:Building aio-dio-regress 2023-10-06T04:30:57.898 INFO:teuthology.orchestra.run.smithi060.stdout:Building vfs 2023-10-06T04:30:57.906 INFO:teuthology.orchestra.run.smithi060.stdout:Building m4 2023-10-06T04:30:57.914 INFO:teuthology.orchestra.run.smithi060.stdout:Building common 2023-10-06T04:30:57.921 INFO:teuthology.orchestra.run.smithi060.stdout:Building tests 2023-10-06T04:30:57.931 INFO:teuthology.orchestra.run.smithi060.stdout:Building perf 2023-10-06T04:30:57.941 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/perf/group.list 2023-10-06T04:30:57.971 INFO:teuthology.orchestra.run.smithi060.stdout:Building ext4 2023-10-06T04:30:57.981 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/ext4/group.list 2023-10-06T04:30:58.075 INFO:teuthology.orchestra.run.smithi060.stdout:Building ocfs2 2023-10-06T04:30:58.084 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/ocfs2/group.list 2023-10-06T04:30:58.119 INFO:teuthology.orchestra.run.smithi060.stdout:Building overlay 2023-10-06T04:30:58.129 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/overlay/group.list 2023-10-06T04:30:58.227 INFO:teuthology.orchestra.run.smithi060.stdout:Building cifs 2023-10-06T04:30:58.237 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/cifs/group.list 2023-10-06T04:30:58.268 INFO:teuthology.orchestra.run.smithi060.stdout:Building generic 2023-10-06T04:30:58.281 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/generic/group.list 2023-10-06T04:30:58.523 INFO:teuthology.orchestra.run.smithi060.stdout:Building shared 2023-10-06T04:30:58.533 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/shared/group.list 2023-10-06T04:30:58.577 INFO:teuthology.orchestra.run.smithi060.stdout:Building xfs 2023-10-06T04:30:58.589 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/xfs/group.list 2023-10-06T04:30:58.831 INFO:teuthology.orchestra.run.smithi060.stdout:Building f2fs 2023-10-06T04:30:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/f2fs/group.list 2023-10-06T04:30:58.884 INFO:teuthology.orchestra.run.smithi060.stdout:Building udf 2023-10-06T04:30:58.893 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/udf/group.list 2023-10-06T04:30:58.923 INFO:teuthology.orchestra.run.smithi060.stdout:Building ceph 2023-10-06T04:30:58.932 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/ceph/group.list 2023-10-06T04:30:58.969 INFO:teuthology.orchestra.run.smithi060.stdout:Building nfs 2023-10-06T04:30:58.978 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/nfs/group.list 2023-10-06T04:30:59.015 INFO:teuthology.orchestra.run.smithi060.stdout:Building btrfs 2023-10-06T04:30:59.025 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/btrfs/group.list 2023-10-06T04:30:59.172 INFO:teuthology.orchestra.run.smithi060.stdout:Building tmpfs 2023-10-06T04:30:59.182 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/tmpfs/group.list 2023-10-06T04:30:59.216 INFO:teuthology.orchestra.run.smithi060.stdout:Building selftest 2023-10-06T04:30:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: [GROUP] /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/selftest/group.list 2023-10-06T04:30:59.257 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-10-06T04:30:59.259 INFO:teuthology.orchestra.run.smithi060.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-06T04:30:59.259 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-10-06T04:30:59.263 INFO:teuthology.orchestra.run.smithi060.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-06T04:30:59.263 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-10-06T04:30:59.266 INFO:teuthology.orchestra.run.smithi060.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-10-06T04:30:59.290 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-10-06T04:30:59.468 INFO:teuthology.orchestra.run.smithi060.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-10-06T04:30:59.493 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-10-06T04:30:59.523 INFO:teuthology.orchestra.run.smithi060.stdout:Building log-writes 2023-10-06T04:30:59.530 INFO:teuthology.orchestra.run.smithi060.stdout:Building perf 2023-10-06T04:30:59.538 INFO:teuthology.orchestra.run.smithi060.stdout:Building aio-dio-regress 2023-10-06T04:30:59.545 INFO:teuthology.orchestra.run.smithi060.stdout:Building vfs 2023-10-06T04:30:59.551 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake -C log-writes install 2023-10-06T04:30:59.554 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-10-06T04:30:59.578 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-10-06T04:30:59.601 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake -C perf install 2023-10-06T04:30:59.604 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-10-06T04:30:59.627 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-10-06T04:30:59.691 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-10-06T04:30:59.694 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-10-06T04:30:59.718 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aiocp aio-dio-invalidate-failure aiodio_sparse2 aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-10-06T04:30:59.869 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake -C vfs install 2023-10-06T04:30:59.872 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-10-06T04:30:59.895 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-10-06T04:30:59.929 INFO:teuthology.orchestra.run.smithi060.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-10-06T04:30:59.952 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-10-06T04:31:02.975 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-10-06T04:31:03.220 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-10-06T04:31:03.276 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-10-06T04:31:03.279 INFO:teuthology.orchestra.run.smithi060.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-06T04:31:03.279 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-10-06T04:31:03.282 INFO:teuthology.orchestra.run.smithi060.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-10-06T04:31:03.305 INFO:teuthology.orchestra.run.smithi060.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-10-06T04:31:03.695 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-10-06T04:31:03.698 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/btrfs/ install 2023-10-06T04:31:03.702 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-10-06T04:31:03.725 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 299 300 /var/lib/xfstests/tests/btrfs 2023-10-06T04:31:06.098 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-10-06T04:31:06.122 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 140.out 056.out 236.out 202.out 008.out 040.out 004.out 047.out 199.out 233.out 055.out 095.out 009.out 033.out 082.out 270.out 088.out 036.out 296.out 225.out 210.out 002.out 125.out 037.out 181.out 152.out 103.out 024.out 243.out 192.out 148.out 282.out 077.out 052.out 256.out 228.out 128.out 028.out 273.out 114.out 274.out 251.out 267.out 043.out 069.out 065.out 209.out 207.out 151.out 195.out 106.out 215.out 115.out 015.out 227.out 250.out 191.out 046.out 051.out 101.out 219.out 119.out 244.out 232.out 143.out 188.out 220.out 120.out 020.out 102.out 171.out 261.out 156.out 217.out 072.out 048.out 062.out 038.out 073.out 129.out 066.out 029.out 229.out 003.out 111.out 011.out 234.out 275.out 134.out 170.out 260.out 034.out 133.out 286.out 161.out 175.out 216.out 116.out 016.out 118.out 110.out 010.out 238.out 281.out 276.out 295.out 138.out 014.out 277.out 145.out 160.out 137.out 091.out 081.out 071.out 061.out 239.out 085.out 265.out 300.out 200.out 100.out 258.out 269.out 208.out 039.out 222.out 169.out 098.out 090.out 080.out 070.out 060.out 206.out 109.out 006.out 167.out 117.out 017.out 246.out 158.out 182.out 204.out 104.out 177.out 254.out 279.out 241.out 235.out 268.out 224.out 025.out 124.out 142.out 172.out 278.out 058.out 262.out 042.out 253.out 297.out 193.out 097.out 271.out 283.out 083.out 135.out 045.out 086.out 053.out 157.out 164.out 257.out 094.out 189.out 139.out 089.out 178.out 001.out 165.out 141.out 214.out 074.out 176.out 012.out 041.out 155.out 064.out 186.out 240.out 252.out 280.out 005.out 223.out 150.out 132.out 179.out 144.out 032.out 057.out 205.out 136.out 146.out 174.out 096.out 198.out 108.out 190.out 173.out 050.out 105.out 263.out 027.out 291.out 187.out 084.out 266.out 153.out 285.out 183.out 123.out 044.out 201.out 019.out 287.out 237.out 067.out 231.out 075.out 163.out 131.out 213.out 113.out 031.out 272.out 078.out 184.out 259.out 293.out 197.out 127.out 230.out 076.out 292.out 130.out 023.out 099.out 092.out 030.out 203.out 063.out 194.out 159.out 249.out 122.out 166.out 022.out 289.out 284.out 255.out 290.out 299.out 154.out 149.out 068.out 185.out 264.out 218.out 018.out 168.out 007.out 093.out 079.out 054.out 059.out 049.out 226.out 126.out 121.out 026.out 180.out 013.out 035.out 221.out 087.out 294.out 212.out 112.out 245.out 021.out 247.out 211.out 107.out 248.out 162.out 147.out 288.out 196.out 242.out /var/lib/xfstests/tests/btrfs 2023-10-06T04:31:08.506 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/ceph/ install 2023-10-06T04:31:08.509 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-10-06T04:31:08.533 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-10-06T04:31:08.587 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-10-06T04:31:08.611 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 005.out 003.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-10-06T04:31:08.667 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/cifs/ install 2023-10-06T04:31:08.669 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-10-06T04:31:08.693 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-10-06T04:31:08.717 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-10-06T04:31:08.740 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-10-06T04:31:08.764 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/ext4/ install 2023-10-06T04:31:08.767 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-10-06T04:31:08.791 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-10-06T04:31:09.341 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-10-06T04:31:09.366 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 049.out 032.out 039.out 305.out 005.out 008.out 023.out 056.out 308.out 050.out 040.out 307.out 006.out 035.out 021.out 017.out 012.out 009.out 033.out 301.out 019.out 026.out 047.out 303.out 302.out 020.out 002.out 044.out 013.out 031.out 025.out 304.out 003.out 048.out 038.out 052.out 042.out 037.out 029.out 011.out 028.out 055.out 030.out 058.out 034.out 015.out 043.out 053.out 036.out 016.out 027.out 010.out 306.out 022.out 014.out 004.out 057.out 045.out 046.out 271.out 051.out 041.out 024.out 018.out 007.out 054.out 059.out /var/lib/xfstests/tests/ext4 2023-10-06T04:31:09.471 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:31:09.476 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:31:09.944 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/f2fs/ install 2023-10-06T04:31:09.947 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-10-06T04:31:09.971 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-10-06T04:31:10.003 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-10-06T04:31:10.026 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-10-06T04:31:10.058 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/generic/ install 2023-10-06T04:31:10.064 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-10-06T04:31:10.088 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 /var/lib/xfstests/tests/generic 2023-10-06T04:31:15.883 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-10-06T04:31:15.907 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 035.cfg 050.cfg 377.out 537.out 234.out 295.out 033.out 385.out 248.out 696.out 149.out 502.out 088.out 366.out 202.out 137.out 102.out 343.out 110.out 468.out 181.out 571.out 531.out 567.out 192.out 726.out 282.out 472.out 628.out 284.out 528.out 607.out 428.out 659.out 128.out 183.out 389.out 271.out 620.out 273.out 265.out 420.out 087.out 089.out 406.out 195.out 346.out 007.out 466.out 632.out 532.out 591.out 064.out 719.out 111.out 723.out 255.out 011.out 623.out 371.out 319.out 467.out 523.out 119.out 423.out 323.out 155.out 134.out 686.out 638.out 174.out 716.out 161.out 516.out 538.out 316.out 216.out 438.out 041.out 358.out 338.out 287.out 238.out 138.out 474.out 097.out 160.out 647.out 691.out 061.out 258.out 588.out 379.out 039.out 046.out 310.out 098.out 426.out 690.out 573.out 706.out 060.out 506.out 306.out 206.out 106.out 006.out 167.out 217.out 191.out 133.out 117.out 411.out 017.out 542.out 211.out 158.out 177.out 724.out 279.out 524.out 424.out 156.out 324.out 082.out 224.out 313.out 124.out 024.out 278.out 058.out 384.out 447.out 042.out 497.out 487.out 047.out 193.out 526.out 399.out 473.out 135.out 709.out 609.out 365.out 509.out 409.out 309.out 209.out 441.out 157.out 356.out 257.out 341.out 678.out 094.out 337.out 241.out 077.out 714.out 616.out 614.out 514.out 414.out 314.out 440.out 114.out 014.out 342.out 671.out 116.out 667.out 340.out 649.out 572.out 568.out 586.out 240.out 549.out 267.out 633.out 434.out 140.out 708.out 533.out 185.out 508.out 408.out 308.out 433.out 670.out 404.out 104.out 004.out 416.out 141.out 176.out 118.out 640.out 483.out 565.out 297.out 393.out 560.out 333.out 599.out 683.out 199.out 227.out 233.out 245.out 639.out 443.out 540.out 086.out 539.out 711.out 164.out 636.out 339.out 652.out 694.out 617.out 498.out 489.out 139.out 178.out 390.out 552.out 695.out 576.out 357.out 677.out 415.out 175.out 593.out 067.out 452.out 679.out 548.out 015.out 606.out 376.out 352.out 663.out 002.out 394.out 651.out 495.out 188.out 482.out 625.out 283.out 252.out 488.out 148.out 673.out 040.out 325.out 551.out 225.out 096.out 125.out 186.out 222.out 693.out 650.out 152.out 630.out 563.out 674.out 451.out 436.out 392.out 075.out 595.out 578.out 530.out 550.out 052.out 062.out 351.out 276.out 475.out 450.out 517.out 463.out 330.out 069.out 644.out 688.out 350.out 544.out 715.out 395.out 515.out 315.out 344.out 215.out 115.out 597.out 205.out 250.out 681.out 594.out 536.out 577.out 244.out 637.out 336.out 579.out 236.out 405.out 182.out 136.out 598.out 144.out 036.out 198.out 108.out 008.out 680.out 705.out 605.out 505.out 305.out 105.out 005.out 367.out 291.out 437.out 266.out 619.out 189.out 685.out 363.out 562.out 382.out 570.out 388.out 527.out 044.out 689.out 432.out 237.out 190.out 163.out 556.out 413.out 332.out 661.out 664.out 320.out 521.out 582.out 372.out 478.out 612.out 584.out 462.out 173.out 037.out 251.out 492.out 051.out 099.out 660.out 063.out 561.out 668.out 465.out 648.out 362.out 387.out 194.out 721.out 289.out 574.out 477.out 123.out 370.out 519.out 290.out 299.out 581.out 076.out 461.out 646.out 107.out 263.out 658.out 626.out 592.out 380.out 093.out 479.out 547.out 221.out 326.out 480.out 226.out 454.out 126.out 121.out 555.out 499.out 580.out 021.out 485.out 347.out 675.out 702.out 361.out 564.out 294.out 066.out 247.out 585.out 162.out 083.out 147.out 288.out 197.out 396.out 446.out 354.out 355.out 575.out 360.out 431.out 543.out 270.out 261.out 045.out 692.out 634.out 272.out 729.out 378.out 458.out 534.out 151.out 429.out 662.out 503.out 329.out 587.out 303.out 129.out 131.out 368.out 486.out 223.out 132.out 669.out 023.out 459.out 032.out 277.out 146.out 398.out 728.out 296.out 590.out 280.out 484.out 491.out 455.out 016.out 656.out 731.out 374.out 583.out 285.out 631.out 328.out 260.out 501.out 171.out 027.out 101.out 687.out 722.out 331.out 504.out 179.out 231.out 613.out 513.out 213.out 730.out 095.out 013.out 031.out 364.out 645.out 596.out 727.out 078.out 510.out 627.out 184.out 430.out 569.out 427.out 259.out 210.out 449.out 327.out 397.out 643.out 493.out 419.out 127.out 699.out 071.out 445.out 292.out 130.out 219.out 073.out 703.out 603.out 403.out 030.out 203.out 103.out 003.out 025.out 386.out 349.out 055.out 456.out 469.out 622.out 122.out 026.out 522.out 422.out 624.out 322.out 254.out 159.out 249.out 381.out 448.out 166.out 022.out 642.out 684.out 490.out 654.out 435.out 439.out 353.out 375.out 600.out 154.out 566.out 500.out 618.out 518.out 418.out 318.out 264.out 218.out 018.out 232.out 172.out 168.out 034.out 293.out 079.out 054.out 059.out 049.out 348.out 239.out 442.out 228.out 657.out 621.out 476.out 180.out 421.out 712.out 321.out 057.out 512.out 494.out 412.out 312.out 212.out 112.out 256.out 012.out 028.out 682.out 554.out 070.out 373.out 720.out 481.out 243.out 196.out 520.out 242.out 457.out 655.out 120.out 019.out 220.out 629.out 602.out 153.out 402.out 302.out 020.out 529.out 717.out 460.out 417.out 317.out 142.out 092.out 672.out 072.out 068.out 143.out 229.out 038.out 084.out 369.out 262.out 611.out 511.out 029.out 311.out 676.out 187.out 170.out 053.out 065.out 286.out 713.out 043.out 496.out 056.out 545.out 559.out 710.out 610.out 274.out 410.out 701.out 601.out 401.out 301.out 201.out 010.out 001.out 214.out 281.out 048.out 665.out 589.out 113.out 074.out 697.out 145.out 641.out 464.out 091.out 081.out 653.out 700.out 400.out 300.out 200.out 100.out 359.out 541.out 269.out 546.out 698.out 553.out 298.out 169.out 090.out 080.out 707.out 608.out 507.out 407.out 307.out 208.out 109.out 009.out 391.out 230.out 150.out 557.out 453.out 666.out 246.out 725.out 383.out 085.out 704.out 604.out 635.out 334.out 525.out 558.out 304.out 204.out 535.out 425.out 345.out 335.out 207.out 718.out 444.out 235.out 470.out 268.out 253.out 165.out 275.out 615.out /var/lib/xfstests/tests/generic 2023-10-06T04:31:21.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/nfs/ install 2023-10-06T04:31:21.762 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-10-06T04:31:21.786 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-10-06T04:31:21.810 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-10-06T04:31:21.833 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-10-06T04:31:21.857 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/ocfs2/ install 2023-10-06T04:31:21.860 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-10-06T04:31:21.883 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-10-06T04:31:21.907 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-10-06T04:31:21.930 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-10-06T04:31:21.958 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/overlay/ install 2023-10-06T04:31:21.959 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-10-06T04:31:21.981 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-10-06T04:31:22.772 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-10-06T04:31:22.796 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 048.out 018.out 020.out 102.out 028.out 024.out 013.out 031.out 015.out 117.out 072.out 078.out 004.out 062.out 038.out 052.out 042.out 076.out 066.out 010.out 003.out 029.out 055.out 023.out 073.out 068.out 053.out 030.out 103.out 063.out 017.out 043.out 077.out 109.out 075.out 116.out 016.out 065.out 041.out 107.out 101.out 022.out 113.out 106.out 014.out 115.out 057.out 035.out 027.out 001.out 114.out 074.out 036.out 111.out 061.out 011.out 026.out 071.out 037.out 058.out 108.out 100.out 064.out 080.out 005.out 079.out 069.out 054.out 059.out 049.out 032.out 039.out 045.out 002.out 025.out 056.out 008.out 110.out 060.out 050.out 105.out 006.out 047.out 021.out 067.out 112.out 046.out 012.out 009.out 007.out 033.out 070.out 040.out 044.out 051.out 019.out 034.out 104.out /var/lib/xfstests/tests/overlay 2023-10-06T04:31:23.589 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/perf/ install 2023-10-06T04:31:23.591 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-10-06T04:31:23.615 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-10-06T04:31:23.639 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-10-06T04:31:23.663 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-10-06T04:31:23.687 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/selftest/ install 2023-10-06T04:31:23.689 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-10-06T04:31:23.713 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-10-06T04:31:23.776 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-10-06T04:31:23.799 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 005.out 003.out 006.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-10-06T04:31:23.862 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/shared/ install 2023-10-06T04:31:23.865 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-10-06T04:31:23.889 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-10-06T04:31:23.928 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-10-06T04:31:23.952 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-10-06T04:31:23.992 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/tmpfs/ install 2023-10-06T04:31:23.994 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-10-06T04:31:24.018 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-10-06T04:31:24.042 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-10-06T04:31:24.066 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-10-06T04:31:24.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/udf/ install 2023-10-06T04:31:24.092 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-10-06T04:31:24.116 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-10-06T04:31:24.139 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-10-06T04:31:24.163 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-10-06T04:31:24.187 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cHkpSAqJTKxfstests-dev/tests/xfs/ install 2023-10-06T04:31:24.193 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-10-06T04:31:24.216 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-10-06T04:31:29.726 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-10-06T04:31:29.751 INFO:teuthology.orchestra.run.smithi060.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 185.out 508.out 408.out 308.out 566.out 433.out 108.out 040.out 104.out 047.out 287.out 537.out 234.out 158.out 337.out 082.out 248.out 759.out 088.out 097.out 296.out 137.out 102.out 343.out 110.out 468.out 525.out 181.out 571.out 775.out 531.out 765.out 192.out 282.out 342.out 472.out 528.out 428.out 507.out 128.out 183.out 273.out 420.out 087.out 089.out 406.out 195.out 732.out 466.out 443.out 227.out 532.out 591.out 471.out 111.out 723.out 255.out 011.out 319.out 467.out 523.out 119.out 423.out 323.out 429.out 329.out 587.out 229.out 129.out 131.out 155.out 134.out 260.out 076.out 034.out 445.out 716.out 161.out 246.out 538.out 316.out 418.out 116.out 438.out 358.out 338.out 238.out 295.out 138.out 474.out 160.out 373.out 061.out 085.out 457.out 522.out 772.out 768.out 530.out 258.out 379.out 322.out 039.out 742.out 098.out 426.out 290.out 573.out 060.out 506.out 306.out 206.out 106.out 006.out 447.out 217.out 191.out 117.out 455.out 542.out 442.out 188.out 065.out 177.out 724.out 279.out 281.out 524.out 424.out 413.out 771.out 324.out 224.out 313.out 355.out 124.out 232.out 024.out 278.out 058.out 741.out 113.out 042.out 497.out 487.out 377.out 193.out 799.out 456.out 526.out 399.out 473.out 770.out 045.out 409.out 364.out 391.out 441.out 157.out 740.out 356.out 341.out 494.out 189.out 241.out 540.out 077.out 714.out 514.out 243.out 414.out 314.out 440.out 114.out 014.out 766.out 041.out 277.out 340.out 793.out 156.out 572.out 568.out 586.out 240.out 733.out 092.out 267.out 543.out 140.out 708.out 533.out 335.out 207.out 718.out 235.out 268.out 556.out 253.out 403.out 165.out 303.out 782.out 431.out 784.out 141.out 176.out 169.out 118.out 444.out 483.out 018.out 393.out 333.out 599.out 367.out 199.out 739.out 068.out 233.out 752.out 736.out 015.out 007.out 773.out 086.out 539.out 133.out 711.out 164.out 339.out 239.out 521.out 458.out 489.out 139.out 411.out 484.out 465.out 552.out 763.out 576.out 357.out 515.out 593.out 067.out 186.out 452.out 069.out 548.out 252.out 751.out 563.out 167.out 190.out 352.out 348.out 346.out 394.out 309.out 495.out 785.out 174.out 283.out 750.out 488.out 148.out 325.out 551.out 225.out 125.out 789.out 222.out 152.out 774.out 436.out 392.out 075.out 748.out 578.out 550.out 052.out 062.out 351.out 463.out 430.out 276.out 094.out 475.out 450.out 517.out 744.out 330.out 036.out 762.out 350.out 544.out 728.out 715.out 395.out 151.out 415.out 389.out 315.out 384.out 215.out 115.out 197.out 250.out 791.out 344.out 051.out 536.out 244.out 336.out 150.out 579.out 236.out 505.out 136.out 598.out 144.out 496.out 198.out 008.out 790.out 178.out 050.out 405.out 305.out 205.out 105.out 005.out 027.out 291.out 761.out 437.out 719.out 211.out 727.out 519.out 363.out 562.out 419.out 271.out 570.out 388.out 527.out 056.out 299.out 432.out 237.out 779.out 760.out 163.out 044.out 332.out 796.out 582.out 372.out 478.out 584.out 462.out 220.out 173.out 597.out 037.out 251.out 112.out 020.out 063.out 792.out 561.out 776.out 781.out 746.out 758.out 362.out 387.out 194.out 265.out 588.out 289.out 574.out 516.out 284.out 123.out 560.out 595.out 461.out 477.out 451.out 390.out 786.out 263.out 448.out 592.out 380.out 093.out 479.out 547.out 221.out 326.out 480.out 226.out 454.out 126.out 121.out 555.out 499.out 580.out 460.out 013.out 756.out 485.out 347.out 035.out 361.out 564.out 294.out 066.out 504.out 247.out 747.out 585.out 162.out 083.out 147.out 288.out 396.out 446.out 298.out 575.out 209.out 381.out 360.out 374.out 270.out 261.out 755.out 292.out 304.out 482.out 726.out 729.out 378.out 048.out 534.out 368.out 486.out 223.out 132.out 179.out 023.out 459.out 032.out 798.out 266.out 146.out 107.out 398.out 366.out 590.out 280.out 470.out 767.out 749.out 016.out 091.out 046.out 153.out 731.out 583.out 285.out 788.out 501.out 171.out 581.out 376.out 101.out 385.out 722.out 331.out 743.out 231.out 469.out 513.out 371.out 549.out 213.out 730.out 095.out 031.out 565.out 182.out 596.out 272.out 078.out 754.out 184.out 797.out 569.out 427.out 259.out 210.out 449.out 327.out 397.out 777.out 493.out 010.out 127.out 230.out 769.out 130.out 219.out 073.out 370.out 503.out 030.out 203.out 103.out 003.out 386.out 349.out 055.out 275.out 245.out 026.out 787.out 745.out 422.out 794.out 159.out 249.out 122.out 166.out 022.out 490.out 435.out 439.out 353.out 375.out 154.out 500.out 149.out 518.out 318.out 264.out 218.out 757.out 172.out 168.out 293.out 328.out 079.out 054.out 059.out 202.out 049.out 021.out 738.out 228.out 721.out 476.out 180.out 421.out 712.out 321.out 057.out 512.out 412.out 312.out 212.out 256.out 012.out 764.out 028.out 554.out 365.out 070.out 416.out 720.out 481.out 196.out 520.out 242.out 498.out 320.out 019.out 425.out 120.out 502.out 402.out 302.out 529.out 002.out 717.out 135.out 417.out 317.out 142.out 492.out 017.out 072.out 778.out 143.out 038.out 737.out 084.out 369.out 262.out 594.out 511.out 025.out 029.out 311.out 783.out 187.out 170.out 053.out 286.out 713.out 043.out 175.out 545.out 559.out 710.out 510.out 274.out 410.out 310.out 401.out 301.out 201.out 001.out 734.out 214.out 589.out 753.out 074.out 297.out 145.out 257.out 464.out 491.out 081.out 800.out 600.out 064.out 400.out 300.out 200.out 100.out 359.out 577.out 354.out 541.out 269.out 546.out 382.out 780.out 099.out 553.out 567.out 090.out 080.out 709.out 509.out 407.out 307.out 208.out 109.out 009.out 434.out 557.out 453.out 725.out 735.out 383.out 334.out 404.out 558.out 204.out 535.out 795.out 004.out 345.out 254.out /var/lib/xfstests/tests/xfs 2023-10-06T04:31:35.313 INFO:teuthology.orchestra.run.smithi060.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-10-06T04:31:35.337 INFO:teuthology.orchestra.run.smithi060.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-10-06T04:31:35.361 INFO:teuthology.orchestra.run.smithi060.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-10-06T04:31:35.385 INFO:teuthology.orchestra.run.smithi060.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-10-06T04:31:35.413 INFO:tasks.cephfs.test_acls:client is kernel mounted 2023-10-06T04:31:35.413 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T04:31:35.413 DEBUG:teuthology.orchestra.run.smithi060:running tests for ACLs from xfstests-dev> (cd /tmp/tmp.cHkpSAqJTKxfstests-dev && exec sudo ./check generic/099) 2023-10-06T04:31:35.889 INFO:teuthology.orchestra.run.smithi060.stdout:FSTYP -- ceph 2023-10-06T04:31:35.902 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM -- Linux/x86_64 smithi060 6.5.0-rc7-gfef64f93da2b #1 SMP PREEMPT_DYNAMIC Mon Sep 11 02:22:53 UTC 2023 2023-10-06T04:31:35.902 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:31:37.191 INFO:teuthology.orchestra.run.smithi060.stdout:generic/099 2s 2023-10-06T04:31:37.204 INFO:teuthology.orchestra.run.smithi060.stdout:Ran: generic/099 2023-10-06T04:31:37.204 INFO:teuthology.orchestra.run.smithi060.stdout:Passed all 1 tests 2023-10-06T04:31:37.210 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:31:37.288 DEBUG:teuthology.orchestra.run.smithi060:> sudo userdel --force --remove fsgqa 2023-10-06T04:31:39.582 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:31:39.587 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:31:40.311 DEBUG:teuthology.orchestra.run.smithi060:> sudo userdel --force --remove 123456-fsgqa 2023-10-06T04:31:43.011 DEBUG:teuthology.orchestra.run.smithi060:> sudo groupdel fsgqa 2023-10-06T04:31:43.097 INFO:teuthology.orchestra.run.smithi060.stderr:groupdel: group 'fsgqa' does not exist 2023-10-06T04:31:43.100 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-06T04:31:43.101 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf /tmp/tmp.cHkpSAqJTKxfstests-dev 2023-10-06T04:31:43.367 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T04:31:43.367 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:31:43.448 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T04:31:43.531 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T04:31:43.531 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T04:31:43.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T04:31:43.531 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T04:31:43.615 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2023-10-06T04:31:43.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:31:43.615 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T04:31:43.653 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:31:43.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.878+0000 7f6746d9d700 1 Processor -- start 2023-10-06T04:31:43.880 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.879+0000 7f6746d9d700 1 -- start start 2023-10-06T04:31:43.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.880+0000 7f6746d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6740158db0 0x7f674006d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:43.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.880+0000 7f6746d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6740159180 0x7f67400c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:43.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.880+0000 7f6746d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67400c1590 0x7f67400c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:43.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.880+0000 7f6746d9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67400c1f50 con 0x7f6740159180 2023-10-06T04:31:43.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.880+0000 7f6746d9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f674006e910 con 0x7f6740158db0 2023-10-06T04:31:43.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.880+0000 7f6746d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674006dd00 con 0x7f67400c1590 2023-10-06T04:31:43.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.880+0000 7f674559a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6740159180 0x7f67400c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:43.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.880+0000 7f674559a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6740159180 0x7f67400c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42468/0 (socket says 172.21.15.60:42468) 2023-10-06T04:31:43.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.880+0000 7f674559a700 1 -- 172.21.15.60:0/1660130048 learned_addr learned my addr 172.21.15.60:0/1660130048 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:43.883 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.880+0000 7f6745d9b700 1 --2- 172.21.15.60:0/1660130048 >> v2:172.21.15.135:3300/0 conn(0x7f6740158db0 0x7f674006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:43.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.880+0000 7f674659c700 1 --2- 172.21.15.60:0/1660130048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67400c1590 0x7f67400c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:43.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.881+0000 7f674559a700 1 -- 172.21.15.60:0/1660130048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67400c1590 msgr2=0x7f67400c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:43.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.881+0000 7f674559a700 1 --2- 172.21.15.60:0/1660130048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67400c1590 0x7f67400c1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:43.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.881+0000 7f674559a700 1 -- 172.21.15.60:0/1660130048 >> v2:172.21.15.135:3300/0 conn(0x7f6740158db0 msgr2=0x7f674006d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:43.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.881+0000 7f674559a700 1 --2- 172.21.15.60:0/1660130048 >> v2:172.21.15.135:3300/0 conn(0x7f6740158db0 0x7f674006d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:43.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.881+0000 7f674559a700 1 -- 172.21.15.60:0/1660130048 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674006dfe0 con 0x7f6740159180 2023-10-06T04:31:43.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.881+0000 7f674559a700 1 --2- 172.21.15.60:0/1660130048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6740159180 0x7f67400c72b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f67400c9a10 tx=0x7f6730009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e445c941b23d5a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:43.884 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.881+0000 7f6744d99700 1 -- 172.21.15.60:0/1660130048 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673000b640 con 0x7f6740159180 2023-10-06T04:31:43.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.881+0000 7f6744d99700 1 -- 172.21.15.60:0/1660130048 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673000b7a0 con 0x7f6740159180 2023-10-06T04:31:43.885 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.881+0000 7f6744d99700 1 -- 172.21.15.60:0/1660130048 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673000bb60 con 0x7f6740159180 2023-10-06T04:31:43.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.882+0000 7f6746d9d700 1 -- 172.21.15.60:0/1660130048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6740159180 msgr2=0x7f67400c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:43.886 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.882+0000 7f6746d9d700 1 --2- 172.21.15.60:0/1660130048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6740159180 0x7f67400c72b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f67400c9a10 tx=0x7f6730009250 comp rx=0 tx=0).stop 2023-10-06T04:31:43.888 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.882+0000 7f6746d9d700 1 -- 172.21.15.60:0/1660130048 shutdown_connections 2023-10-06T04:31:43.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.882+0000 7f6746d9d700 1 --2- 172.21.15.60:0/1660130048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67400c1590 0x7f67400c1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:43.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.882+0000 7f6746d9d700 1 --2- 172.21.15.60:0/1660130048 >> v2:172.21.15.135:3300/0 conn(0x7f6740158db0 0x7f674006d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:43.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.882+0000 7f6746d9d700 1 --2- 172.21.15.60:0/1660130048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6740159180 0x7f67400c72b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:43.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.882+0000 7f6746d9d700 1 -- 172.21.15.60:0/1660130048 >> 172.21.15.60:0/1660130048 conn(0x7f67400cbeb0 msgr2=0x7f67400cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:43.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.882+0000 7f6746d9d700 1 -- 172.21.15.60:0/1660130048 shutdown_connections 2023-10-06T04:31:43.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.882+0000 7f6746d9d700 1 -- 172.21.15.60:0/1660130048 wait complete. 2023-10-06T04:31:43.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.883+0000 7f6746d9d700 1 Processor -- start 2023-10-06T04:31:43.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.884+0000 7f6746d9d700 1 -- start start 2023-10-06T04:31:43.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.884+0000 7f6746d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67400c1590 0x7f6740153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:43.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.884+0000 7f6746d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6740158db0 0x7f67400aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:43.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.884+0000 7f6746d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6740159180 0x7f67400ab700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:43.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.884+0000 7f6746d9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67400cb810 con 0x7f6740159180 2023-10-06T04:31:43.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.884+0000 7f6746d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67400aa5f0 con 0x7f6740158db0 2023-10-06T04:31:43.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.884+0000 7f6746d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67400a99e0 con 0x7f67400c1590 2023-10-06T04:31:43.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.885+0000 7f674659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6740159180 0x7f67400ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:43.890 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.885+0000 7f674659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6740159180 0x7f67400ab700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42478/0 (socket says 172.21.15.60:42478) 2023-10-06T04:31:43.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.885+0000 7f674659c700 1 -- 172.21.15.60:0/485806901 learned_addr learned my addr 172.21.15.60:0/485806901 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:43.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.885+0000 7f674559a700 1 --2- 172.21.15.60:0/485806901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6740158db0 0x7f67400aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:43.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.885+0000 7f6745d9b700 1 --2- 172.21.15.60:0/485806901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67400c1590 0x7f6740153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:43.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.885+0000 7f674659c700 1 -- 172.21.15.60:0/485806901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67400c1590 msgr2=0x7f6740153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:43.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.885+0000 7f674659c700 1 --2- 172.21.15.60:0/485806901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67400c1590 0x7f6740153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:43.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.885+0000 7f674659c700 1 -- 172.21.15.60:0/485806901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6740158db0 msgr2=0x7f67400aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:43.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.885+0000 7f674659c700 1 --2- 172.21.15.60:0/485806901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6740158db0 0x7f67400aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:43.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.885+0000 7f674659c700 1 -- 172.21.15.60:0/485806901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67300094f0 con 0x7f6740159180 2023-10-06T04:31:43.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.885+0000 7f674559a700 1 --2- 172.21.15.60:0/485806901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6740158db0 0x7f67400aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:31:43.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.885+0000 7f674659c700 1 --2- 172.21.15.60:0/485806901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6740159180 0x7f67400ab700 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6738009df0 tx=0x7f673800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:43.891 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.886+0000 7f6735ffb700 1 -- 172.21.15.60:0/485806901 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673800cb50 con 0x7f6740159180 2023-10-06T04:31:43.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.886+0000 7f6735ffb700 1 -- 172.21.15.60:0/485806901 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673800f040 con 0x7f6740159180 2023-10-06T04:31:43.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.886+0000 7f6735ffb700 1 -- 172.21.15.60:0/485806901 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738014480 con 0x7f6740159180 2023-10-06T04:31:43.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.886+0000 7f6746d9d700 1 -- 172.21.15.60:0/485806901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67400a9cc0 con 0x7f6740159180 2023-10-06T04:31:43.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.886+0000 7f6746d9d700 1 -- 172.21.15.60:0/485806901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67400aa280 con 0x7f6740159180 2023-10-06T04:31:43.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.887+0000 7f6746d9d700 1 -- 172.21.15.60:0/485806901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67400aa780 con 0x7f6740159180 2023-10-06T04:31:43.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.888+0000 7f6735ffb700 1 -- 172.21.15.60:0/485806901 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6738014830 con 0x7f6740159180 2023-10-06T04:31:43.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.888+0000 7f6735ffb700 1 --2- 172.21.15.60:0/485806901 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6724066f30 0x7f67240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:43.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.889+0000 7f6735ffb700 1 -- 172.21.15.60:0/485806901 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f6738085260 con 0x7f6740159180 2023-10-06T04:31:43.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.889+0000 7f6745d9b700 1 --2- 172.21.15.60:0/485806901 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6724066f30 0x7f67240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:43.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.889+0000 7f6745d9b700 1 --2- 172.21.15.60:0/485806901 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6724066f30 0x7f67240693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f673c009cb0 tx=0x7f673c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:43.894 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:43.893+0000 7f6735ffb700 1 -- 172.21.15.60:0/485806901 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6738052150 con 0x7f6740159180 2023-10-06T04:31:44.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.142+0000 7f6746d9d700 1 -- 172.21.15.60:0/485806901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f674005f230 con 0x7f6740159180 2023-10-06T04:31:44.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.143+0000 7f6735ffb700 1 -- 172.21.15.60:0/485806901 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f6738055770 con 0x7f6740159180 2023-10-06T04:31:44.145 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:31:44.145 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1681836371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1681836371},{"type":"v1","addr":"172.21.15.135:6834","nonce":1681836371}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/823204172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":823204172},{"type":"v1","addr":"172.21.15.135:6835","nonce":823204172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4963,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1348379028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1348379028},{"type":"v1","addr":"172.21.15.60:6836","nonce":1348379028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:29:20.429944+0000","modified":"2023-10-06T04:29:23.960780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6837/749877170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":749877170},{"type":"v1","addr":"172.21.15.60:6837","nonce":749877170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:31:44.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.145+0000 7f6746d9d700 1 -- 172.21.15.60:0/485806901 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6724066f30 msgr2=0x7f67240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:44.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.145+0000 7f6746d9d700 1 --2- 172.21.15.60:0/485806901 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6724066f30 0x7f67240693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f673c009cb0 tx=0x7f673c008040 comp rx=0 tx=0).stop 2023-10-06T04:31:44.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.146+0000 7f6746d9d700 1 -- 172.21.15.60:0/485806901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6740159180 msgr2=0x7f67400ab700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:44.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.146+0000 7f6746d9d700 1 --2- 172.21.15.60:0/485806901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6740159180 0x7f67400ab700 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6738009df0 tx=0x7f673800b040 comp rx=0 tx=0).stop 2023-10-06T04:31:44.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.146+0000 7f6746d9d700 1 -- 172.21.15.60:0/485806901 shutdown_connections 2023-10-06T04:31:44.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.146+0000 7f6746d9d700 1 --2- 172.21.15.60:0/485806901 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6724066f30 0x7f67240693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:44.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.146+0000 7f6746d9d700 1 --2- 172.21.15.60:0/485806901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6740159180 0x7f67400ab700 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:44.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.146+0000 7f6746d9d700 1 --2- 172.21.15.60:0/485806901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67400c1590 0x7f6740153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:44.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.146+0000 7f6746d9d700 1 --2- 172.21.15.60:0/485806901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6740158db0 0x7f67400aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:44.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.146+0000 7f6746d9d700 1 -- 172.21.15.60:0/485806901 >> 172.21.15.60:0/485806901 conn(0x7f67400cbeb0 msgr2=0x7f6740157d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:44.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.146+0000 7f6746d9d700 1 -- 172.21.15.60:0/485806901 shutdown_connections 2023-10-06T04:31:44.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.146+0000 7f6746d9d700 1 -- 172.21.15.60:0/485806901 wait complete. 2023-10-06T04:31:44.149 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 16 2023-10-06T04:31:44.167 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:31:44.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.353+0000 7fd4b9b9d700 1 Processor -- start 2023-10-06T04:31:44.355 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.354+0000 7fd4b9b9d700 1 -- start start 2023-10-06T04:31:44.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.355+0000 7fd4b9b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4b40cc090 0x7fd4b415d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:44.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.355+0000 7fd4b9b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd4b415dc00 0x7fd4b40675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:44.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.355+0000 7fd4b9b9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b40c16f0 con 0x7fd4b4159320 2023-10-06T04:31:44.356 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.355+0000 7fd4b9b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b40c2550 con 0x7fd4b415dc00 2023-10-06T04:31:44.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.355+0000 7fd4b9b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40cc500 con 0x7fd4b40cc090 2023-10-06T04:31:44.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.355+0000 7fd4b8b9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd4b4159320 0x7fd4b415cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46572/0 (socket says 172.21.15.60:46572) 2023-10-06T04:31:44.357 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.355+0000 7fd4b8b9b700 1 -- 172.21.15.60:0/3504068208 learned_addr learned my addr 172.21.15.60:0/3504068208 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:31:44.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.356+0000 7fd4b37fe700 1 -- 172.21.15.60:0/3504068208 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173292501 0 0) 0x7fd4b40c16f0 con 0x7fd4b4159320 2023-10-06T04:31:44.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.356+0000 7fd4b939c700 1 --2- 172.21.15.60:0/3504068208 >> v2:172.21.15.135:3300/0 conn(0x7fd4b415dc00 0x7fd4b40675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:44.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.356+0000 7fd4b37fe700 1 -- 172.21.15.60:0/3504068208 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4a4003570 con 0x7fd4b4159320 2023-10-06T04:31:44.359 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.356+0000 7fd4b3fff700 1 --2- 172.21.15.60:0/3504068208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4b40cc090 0x7fd4b415d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:44.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.356+0000 7fd4b37fe700 1 -- 172.21.15.60:0/3504068208 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1496603636 0 0) 0x7fd4a4003570 con 0x7fd4b4159320 2023-10-06T04:31:44.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.356+0000 7fd4b37fe700 1 -- 172.21.15.60:0/3504068208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4b40cc090 msgr2=0x7fd4b415d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:44.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.356+0000 7fd4b37fe700 1 --2- 172.21.15.60:0/3504068208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4b40cc090 0x7fd4b415d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:44.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.356+0000 7fd4b37fe700 1 -- 172.21.15.60:0/3504068208 >> v2:172.21.15.135:3300/0 conn(0x7fd4b415dc00 msgr2=0x7fd4b40675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:44.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.356+0000 7fd4b37fe700 1 --2- 172.21.15.60:0/3504068208 >> v2:172.21.15.135:3300/0 conn(0x7fd4b415dc00 0x7fd4b40675b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:44.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.356+0000 7fd4b37fe700 1 -- 172.21.15.60:0/3504068208 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b40c1940 con 0x7fd4b4159320 2023-10-06T04:31:44.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.356+0000 7fd4b37fe700 1 -- 172.21.15.60:0/3504068208 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7fd4a8001470 con 0x7fd4b4159320 2023-10-06T04:31:44.360 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.356+0000 7fd4b37fe700 1 -- 172.21.15.60:0/3504068208 >> v1:172.21.15.60:6789/0 conn(0x7fd4b4159320 legacy=0x7fd4b415cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:44.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.356+0000 7fd4b37fe700 1 --2- 172.21.15.60:0/3504068208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4b40cc090 0x7fd4a4003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:44.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.356+0000 7fd4b37fe700 1 --2- 172.21.15.60:0/3504068208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4a40040b0 0x7fd4a4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:44.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.356+0000 7fd4b37fe700 1 --2- 172.21.15.60:0/3504068208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a4004d50 0x7fd4a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:44.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.356+0000 7fd4b37fe700 1 -- 172.21.15.60:0/3504068208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40c2550 con 0x7fd4a4004d50 2023-10-06T04:31:44.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.356+0000 7fd4b37fe700 1 -- 172.21.15.60:0/3504068208 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40cc500 con 0x7fd4a40040b0 2023-10-06T04:31:44.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.356+0000 7fd4b37fe700 1 -- 172.21.15.60:0/3504068208 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a400bb60 con 0x7fd4b40cc090 2023-10-06T04:31:44.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.357+0000 7fd4b939c700 1 --2- 172.21.15.60:0/3504068208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a4004d50 0x7fd4a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:44.361 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.357+0000 7fd4b8b9b700 1 --2- 172.21.15.60:0/3504068208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4b40cc090 0x7fd4a4003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:44.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.357+0000 7fd4b3fff700 1 --2- 172.21.15.60:0/3504068208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4a40040b0 0x7fd4a4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:44.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.357+0000 7fd4b939c700 1 -- 172.21.15.60:0/3504068208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4b40cc090 msgr2=0x7fd4a4003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:44.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.357+0000 7fd4b939c700 1 --2- 172.21.15.60:0/3504068208 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4b40cc090 0x7fd4a4003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:44.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.357+0000 7fd4b939c700 1 -- 172.21.15.60:0/3504068208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4a40040b0 msgr2=0x7fd4a4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:44.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.357+0000 7fd4b939c700 1 --2- 172.21.15.60:0/3504068208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4a40040b0 0x7fd4a4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:44.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.357+0000 7fd4b939c700 1 -- 172.21.15.60:0/3504068208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a4003570 con 0x7fd4a4004d50 2023-10-06T04:31:44.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.357+0000 7fd4b939c700 1 --2- 172.21.15.60:0/3504068208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a4004d50 0x7fd4a40051c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac0094d0 tx=0x7fd4ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789fb31516cf470b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:44.362 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.357+0000 7fd4b37fe700 1 -- 172.21.15.60:0/3504068208 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00ea60 con 0x7fd4a4004d50 2023-10-06T04:31:44.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.357+0000 7fd4b37fe700 1 -- 172.21.15.60:0/3504068208 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ac00f040 con 0x7fd4a4004d50 2023-10-06T04:31:44.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.357+0000 7fd4b37fe700 1 -- 172.21.15.60:0/3504068208 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00edf0 con 0x7fd4a4004d50 2023-10-06T04:31:44.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.358+0000 7fd4b9b9d700 1 -- 172.21.15.60:0/3504068208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a4004d50 msgr2=0x7fd4a40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:44.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.358+0000 7fd4b9b9d700 1 --2- 172.21.15.60:0/3504068208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a4004d50 0x7fd4a40051c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac0094d0 tx=0x7fd4ac00b040 comp rx=0 tx=0).stop 2023-10-06T04:31:44.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.358+0000 7fd4b939c700 1 -- 172.21.15.60:0/3504068208 reap_dead start 2023-10-06T04:31:44.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.358+0000 7fd4b9b9d700 1 -- 172.21.15.60:0/3504068208 shutdown_connections 2023-10-06T04:31:44.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.358+0000 7fd4b9b9d700 1 -- 172.21.15.60:0/3504068208 >> 172.21.15.60:0/3504068208 conn(0x7fd4b40c91a0 msgr2=0x7fd4b40c95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:44.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.358+0000 7fd4b9b9d700 1 -- 172.21.15.60:0/3504068208 shutdown_connections 2023-10-06T04:31:44.363 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.358+0000 7fd4b9b9d700 1 -- 172.21.15.60:0/3504068208 wait complete. 2023-10-06T04:31:44.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.359+0000 7fd4b9b9d700 1 Processor -- start 2023-10-06T04:31:44.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.360+0000 7fd4b9b9d700 1 -- start start 2023-10-06T04:31:44.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.360+0000 7fd4b9b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4a4004d50 0x7fd4b4144260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:44.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.360+0000 7fd4b9b9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4b40ab1e0 0x7fd4b40abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:44.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.360+0000 7fd4b9b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4b41693b0 0x7fd4b4069570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:44.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.360+0000 7fd4b9b9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b41447a0 con 0x7fd4b40ab1e0 2023-10-06T04:31:44.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.360+0000 7fd4b9b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40ac300 con 0x7fd4a4004d50 2023-10-06T04:31:44.366 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.360+0000 7fd4b9b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40b1350 con 0x7fd4b41693b0 2023-10-06T04:31:44.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.361+0000 7fd4b3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4b40ab1e0 0x7fd4b40abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:44.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.361+0000 7fd4b3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4b40ab1e0 0x7fd4b40abdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42500/0 (socket says 172.21.15.60:42500) 2023-10-06T04:31:44.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.361+0000 7fd4b3fff700 1 -- 172.21.15.60:0/4055440830 learned_addr learned my addr 172.21.15.60:0/4055440830 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:44.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.361+0000 7fd4b939c700 1 --2- 172.21.15.60:0/4055440830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4b41693b0 0x7fd4b4069570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:44.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.361+0000 7fd4b8b9b700 1 --2- 172.21.15.60:0/4055440830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4a4004d50 0x7fd4b4144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:44.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.361+0000 7fd4b3fff700 1 -- 172.21.15.60:0/4055440830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4b41693b0 msgr2=0x7fd4b4069570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:44.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.361+0000 7fd4b3fff700 1 --2- 172.21.15.60:0/4055440830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4b41693b0 0x7fd4b4069570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:44.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.361+0000 7fd4b3fff700 1 -- 172.21.15.60:0/4055440830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4a4004d50 msgr2=0x7fd4b4144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:44.367 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.361+0000 7fd4b3fff700 1 --2- 172.21.15.60:0/4055440830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4a4004d50 0x7fd4b4144260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:44.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.361+0000 7fd4b3fff700 1 -- 172.21.15.60:0/4055440830 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b40b04a0 con 0x7fd4b40ab1e0 2023-10-06T04:31:44.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.361+0000 7fd4b3fff700 1 --2- 172.21.15.60:0/4055440830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4b40ab1e0 0x7fd4b40abdc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0006ac0 tx=0x7fd4a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:44.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.361+0000 7fd4b0ff9700 1 -- 172.21.15.60:0/4055440830 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a000f9b0 con 0x7fd4b40ab1e0 2023-10-06T04:31:44.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.362+0000 7fd4b0ff9700 1 -- 172.21.15.60:0/4055440830 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a000fb10 con 0x7fd4b40ab1e0 2023-10-06T04:31:44.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.362+0000 7fd4b9b9d700 1 -- 172.21.15.60:0/4055440830 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b40b0740 con 0x7fd4b40ab1e0 2023-10-06T04:31:44.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.362+0000 7fd4b0ff9700 1 -- 172.21.15.60:0/4055440830 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a000fe90 con 0x7fd4b40ab1e0 2023-10-06T04:31:44.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.362+0000 7fd4b9b9d700 1 -- 172.21.15.60:0/4055440830 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b40b0d00 con 0x7fd4b40ab1e0 2023-10-06T04:31:44.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.363+0000 7fd4b9b9d700 1 -- 172.21.15.60:0/4055440830 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b40b1500 con 0x7fd4b40ab1e0 2023-10-06T04:31:44.368 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.363+0000 7fd4b0ff9700 1 -- 172.21.15.60:0/4055440830 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4a0014650 con 0x7fd4b40ab1e0 2023-10-06T04:31:44.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.365+0000 7fd4b0ff9700 1 --2- 172.21.15.60:0/4055440830 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd498066f30 0x7fd4980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:44.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.365+0000 7fd4b0ff9700 1 -- 172.21.15.60:0/4055440830 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fd4a0018030 con 0x7fd4b40ab1e0 2023-10-06T04:31:44.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.365+0000 7fd4b8b9b700 1 --2- 172.21.15.60:0/4055440830 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd498066f30 0x7fd4980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:44.369 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.366+0000 7fd4b8b9b700 1 --2- 172.21.15.60:0/4055440830 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd498066f30 0x7fd4980693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8001ed0 tx=0x7fd4a8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:44.370 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.369+0000 7fd4b0ff9700 1 -- 172.21.15.60:0/4055440830 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4b40b1500 con 0x7fd4b40ab1e0 2023-10-06T04:31:44.574 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.573+0000 7fd4b9b9d700 1 -- 172.21.15.60:0/4055440830 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4b40b14c0 con 0x7fd4b40ab1e0 2023-10-06T04:31:44.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.574+0000 7fd4b0ff9700 1 -- 172.21.15.60:0/4055440830 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+17167 (secure 0 0 0) 0x7fd4a00522b0 con 0x7fd4b40ab1e0 2023-10-06T04:31:44.575 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:31:44.576 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":42,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:29:55.380007+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:29:18.102794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:29:19.405806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":5}]},{"pgid":"7.30","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:31:44.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.576+0000 7fd4b9b9d700 1 -- 172.21.15.60:0/4055440830 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd498066f30 msgr2=0x7fd4980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:44.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.576+0000 7fd4b9b9d700 1 --2- 172.21.15.60:0/4055440830 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd498066f30 0x7fd4980693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8001ed0 tx=0x7fd4a8009040 comp rx=0 tx=0).stop 2023-10-06T04:31:44.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.576+0000 7fd4b9b9d700 1 -- 172.21.15.60:0/4055440830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4b40ab1e0 msgr2=0x7fd4b40abdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:44.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.576+0000 7fd4b9b9d700 1 --2- 172.21.15.60:0/4055440830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4b40ab1e0 0x7fd4b40abdc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0006ac0 tx=0x7fd4a00091a0 comp rx=0 tx=0).stop 2023-10-06T04:31:44.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.576+0000 7fd4b9b9d700 1 -- 172.21.15.60:0/4055440830 shutdown_connections 2023-10-06T04:31:44.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.576+0000 7fd4b9b9d700 1 --2- 172.21.15.60:0/4055440830 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd498066f30 0x7fd4980693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:44.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.576+0000 7fd4b9b9d700 1 --2- 172.21.15.60:0/4055440830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd4b41693b0 0x7fd4b4069570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:44.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.576+0000 7fd4b9b9d700 1 --2- 172.21.15.60:0/4055440830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4a4004d50 0x7fd4b4144260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:44.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.576+0000 7fd4b9b9d700 1 --2- 172.21.15.60:0/4055440830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4b40ab1e0 0x7fd4b40abdc0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:44.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.576+0000 7fd4b9b9d700 1 -- 172.21.15.60:0/4055440830 >> 172.21.15.60:0/4055440830 conn(0x7fd4b40c91a0 msgr2=0x7fd4b4156f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:44.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.577+0000 7fd4b9b9d700 1 -- 172.21.15.60:0/4055440830 shutdown_connections 2023-10-06T04:31:44.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.577+0000 7fd4b9b9d700 1 -- 172.21.15.60:0/4055440830 wait complete. 2023-10-06T04:31:44.596 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T04:27:58.899938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T04:27:59.373527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T04:29:18.102794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T04:29:19.405806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T04:31:44.597 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T04:31:44.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.785+0000 7f11abfff700 1 Processor -- start 2023-10-06T04:31:44.787 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.785+0000 7f11abfff700 1 -- start start 2023-10-06T04:31:44.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.787+0000 7f11abfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11ac159970 0x7f11ac0cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:44.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.787+0000 7f11abfff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11ac0cf050 con 0x7f11ac0cf4e0 2023-10-06T04:31:44.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.787+0000 7f11abfff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11ac0ce440 con 0x7f11ac15d590 2023-10-06T04:31:44.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.787+0000 7f11abfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac0ce720 con 0x7f11ac159970 2023-10-06T04:31:44.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.787+0000 7f11aa7fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f11ac0cf4e0 0x7f11ac159260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46582/0 (socket says 172.21.15.60:46582) 2023-10-06T04:31:44.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.787+0000 7f11aa7fc700 1 -- 172.21.15.60:0/152638583 learned_addr learned my addr 172.21.15.60:0/152638583 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:31:44.789 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.787+0000 7f11ab7fe700 1 --2- 172.21.15.60:0/152638583 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11ac159970 0x7f11ac0cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:44.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.787+0000 7f11a9ffb700 1 -- 172.21.15.60:0/152638583 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496304742 0 0) 0x7f11ac0cf050 con 0x7f11ac0cf4e0 2023-10-06T04:31:44.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.787+0000 7f11a9ffb700 1 -- 172.21.15.60:0/152638583 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1194003570 con 0x7f11ac0cf4e0 2023-10-06T04:31:44.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.787+0000 7f11a9ffb700 1 -- 172.21.15.60:0/152638583 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643030358 0 0) 0x7f11ac0ce440 con 0x7f11ac15d590 2023-10-06T04:31:44.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.787+0000 7f11a9ffb700 1 -- 172.21.15.60:0/152638583 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11ac0cf050 con 0x7f11ac15d590 2023-10-06T04:31:44.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.788+0000 7f11ab7fe700 1 -- 172.21.15.60:0/152638583 >> v1:172.21.15.135:6789/0 conn(0x7f11ac15d590 legacy=0x7f11ac0cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:44.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.788+0000 7f11ab7fe700 1 -- 172.21.15.60:0/152638583 >> v1:172.21.15.60:6789/0 conn(0x7f11ac0cf4e0 legacy=0x7f11ac159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:44.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.788+0000 7f11ab7fe700 1 -- 172.21.15.60:0/152638583 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac0cea00 con 0x7f11ac159970 2023-10-06T04:31:44.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.788+0000 7f11ab7fe700 1 --2- 172.21.15.60:0/152638583 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11ac159970 0x7f11ac0cde60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f11a4009e90 tx=0x7f11a4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98f279e2ca78cd0c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:44.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.788+0000 7f11a9ffb700 1 -- 172.21.15.60:0/152638583 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a400e070 con 0x7f11ac159970 2023-10-06T04:31:44.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.788+0000 7f11a9ffb700 1 -- 172.21.15.60:0/152638583 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a400bb80 con 0x7f11ac159970 2023-10-06T04:31:44.790 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.788+0000 7f11a9ffb700 1 -- 172.21.15.60:0/152638583 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4012430 con 0x7f11ac159970 2023-10-06T04:31:44.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.789+0000 7f11abfff700 1 -- 172.21.15.60:0/152638583 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11ac159970 msgr2=0x7f11ac0cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:44.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.789+0000 7f11abfff700 1 --2- 172.21.15.60:0/152638583 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11ac159970 0x7f11ac0cde60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f11a4009e90 tx=0x7f11a4009780 comp rx=0 tx=0).stop 2023-10-06T04:31:44.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.789+0000 7f11abfff700 1 -- 172.21.15.60:0/152638583 shutdown_connections 2023-10-06T04:31:44.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.789+0000 7f11abfff700 1 --2- 172.21.15.60:0/152638583 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11ac159970 0x7f11ac0cde60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:44.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.789+0000 7f11abfff700 1 -- 172.21.15.60:0/152638583 >> 172.21.15.60:0/152638583 conn(0x7f11ac0994e0 msgr2=0x7f11ac06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:44.792 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.789+0000 7f11abfff700 1 -- 172.21.15.60:0/152638583 shutdown_connections 2023-10-06T04:31:44.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.789+0000 7f11abfff700 1 -- 172.21.15.60:0/152638583 wait complete. 2023-10-06T04:31:44.793 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.790+0000 7f11abfff700 1 Processor -- start 2023-10-06T04:31:44.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.791+0000 7f11abfff700 1 -- start start 2023-10-06T04:31:44.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.791+0000 7f11abfff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11ac0cf4e0 0x7f11ac0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:44.796 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.791+0000 7f11abfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ac159970 0x7f11ac148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:44.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.791+0000 7f11abfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11ac15d590 0x7f11ac15c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:44.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.791+0000 7f11abfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac15b330 con 0x7f11ac15d590 2023-10-06T04:31:44.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.791+0000 7f11abfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac1541f0 con 0x7f11ac159970 2023-10-06T04:31:44.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.791+0000 7f11abfff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac15bf60 con 0x7f11ac0cf4e0 2023-10-06T04:31:44.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.792+0000 7f11ab7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11ac15d590 0x7f11ac15c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:44.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.792+0000 7f11ab7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11ac15d590 0x7f11ac15c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42512/0 (socket says 172.21.15.60:42512) 2023-10-06T04:31:44.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.792+0000 7f11ab7fe700 1 -- 172.21.15.60:0/2000387461 learned_addr learned my addr 172.21.15.60:0/2000387461 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:44.797 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.792+0000 7f11aa7fc700 1 --2- 172.21.15.60:0/2000387461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ac159970 0x7f11ac148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:44.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.792+0000 7f11aaffd700 1 --2- 172.21.15.60:0/2000387461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11ac0cf4e0 0x7f11ac0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:44.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.792+0000 7f11ab7fe700 1 -- 172.21.15.60:0/2000387461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11ac0cf4e0 msgr2=0x7f11ac0c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:44.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.792+0000 7f11ab7fe700 1 --2- 172.21.15.60:0/2000387461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11ac0cf4e0 0x7f11ac0c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:44.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.792+0000 7f11ab7fe700 1 -- 172.21.15.60:0/2000387461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ac159970 msgr2=0x7f11ac148c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:44.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.792+0000 7f11ab7fe700 1 --2- 172.21.15.60:0/2000387461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ac159970 0x7f11ac148c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:44.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.792+0000 7f11ab7fe700 1 -- 172.21.15.60:0/2000387461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a4009a20 con 0x7f11ac15d590 2023-10-06T04:31:44.798 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.792+0000 7f11aa7fc700 1 --2- 172.21.15.60:0/2000387461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ac159970 0x7f11ac148c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:31:44.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.792+0000 7f11aaffd700 1 --2- 172.21.15.60:0/2000387461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11ac0cf4e0 0x7f11ac0c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:31:44.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.792+0000 7f11ab7fe700 1 --2- 172.21.15.60:0/2000387461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11ac15d590 0x7f11ac15c3f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f11ac088ed0 tx=0x7f11a4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:44.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.793+0000 7f1192ffd700 1 -- 172.21.15.60:0/2000387461 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4012e50 con 0x7f11ac15d590 2023-10-06T04:31:44.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.793+0000 7f1192ffd700 1 -- 172.21.15.60:0/2000387461 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a401b630 con 0x7f11ac15d590 2023-10-06T04:31:44.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.793+0000 7f1192ffd700 1 -- 172.21.15.60:0/2000387461 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a401b9f0 con 0x7f11ac15d590 2023-10-06T04:31:44.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.793+0000 7f11abfff700 1 -- 172.21.15.60:0/2000387461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11ac0ca1a0 con 0x7f11ac15d590 2023-10-06T04:31:44.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.793+0000 7f11abfff700 1 -- 172.21.15.60:0/2000387461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ac15b6c0 con 0x7f11ac15d590 2023-10-06T04:31:44.799 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.794+0000 7f11abfff700 1 -- 172.21.15.60:0/2000387461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11ac15c0f0 con 0x7f11ac15d590 2023-10-06T04:31:44.800 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.795+0000 7f1192ffd700 1 -- 172.21.15.60:0/2000387461 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f11a401c400 con 0x7f11ac15d590 2023-10-06T04:31:44.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.796+0000 7f1192ffd700 1 --2- 172.21.15.60:0/2000387461 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1198066f30 0x7f11980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:44.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.796+0000 7f1192ffd700 1 -- 172.21.15.60:0/2000387461 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f11a4086700 con 0x7f11ac15d590 2023-10-06T04:31:44.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.796+0000 7f11aaffd700 1 --2- 172.21.15.60:0/2000387461 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1198066f30 0x7f11980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:44.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.797+0000 7f11aaffd700 1 --2- 172.21.15.60:0/2000387461 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1198066f30 0x7f11980693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f119c002820 tx=0x7f119c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:44.801 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:44.800+0000 7f1192ffd700 1 -- 172.21.15.60:0/2000387461 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11a4057080 con 0x7f11ac15d590 2023-10-06T04:31:45.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.005+0000 7f11abfff700 1 -- 172.21.15.60:0/2000387461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f11ac05f230 con 0x7f11ac15d590 2023-10-06T04:31:45.006 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.005+0000 7f1192ffd700 1 -- 172.21.15.60:0/2000387461 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v42) v1 ==== 92+0+10 (secure 0 0 0) 0x7f11a4056c10 con 0x7f11ac15d590 2023-10-06T04:31:45.007 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2023-10-06T04:31:45.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.007+0000 7f11abfff700 1 -- 172.21.15.60:0/2000387461 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1198066f30 msgr2=0x7f11980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:45.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.007+0000 7f11abfff700 1 --2- 172.21.15.60:0/2000387461 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1198066f30 0x7f11980693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f119c002820 tx=0x7f119c009040 comp rx=0 tx=0).stop 2023-10-06T04:31:45.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.007+0000 7f11abfff700 1 -- 172.21.15.60:0/2000387461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11ac15d590 msgr2=0x7f11ac15c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:45.009 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.007+0000 7f11abfff700 1 --2- 172.21.15.60:0/2000387461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11ac15d590 0x7f11ac15c3f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f11ac088ed0 tx=0x7f11a4019000 comp rx=0 tx=0).stop 2023-10-06T04:31:45.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.007+0000 7f11abfff700 1 -- 172.21.15.60:0/2000387461 shutdown_connections 2023-10-06T04:31:45.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.007+0000 7f11abfff700 1 --2- 172.21.15.60:0/2000387461 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1198066f30 0x7f11980693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.007+0000 7f11abfff700 1 --2- 172.21.15.60:0/2000387461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11ac15d590 0x7f11ac15c3f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.007+0000 7f11abfff700 1 --2- 172.21.15.60:0/2000387461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f11ac0cf4e0 0x7f11ac0c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.007+0000 7f11abfff700 1 --2- 172.21.15.60:0/2000387461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11ac159970 0x7f11ac148c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.007+0000 7f11abfff700 1 -- 172.21.15.60:0/2000387461 >> 172.21.15.60:0/2000387461 conn(0x7f11ac0994e0 msgr2=0x7f11ac0cb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:45.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.007+0000 7f11abfff700 1 -- 172.21.15.60:0/2000387461 shutdown_connections 2023-10-06T04:31:45.010 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.007+0000 7f11abfff700 1 -- 172.21.15.60:0/2000387461 wait complete. 2023-10-06T04:31:45.027 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T04:31:45.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.215+0000 7fbf4339d700 1 Processor -- start 2023-10-06T04:31:45.217 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.215+0000 7fbf4339d700 1 -- start start 2023-10-06T04:31:45.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.216+0000 7fbf4339d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf3c15d590 0x7fbf3c0cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:45.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.216+0000 7fbf4339d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf3c0cf4e0 0x7fbf3c0cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:45.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.216+0000 7fbf4339d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbf3c15d960 0x7fbf3c159260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:45.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.216+0000 7fbf4339d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf3c0cf050 con 0x7fbf3c0cf4e0 2023-10-06T04:31:45.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.216+0000 7fbf4339d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf3c0cc6f0 con 0x7fbf3c15d960 2023-10-06T04:31:45.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.216+0000 7fbf4339d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3c0ce440 con 0x7fbf3c15d590 2023-10-06T04:31:45.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.217+0000 7fbf41b9a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf3c0cf4e0 0x7fbf3c0cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:45.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.217+0000 7fbf41b9a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf3c0cf4e0 0x7fbf3c0cc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42516/0 (socket says 172.21.15.60:42516) 2023-10-06T04:31:45.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.217+0000 7fbf41b9a700 1 -- 172.21.15.60:0/2396037380 learned_addr learned my addr 172.21.15.60:0/2396037380 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:45.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.217+0000 7fbf4239b700 1 --2- 172.21.15.60:0/2396037380 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf3c15d590 0x7fbf3c0cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:45.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.217+0000 7fbf42b9c700 1 --2- 172.21.15.60:0/2396037380 >> v2:172.21.15.135:3300/0 conn(0x7fbf3c15d960 0x7fbf3c159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:45.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.217+0000 7fbf41b9a700 1 -- 172.21.15.60:0/2396037380 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf3c15d590 msgr2=0x7fbf3c0cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:45.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.217+0000 7fbf41b9a700 1 --2- 172.21.15.60:0/2396037380 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf3c15d590 0x7fbf3c0cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.217+0000 7fbf41b9a700 1 -- 172.21.15.60:0/2396037380 >> v2:172.21.15.135:3300/0 conn(0x7fbf3c15d960 msgr2=0x7fbf3c159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:45.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.217+0000 7fbf41b9a700 1 --2- 172.21.15.60:0/2396037380 >> v2:172.21.15.135:3300/0 conn(0x7fbf3c15d960 0x7fbf3c159260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.217+0000 7fbf41b9a700 1 -- 172.21.15.60:0/2396037380 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3c0ce720 con 0x7fbf3c0cf4e0 2023-10-06T04:31:45.220 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.217+0000 7fbf41b9a700 1 --2- 172.21.15.60:0/2396037380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c0cf4e0 0x7fbf3c0cc1b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0cefc0 tx=0x7fbf2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75216c62f621be02 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:45.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.218+0000 7fbf41399700 1 -- 172.21.15.60:0/2396037380 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c00b640 con 0x7fbf3c0cf4e0 2023-10-06T04:31:45.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.218+0000 7fbf41399700 1 -- 172.21.15.60:0/2396037380 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c00b7a0 con 0x7fbf3c0cf4e0 2023-10-06T04:31:45.221 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.218+0000 7fbf41399700 1 -- 172.21.15.60:0/2396037380 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c00bb60 con 0x7fbf3c0cf4e0 2023-10-06T04:31:45.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.218+0000 7fbf4339d700 1 -- 172.21.15.60:0/2396037380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c0cf4e0 msgr2=0x7fbf3c0cc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:45.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.218+0000 7fbf4339d700 1 --2- 172.21.15.60:0/2396037380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c0cf4e0 0x7fbf3c0cc1b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0cefc0 tx=0x7fbf2c009250 comp rx=0 tx=0).stop 2023-10-06T04:31:45.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.218+0000 7fbf4339d700 1 -- 172.21.15.60:0/2396037380 shutdown_connections 2023-10-06T04:31:45.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.218+0000 7fbf4339d700 1 --2- 172.21.15.60:0/2396037380 >> v2:172.21.15.135:3300/0 conn(0x7fbf3c15d960 0x7fbf3c159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.218+0000 7fbf4339d700 1 --2- 172.21.15.60:0/2396037380 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf3c15d590 0x7fbf3c0cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.224 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.218+0000 7fbf4339d700 1 --2- 172.21.15.60:0/2396037380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c0cf4e0 0x7fbf3c0cc1b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.218+0000 7fbf4339d700 1 -- 172.21.15.60:0/2396037380 >> 172.21.15.60:0/2396037380 conn(0x7fbf3c0994e0 msgr2=0x7fbf3c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:45.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.218+0000 7fbf4339d700 1 -- 172.21.15.60:0/2396037380 shutdown_connections 2023-10-06T04:31:45.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.219+0000 7fbf4339d700 1 -- 172.21.15.60:0/2396037380 wait complete. 2023-10-06T04:31:45.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.220+0000 7fbf4339d700 1 Processor -- start 2023-10-06T04:31:45.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.220+0000 7fbf4339d700 1 -- start start 2023-10-06T04:31:45.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.221+0000 7fbf4339d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c0cf4e0 0x7fbf3c15cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:45.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.221+0000 7fbf4339d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf3c15d590 0x7fbf3c0b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:45.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.221+0000 7fbf4339d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf3c15d960 0x7fbf3c0b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:45.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.221+0000 7fbf4339d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3c0b3ed0 con 0x7fbf3c0cf4e0 2023-10-06T04:31:45.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.221+0000 7fbf4339d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3c0b41b0 con 0x7fbf3c15d590 2023-10-06T04:31:45.225 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.221+0000 7fbf4339d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3c0b4490 con 0x7fbf3c15d960 2023-10-06T04:31:45.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.221+0000 7fbf4239b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c0cf4e0 0x7fbf3c15cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:45.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.221+0000 7fbf4239b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c0cf4e0 0x7fbf3c15cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42520/0 (socket says 172.21.15.60:42520) 2023-10-06T04:31:45.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.221+0000 7fbf4239b700 1 -- 172.21.15.60:0/1089239565 learned_addr learned my addr 172.21.15.60:0/1089239565 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:45.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.221+0000 7fbf41b9a700 1 --2- 172.21.15.60:0/1089239565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf3c15d590 0x7fbf3c0b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:45.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.221+0000 7fbf42b9c700 1 --2- 172.21.15.60:0/1089239565 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf3c15d960 0x7fbf3c0b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:45.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.222+0000 7fbf4239b700 1 -- 172.21.15.60:0/1089239565 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf3c15d960 msgr2=0x7fbf3c0b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:45.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.222+0000 7fbf4239b700 1 --2- 172.21.15.60:0/1089239565 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf3c15d960 0x7fbf3c0b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.226 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.222+0000 7fbf4239b700 1 -- 172.21.15.60:0/1089239565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf3c15d590 msgr2=0x7fbf3c0b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:45.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.222+0000 7fbf4239b700 1 --2- 172.21.15.60:0/1089239565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf3c15d590 0x7fbf3c0b59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.222+0000 7fbf4239b700 1 -- 172.21.15.60:0/1089239565 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c0094f0 con 0x7fbf3c0cf4e0 2023-10-06T04:31:45.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.222+0000 7fbf41b9a700 1 --2- 172.21.15.60:0/1089239565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf3c15d590 0x7fbf3c0b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:31:45.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.222+0000 7fbf42b9c700 1 --2- 172.21.15.60:0/1089239565 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf3c15d960 0x7fbf3c0b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:31:45.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.222+0000 7fbf4239b700 1 --2- 172.21.15.60:0/1089239565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c0cf4e0 0x7fbf3c15cca0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800ec80 tx=0x7fbf380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:45.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.222+0000 7fbf327fc700 1 -- 172.21.15.60:0/1089239565 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3800c9d0 con 0x7fbf3c0cf4e0 2023-10-06T04:31:45.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.222+0000 7fbf327fc700 1 -- 172.21.15.60:0/1089239565 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3800cb50 con 0x7fbf3c0cf4e0 2023-10-06T04:31:45.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.222+0000 7fbf327fc700 1 -- 172.21.15.60:0/1089239565 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38013470 con 0x7fbf3c0cf4e0 2023-10-06T04:31:45.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.222+0000 7fbf4339d700 1 -- 172.21.15.60:0/1089239565 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf3c0b4770 con 0x7fbf3c0cf4e0 2023-10-06T04:31:45.227 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.222+0000 7fbf4339d700 1 -- 172.21.15.60:0/1089239565 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf3c0b5f20 con 0x7fbf3c0cf4e0 2023-10-06T04:31:45.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.223+0000 7fbf4339d700 1 -- 172.21.15.60:0/1089239565 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf3c0b4c90 con 0x7fbf3c0cf4e0 2023-10-06T04:31:45.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.224+0000 7fbf327fc700 1 -- 172.21.15.60:0/1089239565 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf38013860 con 0x7fbf3c0cf4e0 2023-10-06T04:31:45.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.225+0000 7fbf327fc700 1 --2- 172.21.15.60:0/1089239565 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf20066f30 0x7fbf200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:45.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.225+0000 7fbf327fc700 1 -- 172.21.15.60:0/1089239565 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fbf38084c80 con 0x7fbf3c0cf4e0 2023-10-06T04:31:45.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.225+0000 7fbf41b9a700 1 --2- 172.21.15.60:0/1089239565 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf20066f30 0x7fbf200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:45.229 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.226+0000 7fbf41b9a700 1 --2- 172.21.15.60:0/1089239565 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf20066f30 0x7fbf200693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0cefc0 tx=0x7fbf2c017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:45.230 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.229+0000 7fbf327fc700 1 -- 172.21.15.60:0/1089239565 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf3c0b4c90 con 0x7fbf3c0cf4e0 2023-10-06T04:31:45.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.432+0000 7fbf4339d700 1 -- 172.21.15.60:0/1089239565 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbf3c0883a0 con 0x7fbf3c0cf4e0 2023-10-06T04:31:45.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.433+0000 7fbf327fc700 1 -- 172.21.15.60:0/1089239565 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbf38051b70 con 0x7fbf3c0cf4e0 2023-10-06T04:31:45.434 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2023-10-06T04:31:45.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.435+0000 7fbf4339d700 1 -- 172.21.15.60:0/1089239565 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf20066f30 msgr2=0x7fbf200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:45.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.435+0000 7fbf4339d700 1 --2- 172.21.15.60:0/1089239565 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf20066f30 0x7fbf200693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0cefc0 tx=0x7fbf2c017000 comp rx=0 tx=0).stop 2023-10-06T04:31:45.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.435+0000 7fbf4339d700 1 -- 172.21.15.60:0/1089239565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c0cf4e0 msgr2=0x7fbf3c15cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:45.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.435+0000 7fbf4339d700 1 --2- 172.21.15.60:0/1089239565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c0cf4e0 0x7fbf3c15cca0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800ec80 tx=0x7fbf380091a0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.435+0000 7fbf4339d700 1 -- 172.21.15.60:0/1089239565 shutdown_connections 2023-10-06T04:31:45.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.435+0000 7fbf4339d700 1 --2- 172.21.15.60:0/1089239565 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf20066f30 0x7fbf200693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.435+0000 7fbf4339d700 1 --2- 172.21.15.60:0/1089239565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c0cf4e0 0x7fbf3c15cca0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.435+0000 7fbf4339d700 1 --2- 172.21.15.60:0/1089239565 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf3c15d960 0x7fbf3c0b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.435+0000 7fbf4339d700 1 --2- 172.21.15.60:0/1089239565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf3c15d590 0x7fbf3c0b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.435+0000 7fbf4339d700 1 -- 172.21.15.60:0/1089239565 >> 172.21.15.60:0/1089239565 conn(0x7fbf3c0994e0 msgr2=0x7fbf3c0ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:45.437 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.435+0000 7fbf4339d700 1 -- 172.21.15.60:0/1089239565 shutdown_connections 2023-10-06T04:31:45.438 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.435+0000 7fbf4339d700 1 -- 172.21.15.60:0/1089239565 wait complete. 2023-10-06T04:31:45.454 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T04:31:45.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.643+0000 7fba5119d700 1 Processor -- start 2023-10-06T04:31:45.645 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.643+0000 7fba5119d700 1 -- start start 2023-10-06T04:31:45.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.645+0000 7fba5119d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba4c068cd0 0x7fba4c0a9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:45.648 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.645+0000 7fba5119d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4c0aa6b0 con 0x7fba4c1590c0 2023-10-06T04:31:45.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.645+0000 7fba5119d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4c0aa990 con 0x7fba4c0af4c0 2023-10-06T04:31:45.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.645+0000 7fba5119d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c0aac70 con 0x7fba4c068cd0 2023-10-06T04:31:45.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.645+0000 7fba4bfff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fba4c1590c0 0x7fba4c0685c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46590/0 (socket says 172.21.15.60:46590) 2023-10-06T04:31:45.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.645+0000 7fba4bfff700 1 -- 172.21.15.60:0/2374745454 learned_addr learned my addr 172.21.15.60:0/2374745454 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:31:45.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.645+0000 7fba4b7fe700 1 --2- 172.21.15.60:0/2374745454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba4c068cd0 0x7fba4c0a9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:45.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.645+0000 7fba4affd700 1 -- 172.21.15.60:0/2374745454 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960418266 0 0) 0x7fba4c0aa6b0 con 0x7fba4c1590c0 2023-10-06T04:31:45.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.645+0000 7fba4affd700 1 -- 172.21.15.60:0/2374745454 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba34003570 con 0x7fba4c1590c0 2023-10-06T04:31:45.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.646+0000 7fba4affd700 1 -- 172.21.15.60:0/2374745454 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986081302 0 0) 0x7fba4c0aa990 con 0x7fba4c0af4c0 2023-10-06T04:31:45.649 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.646+0000 7fba4affd700 1 -- 172.21.15.60:0/2374745454 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba4c0aa6b0 con 0x7fba4c0af4c0 2023-10-06T04:31:45.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.646+0000 7fba4affd700 1 -- 172.21.15.60:0/2374745454 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3562120552 0 0) 0x7fba34003570 con 0x7fba4c1590c0 2023-10-06T04:31:45.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.646+0000 7fba4affd700 1 -- 172.21.15.60:0/2374745454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba4c068cd0 msgr2=0x7fba4c0a9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:45.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.646+0000 7fba4affd700 1 --2- 172.21.15.60:0/2374745454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba4c068cd0 0x7fba4c0a9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.646+0000 7fba4affd700 1 -- 172.21.15.60:0/2374745454 >> v1:172.21.15.135:6789/0 conn(0x7fba4c0af4c0 legacy=0x7fba4c0a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:45.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.646+0000 7fba4affd700 1 -- 172.21.15.60:0/2374745454 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4c0aaf50 con 0x7fba4c1590c0 2023-10-06T04:31:45.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.646+0000 7fba4affd700 1 -- 172.21.15.60:0/2374745454 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7fba3c0015f0 con 0x7fba4c1590c0 2023-10-06T04:31:45.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.646+0000 7fba4affd700 1 -- 172.21.15.60:0/2374745454 >> v1:172.21.15.60:6789/0 conn(0x7fba4c1590c0 legacy=0x7fba4c0685c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:45.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.646+0000 7fba4affd700 1 --2- 172.21.15.60:0/2374745454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba4c068cd0 0x7fba34003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:45.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.646+0000 7fba4affd700 1 --2- 172.21.15.60:0/2374745454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba340041d0 0x7fba34004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:45.650 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.646+0000 7fba4affd700 1 --2- 172.21.15.60:0/2374745454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba34004d50 0x7fba340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:45.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.646+0000 7fba4affd700 1 -- 172.21.15.60:0/2374745454 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c0aac70 con 0x7fba34004d50 2023-10-06T04:31:45.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.646+0000 7fba4affd700 1 -- 172.21.15.60:0/2374745454 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3400bbf0 con 0x7fba340041d0 2023-10-06T04:31:45.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.646+0000 7fba4affd700 1 -- 172.21.15.60:0/2374745454 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3400bdb0 con 0x7fba4c068cd0 2023-10-06T04:31:45.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.646+0000 7fba5099c700 1 --2- 172.21.15.60:0/2374745454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba34004d50 0x7fba340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:45.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.646+0000 7fba4b7fe700 1 --2- 172.21.15.60:0/2374745454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba340041d0 0x7fba34004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:45.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.646+0000 7fba4bfff700 1 --2- 172.21.15.60:0/2374745454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba4c068cd0 0x7fba34003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:45.651 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.647+0000 7fba5099c700 1 -- 172.21.15.60:0/2374745454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba4c068cd0 msgr2=0x7fba34003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:45.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.647+0000 7fba5099c700 1 --2- 172.21.15.60:0/2374745454 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba4c068cd0 0x7fba34003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.647+0000 7fba5099c700 1 -- 172.21.15.60:0/2374745454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba340041d0 msgr2=0x7fba34004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:45.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.647+0000 7fba5099c700 1 --2- 172.21.15.60:0/2374745454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba340041d0 0x7fba34004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.647+0000 7fba5099c700 1 -- 172.21.15.60:0/2374745454 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba34003570 con 0x7fba34004d50 2023-10-06T04:31:45.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.647+0000 7fba5099c700 1 --2- 172.21.15.60:0/2374745454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba34004d50 0x7fba340051c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fba44002160 tx=0x7fba440017e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19566e0c0d4c4f1c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:45.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.647+0000 7fba4affd700 1 -- 172.21.15.60:0/2374745454 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba44001af0 con 0x7fba34004d50 2023-10-06T04:31:45.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.647+0000 7fba4affd700 1 -- 172.21.15.60:0/2374745454 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4400c980 con 0x7fba34004d50 2023-10-06T04:31:45.652 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.647+0000 7fba4affd700 1 -- 172.21.15.60:0/2374745454 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4400cd20 con 0x7fba34004d50 2023-10-06T04:31:45.654 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.648+0000 7fba5119d700 1 -- 172.21.15.60:0/2374745454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba34004d50 msgr2=0x7fba340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:45.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.648+0000 7fba5119d700 1 --2- 172.21.15.60:0/2374745454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba34004d50 0x7fba340051c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fba44002160 tx=0x7fba440017e0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.648+0000 7fba5099c700 1 -- 172.21.15.60:0/2374745454 reap_dead start 2023-10-06T04:31:45.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.648+0000 7fba5119d700 1 -- 172.21.15.60:0/2374745454 shutdown_connections 2023-10-06T04:31:45.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.648+0000 7fba5119d700 1 -- 172.21.15.60:0/2374745454 >> 172.21.15.60:0/2374745454 conn(0x7fba4c06da10 msgr2=0x7fba4c06de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:45.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.648+0000 7fba5119d700 1 -- 172.21.15.60:0/2374745454 shutdown_connections 2023-10-06T04:31:45.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.648+0000 7fba5119d700 1 -- 172.21.15.60:0/2374745454 wait complete. 2023-10-06T04:31:45.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.649+0000 7fba5119d700 1 Processor -- start 2023-10-06T04:31:45.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.649+0000 7fba5119d700 1 -- start start 2023-10-06T04:31:45.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.650+0000 7fba5119d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba34004d50 0x7fba4c14d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:45.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.650+0000 7fba5119d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba4c1534b0 0x7fba4c153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:45.655 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.650+0000 7fba5119d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba4c169c00 0x7fba4c16a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:45.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.650+0000 7fba5119d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c159490 con 0x7fba4c169c00 2023-10-06T04:31:45.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.650+0000 7fba5119d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c159a50 con 0x7fba34004d50 2023-10-06T04:31:45.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.650+0000 7fba5119d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c16a710 con 0x7fba4c1534b0 2023-10-06T04:31:45.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.650+0000 7fba5099c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba4c169c00 0x7fba4c16a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:45.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.651+0000 7fba5099c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba4c169c00 0x7fba4c16a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42538/0 (socket says 172.21.15.60:42538) 2023-10-06T04:31:45.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.651+0000 7fba5099c700 1 -- 172.21.15.60:0/3364635776 learned_addr learned my addr 172.21.15.60:0/3364635776 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:45.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.651+0000 7fba4b7fe700 1 --2- 172.21.15.60:0/3364635776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba4c1534b0 0x7fba4c153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:45.656 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.651+0000 7fba4bfff700 1 --2- 172.21.15.60:0/3364635776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba34004d50 0x7fba4c14d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:45.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.651+0000 7fba5099c700 1 -- 172.21.15.60:0/3364635776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba4c1534b0 msgr2=0x7fba4c153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:45.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.651+0000 7fba5099c700 1 --2- 172.21.15.60:0/3364635776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba4c1534b0 0x7fba4c153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.651+0000 7fba5099c700 1 -- 172.21.15.60:0/3364635776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba34004d50 msgr2=0x7fba4c14d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:45.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.651+0000 7fba5099c700 1 --2- 172.21.15.60:0/3364635776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba34004d50 0x7fba4c14d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.651+0000 7fba5099c700 1 -- 172.21.15.60:0/3364635776 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4c16a9f0 con 0x7fba4c169c00 2023-10-06T04:31:45.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.651+0000 7fba5099c700 1 --2- 172.21.15.60:0/3364635776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba4c169c00 0x7fba4c16a070 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fba340057f0 tx=0x7fba44016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:45.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.651+0000 7fba33fff700 1 -- 172.21.15.60:0/3364635776 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4400c6d0 con 0x7fba4c169c00 2023-10-06T04:31:45.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.651+0000 7fba33fff700 1 -- 172.21.15.60:0/3364635776 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba44012e50 con 0x7fba4c169c00 2023-10-06T04:31:45.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.651+0000 7fba33fff700 1 -- 172.21.15.60:0/3364635776 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba44006dd0 con 0x7fba4c169c00 2023-10-06T04:31:45.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.651+0000 7fba5119d700 1 -- 172.21.15.60:0/3364635776 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4c1596e0 con 0x7fba4c169c00 2023-10-06T04:31:45.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.652+0000 7fba5119d700 1 -- 172.21.15.60:0/3364635776 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4c15b750 con 0x7fba4c169c00 2023-10-06T04:31:45.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.653+0000 7fba5119d700 1 -- 172.21.15.60:0/3364635776 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4c05f230 con 0x7fba4c169c00 2023-10-06T04:31:45.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.653+0000 7fba33fff700 1 -- 172.21.15.60:0/3364635776 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba44003030 con 0x7fba4c169c00 2023-10-06T04:31:45.658 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.654+0000 7fba33fff700 1 --2- 172.21.15.60:0/3364635776 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fba38066f30 0x7fba380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:45.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.654+0000 7fba33fff700 1 -- 172.21.15.60:0/3364635776 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fba44086d00 con 0x7fba4c169c00 2023-10-06T04:31:45.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.655+0000 7fba4bfff700 1 --2- 172.21.15.60:0/3364635776 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fba38066f30 0x7fba380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:45.659 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.655+0000 7fba4bfff700 1 --2- 172.21.15.60:0/3364635776 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fba38066f30 0x7fba380693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fba3c001380 tx=0x7fba3c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:45.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.659+0000 7fba33fff700 1 -- 172.21.15.60:0/3364635776 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba44053bf0 con 0x7fba4c169c00 2023-10-06T04:31:45.862 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.861+0000 7fba5119d700 1 -- 172.21.15.60:0/3364635776 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fba4c0ab230 con 0x7fba4c169c00 2023-10-06T04:31:45.863 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.862+0000 7fba33fff700 1 -- 172.21.15.60:0/3364635776 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7fba44057210 con 0x7fba4c169c00 2023-10-06T04:31:45.863 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2023-10-06T04:31:45.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.864+0000 7fba5119d700 1 -- 172.21.15.60:0/3364635776 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fba38066f30 msgr2=0x7fba380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.864+0000 7fba5119d700 1 --2- 172.21.15.60:0/3364635776 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fba38066f30 0x7fba380693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fba3c001380 tx=0x7fba3c009040 comp rx=0 tx=0).stop 2023-10-06T04:31:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.864+0000 7fba5119d700 1 -- 172.21.15.60:0/3364635776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba4c169c00 msgr2=0x7fba4c16a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.864+0000 7fba5119d700 1 --2- 172.21.15.60:0/3364635776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba4c169c00 0x7fba4c16a070 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fba340057f0 tx=0x7fba44016000 comp rx=0 tx=0).stop 2023-10-06T04:31:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.864+0000 7fba5119d700 1 -- 172.21.15.60:0/3364635776 shutdown_connections 2023-10-06T04:31:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.864+0000 7fba5119d700 1 --2- 172.21.15.60:0/3364635776 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fba38066f30 0x7fba380693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.864+0000 7fba5119d700 1 --2- 172.21.15.60:0/3364635776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba4c169c00 0x7fba4c16a070 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.864+0000 7fba5119d700 1 --2- 172.21.15.60:0/3364635776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba34004d50 0x7fba4c14d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.864+0000 7fba5119d700 1 --2- 172.21.15.60:0/3364635776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba4c1534b0 0x7fba4c153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.864+0000 7fba5119d700 1 -- 172.21.15.60:0/3364635776 >> 172.21.15.60:0/3364635776 conn(0x7fba4c06da10 msgr2=0x7fba4c06b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.864+0000 7fba5119d700 1 -- 172.21.15.60:0/3364635776 shutdown_connections 2023-10-06T04:31:45.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:45.864+0000 7fba5119d700 1 -- 172.21.15.60:0/3364635776 wait complete. 2023-10-06T04:31:45.883 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T04:31:46.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.070+0000 7f67a3fff700 1 Processor -- start 2023-10-06T04:31:46.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.070+0000 7f67a3fff700 1 -- start start 2023-10-06T04:31:46.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.072+0000 7f67a3fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67a4156ea0 0x7f67a4155d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:46.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.072+0000 7f67a3fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f67a41562d0 0x7f67a406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:46.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.072+0000 7f67a3fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a40ad610 con 0x7f67a414c310 2023-10-06T04:31:46.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.072+0000 7f67a3fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67a41572f0 con 0x7f67a41562d0 2023-10-06T04:31:46.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.072+0000 7f67a3fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a4156880 con 0x7f67a4156ea0 2023-10-06T04:31:46.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.072+0000 7f67a37fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f67a41562d0 0x7f67a406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:46.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.072+0000 7f67a37fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f67a41562d0 0x7f67a406e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42548/0 (socket says 172.21.15.60:42548) 2023-10-06T04:31:46.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.072+0000 7f67a37fe700 1 -- 172.21.15.60:0/1630378020 learned_addr learned my addr 172.21.15.60:0/1630378020 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:46.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.072+0000 7f67a37fe700 1 -- 172.21.15.60:0/1630378020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67a4156ea0 msgr2=0x7f67a4155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:46.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.072+0000 7f67a37fe700 1 --2- 172.21.15.60:0/1630378020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67a4156ea0 0x7f67a4155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.072+0000 7f67a37fe700 1 -- 172.21.15.60:0/1630378020 >> v1:172.21.15.60:6789/0 conn(0x7f67a414c310 legacy=0x7f67a414c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:46.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.072+0000 7f67a37fe700 1 -- 172.21.15.60:0/1630378020 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a4156b60 con 0x7f67a41562d0 2023-10-06T04:31:46.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.072+0000 7f67a1ffb700 1 -- 172.21.15.60:0/1630378020 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596261399 0 0) 0x7f67a40ad610 con 0x7f67a414c310 2023-10-06T04:31:46.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.073+0000 7f67a37fe700 1 --2- 172.21.15.60:0/1630378020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67a41562d0 0x7f67a406e9f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f679c009f20 tx=0x7f679c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccdf85d39a1b4c46 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:46.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.073+0000 7f67a1ffb700 1 -- 172.21.15.60:0/1630378020 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c00e070 con 0x7f67a41562d0 2023-10-06T04:31:46.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.073+0000 7f67a1ffb700 1 -- 172.21.15.60:0/1630378020 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679c00ba80 con 0x7f67a41562d0 2023-10-06T04:31:46.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.073+0000 7f67a1ffb700 1 -- 172.21.15.60:0/1630378020 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c0092e0 con 0x7f67a41562d0 2023-10-06T04:31:46.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.073+0000 7f67a3fff700 1 -- 172.21.15.60:0/1630378020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67a41562d0 msgr2=0x7f67a406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:46.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.073+0000 7f67a3fff700 1 --2- 172.21.15.60:0/1630378020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67a41562d0 0x7f67a406e9f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f679c009f20 tx=0x7f679c009840 comp rx=0 tx=0).stop 2023-10-06T04:31:46.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.073+0000 7f67a3fff700 1 -- 172.21.15.60:0/1630378020 shutdown_connections 2023-10-06T04:31:46.078 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.073+0000 7f67a3fff700 1 --2- 172.21.15.60:0/1630378020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67a41562d0 0x7f67a406e9f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.073+0000 7f67a3fff700 1 --2- 172.21.15.60:0/1630378020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67a4156ea0 0x7f67a4155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.073+0000 7f67a3fff700 1 -- 172.21.15.60:0/1630378020 >> 172.21.15.60:0/1630378020 conn(0x7f67a40cbe90 msgr2=0x7f67a40cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:46.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.074+0000 7f67a3fff700 1 -- 172.21.15.60:0/1630378020 shutdown_connections 2023-10-06T04:31:46.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.074+0000 7f67a3fff700 1 -- 172.21.15.60:0/1630378020 wait complete. 2023-10-06T04:31:46.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.075+0000 7f67a3fff700 1 Processor -- start 2023-10-06T04:31:46.079 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.075+0000 7f67a3fff700 1 -- start start 2023-10-06T04:31:46.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.076+0000 7f67a3fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67a414c310 0x7f67a406e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:46.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.076+0000 7f67a3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67a41562d0 0x7f67a406e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:46.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.076+0000 7f67a3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67a4156ea0 0x7f67a41698f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:46.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.076+0000 7f67a3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a414d010 con 0x7f67a41562d0 2023-10-06T04:31:46.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.076+0000 7f67a3fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a416a670 con 0x7f67a4156ea0 2023-10-06T04:31:46.082 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.076+0000 7f67a3fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a414c6e0 con 0x7f67a414c310 2023-10-06T04:31:46.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.076+0000 7f67a27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67a41562d0 0x7f67a406e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:46.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.076+0000 7f67a27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67a41562d0 0x7f67a406e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42560/0 (socket says 172.21.15.60:42560) 2023-10-06T04:31:46.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.076+0000 7f67a27fc700 1 -- 172.21.15.60:0/1220132347 learned_addr learned my addr 172.21.15.60:0/1220132347 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:46.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.076+0000 7f67a37fe700 1 --2- 172.21.15.60:0/1220132347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67a4156ea0 0x7f67a41698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:46.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.076+0000 7f67a2ffd700 1 --2- 172.21.15.60:0/1220132347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67a414c310 0x7f67a406e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:46.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.077+0000 7f67a27fc700 1 -- 172.21.15.60:0/1220132347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67a414c310 msgr2=0x7f67a406e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:46.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.077+0000 7f67a27fc700 1 --2- 172.21.15.60:0/1220132347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67a414c310 0x7f67a406e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.083 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.077+0000 7f67a27fc700 1 -- 172.21.15.60:0/1220132347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67a4156ea0 msgr2=0x7f67a41698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:46.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.077+0000 7f67a27fc700 1 --2- 172.21.15.60:0/1220132347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67a4156ea0 0x7f67a41698f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.077+0000 7f67a27fc700 1 -- 172.21.15.60:0/1220132347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679c009ae0 con 0x7f67a41562d0 2023-10-06T04:31:46.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.077+0000 7f67a2ffd700 1 --2- 172.21.15.60:0/1220132347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67a414c310 0x7f67a406e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:31:46.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.077+0000 7f67a27fc700 1 --2- 172.21.15.60:0/1220132347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67a41562d0 0x7f67a406e660 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f679800b810 tx=0x7f6798009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:46.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.077+0000 7f678affd700 1 -- 172.21.15.60:0/1220132347 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679800f510 con 0x7f67a41562d0 2023-10-06T04:31:46.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.077+0000 7f678affd700 1 -- 172.21.15.60:0/1220132347 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679800f690 con 0x7f67a41562d0 2023-10-06T04:31:46.084 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.077+0000 7f678affd700 1 -- 172.21.15.60:0/1220132347 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679800fa50 con 0x7f67a41562d0 2023-10-06T04:31:46.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.077+0000 7f67a3fff700 1 -- 172.21.15.60:0/1220132347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a414c9c0 con 0x7f67a41562d0 2023-10-06T04:31:46.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.077+0000 7f67a3fff700 1 -- 172.21.15.60:0/1220132347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a414d4a0 con 0x7f67a41562d0 2023-10-06T04:31:46.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.078+0000 7f67a3fff700 1 -- 172.21.15.60:0/1220132347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a414d180 con 0x7f67a41562d0 2023-10-06T04:31:46.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.079+0000 7f678affd700 1 -- 172.21.15.60:0/1220132347 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f679801a400 con 0x7f67a41562d0 2023-10-06T04:31:46.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.080+0000 7f678affd700 1 --2- 172.21.15.60:0/1220132347 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6790066f30 0x7f67900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:46.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.080+0000 7f678affd700 1 -- 172.21.15.60:0/1220132347 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f6798084440 con 0x7f67a41562d0 2023-10-06T04:31:46.085 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.081+0000 7f67a2ffd700 1 --2- 172.21.15.60:0/1220132347 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6790066f30 0x7f67900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:46.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.081+0000 7f67a2ffd700 1 --2- 172.21.15.60:0/1220132347 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6790066f30 0x7f67900693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6794007fd0 tx=0x7f6794009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:46.086 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.084+0000 7f678affd700 1 -- 172.21.15.60:0/1220132347 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67980513b0 con 0x7f67a41562d0 2023-10-06T04:31:46.285 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.283+0000 7f67a3fff700 1 -- 172.21.15.60:0/1220132347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f67a405f230 con 0x7f67a41562d0 2023-10-06T04:31:46.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.284+0000 7f678affd700 1 -- 172.21.15.60:0/1220132347 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f67980549d0 con 0x7f67a41562d0 2023-10-06T04:31:46.286 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2023-10-06T04:31:46.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.286+0000 7f67a3fff700 1 -- 172.21.15.60:0/1220132347 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6790066f30 msgr2=0x7f67900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:46.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.286+0000 7f67a3fff700 1 --2- 172.21.15.60:0/1220132347 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6790066f30 0x7f67900693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6794007fd0 tx=0x7f6794009040 comp rx=0 tx=0).stop 2023-10-06T04:31:46.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.286+0000 7f67a3fff700 1 -- 172.21.15.60:0/1220132347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67a41562d0 msgr2=0x7f67a406e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:46.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.286+0000 7f67a3fff700 1 --2- 172.21.15.60:0/1220132347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67a41562d0 0x7f67a406e660 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f679800b810 tx=0x7f6798009250 comp rx=0 tx=0).stop 2023-10-06T04:31:46.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.286+0000 7f67a3fff700 1 -- 172.21.15.60:0/1220132347 shutdown_connections 2023-10-06T04:31:46.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.286+0000 7f67a3fff700 1 --2- 172.21.15.60:0/1220132347 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6790066f30 0x7f67900693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.286+0000 7f67a3fff700 1 --2- 172.21.15.60:0/1220132347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67a4156ea0 0x7f67a41698f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.286+0000 7f67a3fff700 1 --2- 172.21.15.60:0/1220132347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67a414c310 0x7f67a406e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.286+0000 7f67a3fff700 1 --2- 172.21.15.60:0/1220132347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67a41562d0 0x7f67a406e660 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.286+0000 7f67a3fff700 1 -- 172.21.15.60:0/1220132347 >> 172.21.15.60:0/1220132347 conn(0x7f67a40cbe90 msgr2=0x7f67a4157440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:46.288 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.286+0000 7f67a3fff700 1 -- 172.21.15.60:0/1220132347 shutdown_connections 2023-10-06T04:31:46.289 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.286+0000 7f67a3fff700 1 -- 172.21.15.60:0/1220132347 wait complete. 2023-10-06T04:31:46.306 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:31:46.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.494+0000 7fdb0139d700 1 Processor -- start 2023-10-06T04:31:46.496 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.494+0000 7fdb0139d700 1 -- start start 2023-10-06T04:31:46.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.496+0000 7fdb0139d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdafc158db0 0x7fdafc06d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:46.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.496+0000 7fdb0139d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdafc0c1590 0x7fdafc0c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:46.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.496+0000 7fdb0139d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdafc0c79c0 con 0x7fdafc159180 2023-10-06T04:31:46.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.496+0000 7fdb0139d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdafc0c1f50 con 0x7fdafc158db0 2023-10-06T04:31:46.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.496+0000 7fdb0139d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc06e910 con 0x7fdafc0c1590 2023-10-06T04:31:46.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.496+0000 7fdafbfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdafc158db0 0x7fdafc06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:46.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.496+0000 7fdafbfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdafc158db0 0x7fdafc06d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42562/0 (socket says 172.21.15.60:42562) 2023-10-06T04:31:46.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.496+0000 7fdafbfff700 1 -- 172.21.15.60:0/3439169468 learned_addr learned my addr 172.21.15.60:0/3439169468 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:46.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.496+0000 7fdb00b9c700 1 --2- 172.21.15.60:0/3439169468 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdafc0c1590 0x7fdafc0c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:46.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.496+0000 7fdafbfff700 1 -- 172.21.15.60:0/3439169468 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdafc0c1590 msgr2=0x7fdafc0c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:46.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.496+0000 7fdafbfff700 1 --2- 172.21.15.60:0/3439169468 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdafc0c1590 0x7fdafc0c1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.496+0000 7fdafbfff700 1 -- 172.21.15.60:0/3439169468 >> v1:172.21.15.135:6789/0 conn(0x7fdafc159180 legacy=0x7fdafc0c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:46.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.496+0000 7fdafbfff700 1 -- 172.21.15.60:0/3439169468 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc0caa90 con 0x7fdafc158db0 2023-10-06T04:31:46.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.497+0000 7fdafbfff700 1 --2- 172.21.15.60:0/3439169468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdafc158db0 0x7fdafc06d710 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdaec00bc80 tx=0x7fdaec00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1615c98588a34d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:46.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.497+0000 7fdafaffd700 1 -- 172.21.15.60:0/3439169468 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec00be90 con 0x7fdafc158db0 2023-10-06T04:31:46.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.497+0000 7fdafaffd700 1 -- 172.21.15.60:0/3439169468 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec00ddc0 con 0x7fdafc158db0 2023-10-06T04:31:46.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.497+0000 7fdafaffd700 1 -- 172.21.15.60:0/3439169468 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec0196b0 con 0x7fdafc158db0 2023-10-06T04:31:46.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.498+0000 7fdb0139d700 1 -- 172.21.15.60:0/3439169468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdafc158db0 msgr2=0x7fdafc06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:46.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.498+0000 7fdb0139d700 1 --2- 172.21.15.60:0/3439169468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdafc158db0 0x7fdafc06d710 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdaec00bc80 tx=0x7fdaec00b4f0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.498+0000 7fdb0139d700 1 -- 172.21.15.60:0/3439169468 shutdown_connections 2023-10-06T04:31:46.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.498+0000 7fdb0139d700 1 --2- 172.21.15.60:0/3439169468 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdafc0c1590 0x7fdafc0c1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.498+0000 7fdb0139d700 1 --2- 172.21.15.60:0/3439169468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdafc158db0 0x7fdafc06d710 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.498+0000 7fdb0139d700 1 -- 172.21.15.60:0/3439169468 >> 172.21.15.60:0/3439169468 conn(0x7fdafc0cbeb0 msgr2=0x7fdafc0cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:46.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.498+0000 7fdb0139d700 1 -- 172.21.15.60:0/3439169468 shutdown_connections 2023-10-06T04:31:46.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.498+0000 7fdb0139d700 1 -- 172.21.15.60:0/3439169468 wait complete. 2023-10-06T04:31:46.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.499+0000 7fdb0139d700 1 Processor -- start 2023-10-06T04:31:46.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.499+0000 7fdb0139d700 1 -- start start 2023-10-06T04:31:46.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.500+0000 7fdb0139d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdafc0c1590 0x7fdafc0aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:46.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.500+0000 7fdb0139d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdafc158db0 0x7fdafc0acf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:46.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.500+0000 7fdb0139d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdafc159180 0x7fdafc1699f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:46.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.500+0000 7fdb0139d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc16a900 con 0x7fdafc0c1590 2023-10-06T04:31:46.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.500+0000 7fdb0139d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc0ad4a0 con 0x7fdafc158db0 2023-10-06T04:31:46.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.500+0000 7fdb0139d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc16aae0 con 0x7fdafc159180 2023-10-06T04:31:46.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.501+0000 7fdafbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdafc0c1590 0x7fdafc0aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:46.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.501+0000 7fdafbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdafc0c1590 0x7fdafc0aca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42570/0 (socket says 172.21.15.60:42570) 2023-10-06T04:31:46.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.501+0000 7fdafbfff700 1 -- 172.21.15.60:0/1470264051 learned_addr learned my addr 172.21.15.60:0/1470264051 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:46.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.501+0000 7fdafbfff700 1 -- 172.21.15.60:0/1470264051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdafc159180 msgr2=0x7fdafc1699f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:46.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.501+0000 7fdafbfff700 1 --2- 172.21.15.60:0/1470264051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdafc159180 0x7fdafc1699f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.501+0000 7fdafbfff700 1 -- 172.21.15.60:0/1470264051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdafc158db0 msgr2=0x7fdafc0acf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:46.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.501+0000 7fdafb7fe700 1 --2- 172.21.15.60:0/1470264051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdafc158db0 0x7fdafc0acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:46.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.501+0000 7fdafbfff700 1 --2- 172.21.15.60:0/1470264051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdafc158db0 0x7fdafc0acf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.501+0000 7fdafbfff700 1 -- 172.21.15.60:0/1470264051 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaec00b790 con 0x7fdafc0c1590 2023-10-06T04:31:46.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.501+0000 7fdafb7fe700 1 --2- 172.21.15.60:0/1470264051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdafc158db0 0x7fdafc0acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:31:46.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.501+0000 7fdafbfff700 1 --2- 172.21.15.60:0/1470264051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdafc0c1590 0x7fdafc0aca20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdaec00b760 tx=0x7fdaec01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:46.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.501+0000 7fdae3fff700 1 -- 172.21.15.60:0/1470264051 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec010700 con 0x7fdafc0c1590 2023-10-06T04:31:46.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.502+0000 7fdae3fff700 1 -- 172.21.15.60:0/1470264051 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec0108a0 con 0x7fdafc0c1590 2023-10-06T04:31:46.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.502+0000 7fdae3fff700 1 -- 172.21.15.60:0/1470264051 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec010c60 con 0x7fdafc0c1590 2023-10-06T04:31:46.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.502+0000 7fdb0139d700 1 -- 172.21.15.60:0/1470264051 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdafc16adc0 con 0x7fdafc0c1590 2023-10-06T04:31:46.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.502+0000 7fdb0139d700 1 -- 172.21.15.60:0/1470264051 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdafc16b380 con 0x7fdafc0c1590 2023-10-06T04:31:46.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.503+0000 7fdb0139d700 1 -- 172.21.15.60:0/1470264051 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdafc0b1cc0 con 0x7fdafc0c1590 2023-10-06T04:31:46.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.504+0000 7fdae3fff700 1 -- 172.21.15.60:0/1470264051 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdaec0183e0 con 0x7fdafc0c1590 2023-10-06T04:31:46.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.504+0000 7fdae3fff700 1 --2- 172.21.15.60:0/1470264051 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fdae8066f30 0x7fdae80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:46.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.504+0000 7fdae3fff700 1 -- 172.21.15.60:0/1470264051 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fdaec014070 con 0x7fdafc0c1590 2023-10-06T04:31:46.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.505+0000 7fdafb7fe700 1 --2- 172.21.15.60:0/1470264051 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fdae8066f30 0x7fdae80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:46.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.505+0000 7fdafb7fe700 1 --2- 172.21.15.60:0/1470264051 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fdae8066f30 0x7fdae80693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdafc157df0 tx=0x7fdaf0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:46.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.509+0000 7fdae3fff700 1 -- 172.21.15.60:0/1470264051 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdaec052f30 con 0x7fdafc0c1590 2023-10-06T04:31:46.757 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.756+0000 7fdb0139d700 1 -- 172.21.15.60:0/1470264051 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdafc05f230 con 0x7fdafc0c1590 2023-10-06T04:31:46.758 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.756+0000 7fdae3fff700 1 -- 172.21.15.60:0/1470264051 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fdaec056550 con 0x7fdafc0c1590 2023-10-06T04:31:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:31:46.758 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1681836371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1681836371},{"type":"v1","addr":"172.21.15.135:6834","nonce":1681836371}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/823204172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":823204172},{"type":"v1","addr":"172.21.15.135:6835","nonce":823204172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4963,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1348379028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1348379028},{"type":"v1","addr":"172.21.15.60:6836","nonce":1348379028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:29:20.429944+0000","modified":"2023-10-06T04:29:23.960780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6837/749877170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":749877170},{"type":"v1","addr":"172.21.15.60:6837","nonce":749877170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:31:46.760 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.759+0000 7fdb0139d700 1 -- 172.21.15.60:0/1470264051 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fdae8066f30 msgr2=0x7fdae80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:46.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.759+0000 7fdb0139d700 1 --2- 172.21.15.60:0/1470264051 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fdae8066f30 0x7fdae80693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdafc157df0 tx=0x7fdaf0009040 comp rx=0 tx=0).stop 2023-10-06T04:31:46.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.759+0000 7fdb0139d700 1 -- 172.21.15.60:0/1470264051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdafc0c1590 msgr2=0x7fdafc0aca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:46.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.759+0000 7fdb0139d700 1 --2- 172.21.15.60:0/1470264051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdafc0c1590 0x7fdafc0aca20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdaec00b760 tx=0x7fdaec01b000 comp rx=0 tx=0).stop 2023-10-06T04:31:46.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.759+0000 7fdb0139d700 1 -- 172.21.15.60:0/1470264051 shutdown_connections 2023-10-06T04:31:46.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.759+0000 7fdb0139d700 1 --2- 172.21.15.60:0/1470264051 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fdae8066f30 0x7fdae80693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.759+0000 7fdb0139d700 1 --2- 172.21.15.60:0/1470264051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdafc0c1590 0x7fdafc0aca20 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.759+0000 7fdb0139d700 1 --2- 172.21.15.60:0/1470264051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdafc159180 0x7fdafc1699f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.759+0000 7fdb0139d700 1 --2- 172.21.15.60:0/1470264051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdafc158db0 0x7fdafc0acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.759+0000 7fdb0139d700 1 -- 172.21.15.60:0/1470264051 >> 172.21.15.60:0/1470264051 conn(0x7fdafc0cbeb0 msgr2=0x7fdafc157e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:46.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.759+0000 7fdb0139d700 1 -- 172.21.15.60:0/1470264051 shutdown_connections 2023-10-06T04:31:46.761 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.759+0000 7fdb0139d700 1 -- 172.21.15.60:0/1470264051 wait complete. 2023-10-06T04:31:46.762 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 16 2023-10-06T04:31:46.778 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:31:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.962+0000 7fe11d39d700 1 Processor -- start 2023-10-06T04:31:46.964 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.963+0000 7fe11d39d700 1 -- start start 2023-10-06T04:31:46.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.964+0000 7fe11d39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1180af560 0x7fe1180ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:46.965 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.964+0000 7fe11d39d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11815cff0 con 0x7fe118159660 2023-10-06T04:31:46.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.964+0000 7fe11d39d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1180cb2d0 con 0x7fe118159290 2023-10-06T04:31:46.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.964+0000 7fe11d39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1180ce9f0 con 0x7fe1180af560 2023-10-06T04:31:46.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.964+0000 7fe1177fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe118159660 0x7fe1180aee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46604/0 (socket says 172.21.15.60:46604) 2023-10-06T04:31:46.966 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.964+0000 7fe1177fe700 1 -- 172.21.15.60:0/68889973 learned_addr learned my addr 172.21.15.60:0/68889973 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:31:46.969 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.964+0000 7fe11cb9c700 1 --2- 172.21.15.60:0/68889973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1180af560 0x7fe1180ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:46.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.964+0000 7fe116ffd700 1 -- 172.21.15.60:0/68889973 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865626764 0 0) 0x7fe11815cff0 con 0x7fe118159660 2023-10-06T04:31:46.970 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.965+0000 7fe116ffd700 1 -- 172.21.15.60:0/68889973 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe100003570 con 0x7fe118159660 2023-10-06T04:31:46.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.965+0000 7fe116ffd700 1 -- 172.21.15.60:0/68889973 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1636821872 0 0) 0x7fe100003570 con 0x7fe118159660 2023-10-06T04:31:46.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.965+0000 7fe116ffd700 1 -- 172.21.15.60:0/68889973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1180af560 msgr2=0x7fe1180ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:46.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.965+0000 7fe116ffd700 1 --2- 172.21.15.60:0/68889973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1180af560 0x7fe1180ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.965+0000 7fe116ffd700 1 -- 172.21.15.60:0/68889973 >> v1:172.21.15.135:6789/0 conn(0x7fe118159290 legacy=0x7fe1180ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:46.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.965+0000 7fe116ffd700 1 -- 172.21.15.60:0/68889973 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1180cb570 con 0x7fe118159660 2023-10-06T04:31:46.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.965+0000 7fe116ffd700 1 -- 172.21.15.60:0/68889973 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7fe10c001470 con 0x7fe118159660 2023-10-06T04:31:46.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.965+0000 7fe116ffd700 1 -- 172.21.15.60:0/68889973 >> v1:172.21.15.60:6789/0 conn(0x7fe118159660 legacy=0x7fe1180aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:46.971 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.965+0000 7fe116ffd700 1 --2- 172.21.15.60:0/68889973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe100003a90 0x7fe100003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:46.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.965+0000 7fe116ffd700 1 --2- 172.21.15.60:0/68889973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe100004810 0x7fe100004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:46.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.965+0000 7fe116ffd700 1 --2- 172.21.15.60:0/68889973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1180af560 0x7fe1000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:46.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.965+0000 7fe116ffd700 1 -- 172.21.15.60:0/68889973 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1180ce9f0 con 0x7fe100004810 2023-10-06T04:31:46.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.965+0000 7fe116ffd700 1 -- 172.21.15.60:0/68889973 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10000bb10 con 0x7fe100003a90 2023-10-06T04:31:46.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.965+0000 7fe116ffd700 1 -- 172.21.15.60:0/68889973 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10000bcd0 con 0x7fe1180af560 2023-10-06T04:31:46.972 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.965+0000 7fe1177fe700 1 --2- 172.21.15.60:0/68889973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe100004810 0x7fe100004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:46.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.965+0000 7fe117fff700 1 --2- 172.21.15.60:0/68889973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe100003a90 0x7fe100003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:46.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.965+0000 7fe11cb9c700 1 --2- 172.21.15.60:0/68889973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1180af560 0x7fe1000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:46.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.966+0000 7fe1177fe700 1 -- 172.21.15.60:0/68889973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1180af560 msgr2=0x7fe1000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:46.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.966+0000 7fe1177fe700 1 --2- 172.21.15.60:0/68889973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1180af560 0x7fe1000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.966+0000 7fe1177fe700 1 -- 172.21.15.60:0/68889973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe100003a90 msgr2=0x7fe100003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:46.973 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.966+0000 7fe1177fe700 1 --2- 172.21.15.60:0/68889973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe100003a90 0x7fe100003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.966+0000 7fe1177fe700 1 -- 172.21.15.60:0/68889973 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe100003570 con 0x7fe100004810 2023-10-06T04:31:46.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.966+0000 7fe1177fe700 1 --2- 172.21.15.60:0/68889973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe100004810 0x7fe100004c80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00c390 tx=0x7fe10c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5187c7840c599262 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:46.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.966+0000 7fe116ffd700 1 -- 172.21.15.60:0/68889973 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c00cc60 con 0x7fe100004810 2023-10-06T04:31:46.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.966+0000 7fe116ffd700 1 -- 172.21.15.60:0/68889973 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c00cdc0 con 0x7fe100004810 2023-10-06T04:31:46.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.966+0000 7fe116ffd700 1 -- 172.21.15.60:0/68889973 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c005b70 con 0x7fe100004810 2023-10-06T04:31:46.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.967+0000 7fe11d39d700 1 -- 172.21.15.60:0/68889973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe100004810 msgr2=0x7fe100004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:46.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.967+0000 7fe11d39d700 1 --2- 172.21.15.60:0/68889973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe100004810 0x7fe100004c80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00c390 tx=0x7fe10c001e70 comp rx=0 tx=0).stop 2023-10-06T04:31:46.974 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.967+0000 7fe11cb9c700 1 -- 172.21.15.60:0/68889973 reap_dead start 2023-10-06T04:31:46.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.967+0000 7fe11d39d700 1 -- 172.21.15.60:0/68889973 shutdown_connections 2023-10-06T04:31:46.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.967+0000 7fe11d39d700 1 -- 172.21.15.60:0/68889973 >> 172.21.15.60:0/68889973 conn(0x7fe1180680f0 msgr2=0x7fe1180684f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:46.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.967+0000 7fe11d39d700 1 -- 172.21.15.60:0/68889973 shutdown_connections 2023-10-06T04:31:46.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.967+0000 7fe11d39d700 1 -- 172.21.15.60:0/68889973 wait complete. 2023-10-06T04:31:46.975 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.968+0000 7fe11d39d700 1 Processor -- start 2023-10-06T04:31:46.976 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.968+0000 7fe11d39d700 1 -- start start 2023-10-06T04:31:46.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.969+0000 7fe11d39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe100004810 0x7fe11815b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:46.978 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.969+0000 7fe11d39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1180c87b0 0x7fe1180c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:46.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.969+0000 7fe11d39d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe118169800 0x7fe118169c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:46.979 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.969+0000 7fe11d39d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1181693b0 con 0x7fe118169800 2023-10-06T04:31:46.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.969+0000 7fe11d39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1180c7740 con 0x7fe100004810 2023-10-06T04:31:46.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.969+0000 7fe11d39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1180c7a20 con 0x7fe1180c87b0 2023-10-06T04:31:46.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.970+0000 7fe11cb9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe118169800 0x7fe118169c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:46.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.970+0000 7fe11cb9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe118169800 0x7fe118169c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42590/0 (socket says 172.21.15.60:42590) 2023-10-06T04:31:46.980 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.970+0000 7fe11cb9c700 1 -- 172.21.15.60:0/1448767296 learned_addr learned my addr 172.21.15.60:0/1448767296 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:46.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.970+0000 7fe117fff700 1 --2- 172.21.15.60:0/1448767296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe100004810 0x7fe11815b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:46.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.970+0000 7fe1177fe700 1 --2- 172.21.15.60:0/1448767296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1180c87b0 0x7fe1180c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:46.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.970+0000 7fe11cb9c700 1 -- 172.21.15.60:0/1448767296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1180c87b0 msgr2=0x7fe1180c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:46.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.970+0000 7fe11cb9c700 1 --2- 172.21.15.60:0/1448767296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1180c87b0 0x7fe1180c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.981 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.970+0000 7fe11cb9c700 1 -- 172.21.15.60:0/1448767296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe100004810 msgr2=0x7fe11815b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:46.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.970+0000 7fe11cb9c700 1 --2- 172.21.15.60:0/1448767296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe100004810 0x7fe11815b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:46.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.970+0000 7fe11cb9c700 1 -- 172.21.15.60:0/1448767296 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1180c7d00 con 0x7fe118169800 2023-10-06T04:31:46.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.970+0000 7fe1177fe700 1 --2- 172.21.15.60:0/1448767296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1180c87b0 0x7fe1180c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:31:46.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.970+0000 7fe11cb9c700 1 --2- 172.21.15.60:0/1448767296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe118169800 0x7fe118169c70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe118064790 tx=0x7fe11000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:46.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.971+0000 7fe0fffff700 1 -- 172.21.15.60:0/1448767296 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11000e040 con 0x7fe118169800 2023-10-06T04:31:46.982 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.971+0000 7fe0fffff700 1 -- 172.21.15.60:0/1448767296 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11000f040 con 0x7fe118169800 2023-10-06T04:31:46.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.971+0000 7fe0fffff700 1 -- 172.21.15.60:0/1448767296 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11000fe40 con 0x7fe118169800 2023-10-06T04:31:46.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.971+0000 7fe11d39d700 1 -- 172.21.15.60:0/1448767296 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1180c7fe0 con 0x7fe118169800 2023-10-06T04:31:46.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.971+0000 7fe11d39d700 1 -- 172.21.15.60:0/1448767296 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1180c7360 con 0x7fe118169800 2023-10-06T04:31:46.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.972+0000 7fe11d39d700 1 -- 172.21.15.60:0/1448767296 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11805f230 con 0x7fe118169800 2023-10-06T04:31:46.983 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.973+0000 7fe0fffff700 1 -- 172.21.15.60:0/1448767296 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe110015640 con 0x7fe118169800 2023-10-06T04:31:46.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.974+0000 7fe0fffff700 1 --2- 172.21.15.60:0/1448767296 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe104066f30 0x7fe1040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:46.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.974+0000 7fe0fffff700 1 -- 172.21.15.60:0/1448767296 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fe110085270 con 0x7fe118169800 2023-10-06T04:31:46.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.974+0000 7fe117fff700 1 --2- 172.21.15.60:0/1448767296 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe104066f30 0x7fe1040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:46.984 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.974+0000 7fe117fff700 1 --2- 172.21.15.60:0/1448767296 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe104066f30 0x7fe1040693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe108003d10 tx=0x7fe108007d10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:46.985 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:46.978+0000 7fe0fffff700 1 -- 172.21.15.60:0/1448767296 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe110052160 con 0x7fe118169800 2023-10-06T04:31:47.183 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.182+0000 7fe11d39d700 1 -- 172.21.15.60:0/1448767296 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1180cb850 con 0x7fe118169800 2023-10-06T04:31:47.184 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.183+0000 7fe0fffff700 1 -- 172.21.15.60:0/1448767296 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+17167 (secure 0 0 0) 0x7fe110055780 con 0x7fe118169800 2023-10-06T04:31:47.185 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:31:47.185 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":42,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:29:55.380007+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:29:18.102794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:29:19.405806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":5}]},{"pgid":"7.30","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:31:47.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.185+0000 7fe11d39d700 1 -- 172.21.15.60:0/1448767296 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe104066f30 msgr2=0x7fe1040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:47.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.185+0000 7fe11d39d700 1 --2- 172.21.15.60:0/1448767296 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe104066f30 0x7fe1040693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe108003d10 tx=0x7fe108007d10 comp rx=0 tx=0).stop 2023-10-06T04:31:47.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.185+0000 7fe11d39d700 1 -- 172.21.15.60:0/1448767296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe118169800 msgr2=0x7fe118169c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:47.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.185+0000 7fe11d39d700 1 --2- 172.21.15.60:0/1448767296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe118169800 0x7fe118169c70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe118064790 tx=0x7fe11000b040 comp rx=0 tx=0).stop 2023-10-06T04:31:47.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.185+0000 7fe11d39d700 1 -- 172.21.15.60:0/1448767296 shutdown_connections 2023-10-06T04:31:47.187 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.185+0000 7fe11d39d700 1 --2- 172.21.15.60:0/1448767296 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe104066f30 0x7fe1040693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:47.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.185+0000 7fe11d39d700 1 --2- 172.21.15.60:0/1448767296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe118169800 0x7fe118169c70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:47.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.185+0000 7fe11d39d700 1 --2- 172.21.15.60:0/1448767296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe100004810 0x7fe11815b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:47.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.185+0000 7fe11d39d700 1 --2- 172.21.15.60:0/1448767296 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1180c87b0 0x7fe1180c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:47.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.185+0000 7fe11d39d700 1 -- 172.21.15.60:0/1448767296 >> 172.21.15.60:0/1448767296 conn(0x7fe1180680f0 msgr2=0x7fe1180c6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:47.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.186+0000 7fe11d39d700 1 -- 172.21.15.60:0/1448767296 shutdown_connections 2023-10-06T04:31:47.188 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.186+0000 7fe11d39d700 1 -- 172.21.15.60:0/1448767296 wait complete. 2023-10-06T04:31:47.205 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:31:47.205 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:31:47.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.392+0000 7f5a925ff700 1 Processor -- start 2023-10-06T04:31:47.394 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.392+0000 7f5a925ff700 1 -- start start 2023-10-06T04:31:47.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.393+0000 7f5a925ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5a8c159560 0x7f5a8c0aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:47.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.393+0000 7f5a925ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0b49a0 0x7f5a8c0aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:47.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.393+0000 7f5a925ff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8c0b0c60 con 0x7f5a8c0b0760 2023-10-06T04:31:47.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.393+0000 7f5a925ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8c0b0f40 con 0x7f5a8c159560 2023-10-06T04:31:47.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.393+0000 7f5a925ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c0b1220 con 0x7f5a8c0b49a0 2023-10-06T04:31:47.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.394+0000 7f5a90b9c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5a8c0b0760 0x7f5a8c0b3890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46618/0 (socket says 172.21.15.60:46618) 2023-10-06T04:31:47.395 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.394+0000 7f5a90b9c700 1 -- 172.21.15.60:0/3579362152 learned_addr learned my addr 172.21.15.60:0/3579362152 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:31:47.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.394+0000 7f5a8b7fe700 1 --2- 172.21.15.60:0/3579362152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0b49a0 0x7f5a8c0aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:47.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.394+0000 7f5a8bfff700 1 --2- 172.21.15.60:0/3579362152 >> v2:172.21.15.135:3300/0 conn(0x7f5a8c159560 0x7f5a8c0aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:47.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.394+0000 7f5a8affd700 1 -- 172.21.15.60:0/3579362152 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1961347289 0 0) 0x7f5a8c0b0c60 con 0x7f5a8c0b0760 2023-10-06T04:31:47.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.394+0000 7f5a8affd700 1 -- 172.21.15.60:0/3579362152 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a74003570 con 0x7f5a8c0b0760 2023-10-06T04:31:47.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.394+0000 7f5a8bfff700 1 -- 172.21.15.60:0/3579362152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0b49a0 msgr2=0x7f5a8c0aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:47.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.394+0000 7f5a8bfff700 1 --2- 172.21.15.60:0/3579362152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0b49a0 0x7f5a8c0aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:47.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.394+0000 7f5a8bfff700 1 -- 172.21.15.60:0/3579362152 >> v1:172.21.15.60:6789/0 conn(0x7f5a8c0b0760 legacy=0x7f5a8c0b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:47.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.394+0000 7f5a8bfff700 1 -- 172.21.15.60:0/3579362152 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c0b1500 con 0x7f5a8c159560 2023-10-06T04:31:47.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.395+0000 7f5a8bfff700 1 --2- 172.21.15.60:0/3579362152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8c159560 0x7f5a8c0aa530 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0098d0 tx=0x7f5a7c009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32a536d82ed319af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:47.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.395+0000 7f5a8affd700 1 -- 172.21.15.60:0/3579362152 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c005c10 con 0x7f5a8c159560 2023-10-06T04:31:47.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.395+0000 7f5a8affd700 1 -- 172.21.15.60:0/3579362152 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7c005d70 con 0x7f5a8c159560 2023-10-06T04:31:47.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.395+0000 7f5a8affd700 1 -- 172.21.15.60:0/3579362152 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c006260 con 0x7f5a8c159560 2023-10-06T04:31:47.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.396+0000 7f5a925ff700 1 -- 172.21.15.60:0/3579362152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8c159560 msgr2=0x7f5a8c0aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:47.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.396+0000 7f5a925ff700 1 --2- 172.21.15.60:0/3579362152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8c159560 0x7f5a8c0aa530 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0098d0 tx=0x7f5a7c009120 comp rx=0 tx=0).stop 2023-10-06T04:31:47.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.396+0000 7f5a925ff700 1 -- 172.21.15.60:0/3579362152 shutdown_connections 2023-10-06T04:31:47.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.396+0000 7f5a925ff700 1 --2- 172.21.15.60:0/3579362152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8c159560 0x7f5a8c0aa530 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:47.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.396+0000 7f5a925ff700 1 --2- 172.21.15.60:0/3579362152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0b49a0 0x7f5a8c0aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:47.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.396+0000 7f5a925ff700 1 -- 172.21.15.60:0/3579362152 >> 172.21.15.60:0/3579362152 conn(0x7f5a8c0997f0 msgr2=0x7f5a8c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:47.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.396+0000 7f5a925ff700 1 -- 172.21.15.60:0/3579362152 shutdown_connections 2023-10-06T04:31:47.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.396+0000 7f5a925ff700 1 -- 172.21.15.60:0/3579362152 wait complete. 2023-10-06T04:31:47.400 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.397+0000 7f5a925ff700 1 Processor -- start 2023-10-06T04:31:47.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.397+0000 7f5a925ff700 1 -- start start 2023-10-06T04:31:47.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.398+0000 7f5a925ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0b0760 0x7f5a8c159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:47.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.398+0000 7f5a925ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8c0b49a0 0x7f5a8c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:47.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.398+0000 7f5a925ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a8c159560 0x7f5a8c15c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:47.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.398+0000 7f5a925ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c09a050 con 0x7f5a8c159560 2023-10-06T04:31:47.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.398+0000 7f5a925ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c16a210 con 0x7f5a8c0b49a0 2023-10-06T04:31:47.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.398+0000 7f5a925ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c16a4f0 con 0x7f5a8c0b0760 2023-10-06T04:31:47.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.398+0000 7f5a90b9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a8c159560 0x7f5a8c15c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:47.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.398+0000 7f5a90b9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a8c159560 0x7f5a8c15c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42598/0 (socket says 172.21.15.60:42598) 2023-10-06T04:31:47.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.398+0000 7f5a90b9c700 1 -- 172.21.15.60:0/1151465672 learned_addr learned my addr 172.21.15.60:0/1151465672 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:47.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.399+0000 7f5a90b9c700 1 -- 172.21.15.60:0/1151465672 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0b0760 msgr2=0x7f5a8c159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:47.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.399+0000 7f5a90b9c700 1 --2- 172.21.15.60:0/1151465672 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0b0760 0x7f5a8c159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:47.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.399+0000 7f5a90b9c700 1 -- 172.21.15.60:0/1151465672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8c0b49a0 msgr2=0x7f5a8c156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:47.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.399+0000 7f5a90b9c700 1 --2- 172.21.15.60:0/1151465672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8c0b49a0 0x7f5a8c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:47.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.399+0000 7f5a90b9c700 1 -- 172.21.15.60:0/1151465672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c0093c0 con 0x7f5a8c159560 2023-10-06T04:31:47.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.399+0000 7f5a90b9c700 1 --2- 172.21.15.60:0/1151465672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a8c159560 0x7f5a8c15c430 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5a84001460 tx=0x7f5a84001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:47.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.399+0000 7f5a73fff700 1 -- 172.21.15.60:0/1151465672 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8400ce80 con 0x7f5a8c159560 2023-10-06T04:31:47.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.399+0000 7f5a925ff700 1 -- 172.21.15.60:0/1151465672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8c16a7d0 con 0x7f5a8c159560 2023-10-06T04:31:47.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.399+0000 7f5a73fff700 1 -- 172.21.15.60:0/1151465672 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8400ab70 con 0x7f5a8c159560 2023-10-06T04:31:47.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.399+0000 7f5a73fff700 1 -- 172.21.15.60:0/1151465672 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a840070f0 con 0x7f5a8c159560 2023-10-06T04:31:47.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.399+0000 7f5a925ff700 1 -- 172.21.15.60:0/1151465672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8c15c970 con 0x7f5a8c159560 2023-10-06T04:31:47.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.401+0000 7f5a925ff700 1 -- 172.21.15.60:0/1151465672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8c064a90 con 0x7f5a8c159560 2023-10-06T04:31:47.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.401+0000 7f5a73fff700 1 -- 172.21.15.60:0/1151465672 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a84007520 con 0x7f5a8c159560 2023-10-06T04:31:47.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.402+0000 7f5a73fff700 1 --2- 172.21.15.60:0/1151465672 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5a78066f30 0x7f5a780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:47.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.402+0000 7f5a73fff700 1 -- 172.21.15.60:0/1151465672 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f5a84084e70 con 0x7f5a8c159560 2023-10-06T04:31:47.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.403+0000 7f5a8bfff700 1 --2- 172.21.15.60:0/1151465672 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5a78066f30 0x7f5a780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:47.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.403+0000 7f5a8bfff700 1 --2- 172.21.15.60:0/1151465672 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5a78066f30 0x7f5a780693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c009160 tx=0x7f5a7c016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:47.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.406+0000 7f5a73fff700 1 -- 172.21.15.60:0/1151465672 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a84051cd0 con 0x7f5a8c159560 2023-10-06T04:31:47.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.656+0000 7f5a925ff700 1 -- 172.21.15.60:0/1151465672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a8c0b17e0 con 0x7f5a8c159560 2023-10-06T04:31:47.657 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.656+0000 7f5a73fff700 1 -- 172.21.15.60:0/1151465672 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f5a840552f0 con 0x7f5a8c159560 2023-10-06T04:31:47.658 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:31:47.658 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1681836371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1681836371},{"type":"v1","addr":"172.21.15.135:6834","nonce":1681836371}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/823204172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":823204172},{"type":"v1","addr":"172.21.15.135:6835","nonce":823204172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4963,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1348379028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1348379028},{"type":"v1","addr":"172.21.15.60:6836","nonce":1348379028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:29:20.429944+0000","modified":"2023-10-06T04:29:23.960780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6837/749877170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":749877170},{"type":"v1","addr":"172.21.15.60:6837","nonce":749877170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:31:47.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.658+0000 7f5a925ff700 1 -- 172.21.15.60:0/1151465672 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5a78066f30 msgr2=0x7f5a780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:47.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.658+0000 7f5a925ff700 1 --2- 172.21.15.60:0/1151465672 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5a78066f30 0x7f5a780693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c009160 tx=0x7f5a7c016000 comp rx=0 tx=0).stop 2023-10-06T04:31:47.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.658+0000 7f5a925ff700 1 -- 172.21.15.60:0/1151465672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a8c159560 msgr2=0x7f5a8c15c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:47.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.658+0000 7f5a925ff700 1 --2- 172.21.15.60:0/1151465672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a8c159560 0x7f5a8c15c430 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5a84001460 tx=0x7f5a84001ae0 comp rx=0 tx=0).stop 2023-10-06T04:31:47.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.658+0000 7f5a925ff700 1 -- 172.21.15.60:0/1151465672 shutdown_connections 2023-10-06T04:31:47.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.658+0000 7f5a925ff700 1 --2- 172.21.15.60:0/1151465672 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f5a78066f30 0x7f5a780693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:47.660 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.658+0000 7f5a925ff700 1 --2- 172.21.15.60:0/1151465672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a8c159560 0x7f5a8c15c430 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:47.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.658+0000 7f5a925ff700 1 --2- 172.21.15.60:0/1151465672 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5a8c0b0760 0x7f5a8c159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:47.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.658+0000 7f5a925ff700 1 --2- 172.21.15.60:0/1151465672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8c0b49a0 0x7f5a8c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:47.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.658+0000 7f5a925ff700 1 -- 172.21.15.60:0/1151465672 >> 172.21.15.60:0/1151465672 conn(0x7f5a8c0997f0 msgr2=0x7f5a8c1587e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:47.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.659+0000 7f5a925ff700 1 -- 172.21.15.60:0/1151465672 shutdown_connections 2023-10-06T04:31:47.661 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.659+0000 7f5a925ff700 1 -- 172.21.15.60:0/1151465672 wait complete. 2023-10-06T04:31:47.661 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 16 2023-10-06T04:31:47.678 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:31:47.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.863+0000 7fe256d9d700 1 Processor -- start 2023-10-06T04:31:47.865 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.863+0000 7fe256d9d700 1 -- start start 2023-10-06T04:31:47.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.865+0000 7fe256d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe25013f9f0 0x7fe2500c0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:47.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.865+0000 7fe256d9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2500c1240 con 0x7fe25015a5f0 2023-10-06T04:31:47.866 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.865+0000 7fe256d9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe25006f480 con 0x7fe2500ca490 2023-10-06T04:31:47.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.865+0000 7fe256d9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2500cb4d0 con 0x7fe25013f9f0 2023-10-06T04:31:47.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.865+0000 7fe255d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe25013f9f0 0x7fe2500c0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:47.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.865+0000 7fe255d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe25013f9f0 0x7fe2500c0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42602/0 (socket says 172.21.15.60:42602) 2023-10-06T04:31:47.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.865+0000 7fe255d9b700 1 -- 172.21.15.60:0/2046827084 learned_addr learned my addr 172.21.15.60:0/2046827084 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:47.867 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.865+0000 7fe25659c700 1 --1- 172.21.15.60:0/2046827084 >> v1:172.21.15.60:6789/0 conn(0x7fe25015a5f0 0x7fe2500c68d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46628/0 (socket says 172.21.15.60:46628) 2023-10-06T04:31:47.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.865+0000 7fe255d9b700 1 -- 172.21.15.60:0/2046827084 >> v1:172.21.15.135:6789/0 conn(0x7fe2500ca490 legacy=0x7fe250159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:47.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.865+0000 7fe255d9b700 1 -- 172.21.15.60:0/2046827084 >> v1:172.21.15.60:6789/0 conn(0x7fe25015a5f0 legacy=0x7fe2500c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:47.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.865+0000 7fe255d9b700 1 -- 172.21.15.60:0/2046827084 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2500ca950 con 0x7fe25013f9f0 2023-10-06T04:31:47.868 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.865+0000 7fe254d99700 1 -- 172.21.15.60:0/2046827084 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595656946 0 0) 0x7fe2500c1240 con 0x7fe25015a5f0 2023-10-06T04:31:47.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.866+0000 7fe255d9b700 1 --2- 172.21.15.60:0/2046827084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25013f9f0 0x7fe2500c0d00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0099b0 tx=0x7fe24c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6f1b0946f773f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:47.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.866+0000 7fe254d99700 1 -- 172.21.15.60:0/2046827084 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c00b860 con 0x7fe25013f9f0 2023-10-06T04:31:47.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.866+0000 7fe254d99700 1 -- 172.21.15.60:0/2046827084 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24c00b9c0 con 0x7fe25013f9f0 2023-10-06T04:31:47.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.866+0000 7fe254d99700 1 -- 172.21.15.60:0/2046827084 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c00bd60 con 0x7fe25013f9f0 2023-10-06T04:31:47.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.866+0000 7fe256d9d700 1 -- 172.21.15.60:0/2046827084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25013f9f0 msgr2=0x7fe2500c0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:47.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.866+0000 7fe256d9d700 1 --2- 172.21.15.60:0/2046827084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25013f9f0 0x7fe2500c0d00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0099b0 tx=0x7fe24c009250 comp rx=0 tx=0).stop 2023-10-06T04:31:47.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.867+0000 7fe256d9d700 1 -- 172.21.15.60:0/2046827084 shutdown_connections 2023-10-06T04:31:47.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.867+0000 7fe256d9d700 1 --2- 172.21.15.60:0/2046827084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25013f9f0 0x7fe2500c0d00 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:47.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.867+0000 7fe256d9d700 1 -- 172.21.15.60:0/2046827084 >> 172.21.15.60:0/2046827084 conn(0x7fe2500cbeb0 msgr2=0x7fe2500cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:47.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.867+0000 7fe256d9d700 1 -- 172.21.15.60:0/2046827084 shutdown_connections 2023-10-06T04:31:47.869 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.867+0000 7fe256d9d700 1 -- 172.21.15.60:0/2046827084 wait complete. 2023-10-06T04:31:47.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.868+0000 7fe256d9d700 1 Processor -- start 2023-10-06T04:31:47.870 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.868+0000 7fe256d9d700 1 -- start start 2023-10-06T04:31:47.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.869+0000 7fe256d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2500ca490 0x7fe2500c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:47.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.869+0000 7fe256d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25013f9f0 0x7fe2501327e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:47.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.869+0000 7fe256d9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe25015a5f0 0x7fe250132d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:47.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.869+0000 7fe256d9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2501561f0 con 0x7fe25013f9f0 2023-10-06T04:31:47.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.869+0000 7fe256d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25016d500 con 0x7fe2500ca490 2023-10-06T04:31:47.872 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.869+0000 7fe256d9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25016ad10 con 0x7fe25015a5f0 2023-10-06T04:31:47.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.869+0000 7fe25559a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25013f9f0 0x7fe2501327e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:47.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.870+0000 7fe25559a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25013f9f0 0x7fe2501327e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42618/0 (socket says 172.21.15.60:42618) 2023-10-06T04:31:47.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.870+0000 7fe25559a700 1 -- 172.21.15.60:0/4234154416 learned_addr learned my addr 172.21.15.60:0/4234154416 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:47.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.870+0000 7fe25659c700 1 --2- 172.21.15.60:0/4234154416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe25015a5f0 0x7fe250132d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:47.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.870+0000 7fe255d9b700 1 --2- 172.21.15.60:0/4234154416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2500ca490 0x7fe2500c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:47.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.870+0000 7fe25559a700 1 -- 172.21.15.60:0/4234154416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe25015a5f0 msgr2=0x7fe250132d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:47.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.870+0000 7fe25559a700 1 --2- 172.21.15.60:0/4234154416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe25015a5f0 0x7fe250132d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:47.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.870+0000 7fe25559a700 1 -- 172.21.15.60:0/4234154416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2500ca490 msgr2=0x7fe2500c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:47.873 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.870+0000 7fe25559a700 1 --2- 172.21.15.60:0/4234154416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2500ca490 0x7fe2500c7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:47.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.870+0000 7fe25559a700 1 -- 172.21.15.60:0/4234154416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c0094f0 con 0x7fe25013f9f0 2023-10-06T04:31:47.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.870+0000 7fe25659c700 1 --2- 172.21.15.60:0/4234154416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe25015a5f0 0x7fe250132d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:31:47.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.870+0000 7fe25559a700 1 --2- 172.21.15.60:0/4234154416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25013f9f0 0x7fe2501327e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe24000c790 tx=0x7fe240007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:47.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.870+0000 7fe245ffb700 1 -- 172.21.15.60:0/4234154416 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe240006820 con 0x7fe25013f9f0 2023-10-06T04:31:47.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.870+0000 7fe245ffb700 1 -- 172.21.15.60:0/4234154416 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe240006980 con 0x7fe25013f9f0 2023-10-06T04:31:47.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.870+0000 7fe245ffb700 1 -- 172.21.15.60:0/4234154416 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe240006d40 con 0x7fe25013f9f0 2023-10-06T04:31:47.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.870+0000 7fe256d9d700 1 -- 172.21.15.60:0/4234154416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25016d7c0 con 0x7fe25013f9f0 2023-10-06T04:31:47.874 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.871+0000 7fe256d9d700 1 -- 172.21.15.60:0/4234154416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25016dd80 con 0x7fe25013f9f0 2023-10-06T04:31:47.875 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.871+0000 7fe256d9d700 1 -- 172.21.15.60:0/4234154416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25016dfa0 con 0x7fe25013f9f0 2023-10-06T04:31:47.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.872+0000 7fe245ffb700 1 -- 172.21.15.60:0/4234154416 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe240007240 con 0x7fe25013f9f0 2023-10-06T04:31:47.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.873+0000 7fe245ffb700 1 --2- 172.21.15.60:0/4234154416 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe234066f30 0x7fe2340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:47.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.873+0000 7fe245ffb700 1 -- 172.21.15.60:0/4234154416 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6436+0+0 (secure 0 0 0) 0x7fe240083e40 con 0x7fe25013f9f0 2023-10-06T04:31:47.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.873+0000 7fe255d9b700 1 --2- 172.21.15.60:0/4234154416 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe234066f30 0x7fe2340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:47.876 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.874+0000 7fe255d9b700 1 --2- 172.21.15.60:0/4234154416 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe234066f30 0x7fe2340693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0099b0 tx=0x7fe24c017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:47.878 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:47.877+0000 7fe245ffb700 1 -- 172.21.15.60:0/4234154416 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe240050d30 con 0x7fe25013f9f0 2023-10-06T04:31:48.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.124+0000 7fe256d9d700 1 -- 172.21.15.60:0/4234154416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe25005f230 con 0x7fe25013f9f0 2023-10-06T04:31:48.125 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.124+0000 7fe245ffb700 1 -- 172.21.15.60:0/4234154416 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fe240017070 con 0x7fe25013f9f0 2023-10-06T04:31:48.126 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:31:48.126 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1681836371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1681836371},{"type":"v1","addr":"172.21.15.135:6834","nonce":1681836371}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/823204172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":823204172},{"type":"v1","addr":"172.21.15.135:6835","nonce":823204172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4963,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1348379028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1348379028},{"type":"v1","addr":"172.21.15.60:6836","nonce":1348379028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T04:29:20.429944+0000","modified":"2023-10-06T04:29:23.960780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5082":{"gid":5082,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6837/749877170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":749877170},{"type":"v1","addr":"172.21.15.60:6837","nonce":749877170}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T04:31:48.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.127+0000 7fe256d9d700 1 -- 172.21.15.60:0/4234154416 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe234066f30 msgr2=0x7fe2340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:48.128 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.127+0000 7fe256d9d700 1 --2- 172.21.15.60:0/4234154416 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe234066f30 0x7fe2340693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0099b0 tx=0x7fe24c017000 comp rx=0 tx=0).stop 2023-10-06T04:31:48.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.127+0000 7fe256d9d700 1 -- 172.21.15.60:0/4234154416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25013f9f0 msgr2=0x7fe2501327e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:48.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.127+0000 7fe256d9d700 1 --2- 172.21.15.60:0/4234154416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25013f9f0 0x7fe2501327e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe24000c790 tx=0x7fe240007f60 comp rx=0 tx=0).stop 2023-10-06T04:31:48.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.127+0000 7fe256d9d700 1 -- 172.21.15.60:0/4234154416 shutdown_connections 2023-10-06T04:31:48.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.127+0000 7fe256d9d700 1 --2- 172.21.15.60:0/4234154416 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe234066f30 0x7fe2340693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:48.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.127+0000 7fe256d9d700 1 --2- 172.21.15.60:0/4234154416 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe25015a5f0 0x7fe250132d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:48.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.127+0000 7fe256d9d700 1 --2- 172.21.15.60:0/4234154416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2500ca490 0x7fe2500c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:48.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.127+0000 7fe256d9d700 1 --2- 172.21.15.60:0/4234154416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe25013f9f0 0x7fe2501327e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:48.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.127+0000 7fe256d9d700 1 -- 172.21.15.60:0/4234154416 >> 172.21.15.60:0/4234154416 conn(0x7fe2500cbeb0 msgr2=0x7fe2500c86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:48.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.127+0000 7fe256d9d700 1 -- 172.21.15.60:0/4234154416 shutdown_connections 2023-10-06T04:31:48.129 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.127+0000 7fe256d9d700 1 -- 172.21.15.60:0/4234154416 wait complete. 2023-10-06T04:31:48.130 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 16 2023-10-06T04:31:48.146 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:31:48.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.332+0000 7f1f4a39d700 1 Processor -- start 2023-10-06T04:31:48.334 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.333+0000 7f1f4a39d700 1 -- start start 2023-10-06T04:31:48.335 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.334+0000 7f1f4a39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f44159180 0x7f1f4406d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:48.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.334+0000 7f1f4a39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1f440c1590 0x7f1f440c1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:48.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.334+0000 7f1f4a39d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f440c79c0 con 0x7f1f44158db0 2023-10-06T04:31:48.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.334+0000 7f1f4a39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f440c1f70 con 0x7f1f440c1590 2023-10-06T04:31:48.336 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.334+0000 7f1f4a39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4406e910 con 0x7f1f44159180 2023-10-06T04:31:48.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.334+0000 7f1f48b9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f44159180 0x7f1f4406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:48.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.334+0000 7f1f49b9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1f440c1590 0x7f1f440c1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:48.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.334+0000 7f1f48b9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f44159180 0x7f1f4406d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:37882/0 (socket says 172.21.15.60:37882) 2023-10-06T04:31:48.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.334+0000 7f1f48b9a700 1 -- 172.21.15.60:0/2339853646 learned_addr learned my addr 172.21.15.60:0/2339853646 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:48.337 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.334+0000 7f1f4939b700 1 --1- 172.21.15.60:0/2339853646 >> v1:172.21.15.135:6789/0 conn(0x7f1f44158db0 0x7f1f440c72b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.60:41292/0 (socket says 172.21.15.60:41292) 2023-10-06T04:31:48.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.335+0000 7f1f48b9a700 1 -- 172.21.15.60:0/2339853646 >> v2:172.21.15.135:3300/0 conn(0x7f1f440c1590 msgr2=0x7f1f440c1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:48.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.335+0000 7f1f48b9a700 1 --2- 172.21.15.60:0/2339853646 >> v2:172.21.15.135:3300/0 conn(0x7f1f440c1590 0x7f1f440c1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:48.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.335+0000 7f1f48b9a700 1 -- 172.21.15.60:0/2339853646 >> v1:172.21.15.135:6789/0 conn(0x7f1f44158db0 legacy=0x7f1f440c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:48.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.335+0000 7f1f48b9a700 1 -- 172.21.15.60:0/2339853646 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f440caa90 con 0x7f1f44159180 2023-10-06T04:31:48.340 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.335+0000 7f1f48b9a700 1 --2- 172.21.15.60:0/2339853646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f44159180 0x7f1f4406d710 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1f340099b0 tx=0x7f1f34009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b20d38cd3be657bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:48.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.335+0000 7f1f3bfff700 1 -- 172.21.15.60:0/2339853646 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f34009ea0 con 0x7f1f44159180 2023-10-06T04:31:48.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.336+0000 7f1f3bfff700 1 -- 172.21.15.60:0/2339853646 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3400b860 con 0x7f1f44159180 2023-10-06T04:31:48.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.336+0000 7f1f3bfff700 1 -- 172.21.15.60:0/2339853646 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3400bc00 con 0x7f1f44159180 2023-10-06T04:31:48.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.336+0000 7f1f4a39d700 1 -- 172.21.15.60:0/2339853646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f44159180 msgr2=0x7f1f4406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:48.341 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.336+0000 7f1f4a39d700 1 --2- 172.21.15.60:0/2339853646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f44159180 0x7f1f4406d710 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1f340099b0 tx=0x7f1f34009250 comp rx=0 tx=0).stop 2023-10-06T04:31:48.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.336+0000 7f1f4a39d700 1 -- 172.21.15.60:0/2339853646 shutdown_connections 2023-10-06T04:31:48.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.336+0000 7f1f4a39d700 1 --2- 172.21.15.60:0/2339853646 >> v2:172.21.15.135:3300/0 conn(0x7f1f440c1590 0x7f1f440c1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:48.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.336+0000 7f1f4a39d700 1 --2- 172.21.15.60:0/2339853646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f44159180 0x7f1f4406d710 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:48.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.336+0000 7f1f4a39d700 1 -- 172.21.15.60:0/2339853646 >> 172.21.15.60:0/2339853646 conn(0x7f1f440cbeb0 msgr2=0x7f1f440cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:48.342 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.336+0000 7f1f4a39d700 1 -- 172.21.15.60:0/2339853646 shutdown_connections 2023-10-06T04:31:48.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.336+0000 7f1f4a39d700 1 -- 172.21.15.60:0/2339853646 wait complete. 2023-10-06T04:31:48.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.338+0000 7f1f4a39d700 1 Processor -- start 2023-10-06T04:31:48.343 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.338+0000 7f1f4a39d700 1 -- start start 2023-10-06T04:31:48.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.339+0000 7f1f4a39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f440c1590 0x7f1f4415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.339+0000 7f1f4a39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f44158db0 0x7f1f440acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.339+0000 7f1f4a39d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f44159180 0x7f1f440ad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.339+0000 7f1f4a39d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f440ae470 con 0x7f1f44159180 2023-10-06T04:31:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.339+0000 7f1f4a39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f440ad860 con 0x7f1f44158db0 2023-10-06T04:31:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.339+0000 7f1f4a39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f440adb40 con 0x7f1f440c1590 2023-10-06T04:31:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.339+0000 7f1f49b9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f44159180 0x7f1f440ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.339+0000 7f1f49b9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f44159180 0x7f1f440ad220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42628/0 (socket says 172.21.15.60:42628) 2023-10-06T04:31:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.339+0000 7f1f49b9c700 1 -- 172.21.15.60:0/3437132162 learned_addr learned my addr 172.21.15.60:0/3437132162 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.339+0000 7f1f4939b700 1 --2- 172.21.15.60:0/3437132162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f440c1590 0x7f1f4415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:48.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.339+0000 7f1f48b9a700 1 --2- 172.21.15.60:0/3437132162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f44158db0 0x7f1f440acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:48.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.339+0000 7f1f49b9c700 1 -- 172.21.15.60:0/3437132162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f440c1590 msgr2=0x7f1f4415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:48.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.339+0000 7f1f49b9c700 1 --2- 172.21.15.60:0/3437132162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f440c1590 0x7f1f4415aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:48.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.339+0000 7f1f49b9c700 1 -- 172.21.15.60:0/3437132162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f44158db0 msgr2=0x7f1f440acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:48.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.339+0000 7f1f49b9c700 1 --2- 172.21.15.60:0/3437132162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f44158db0 0x7f1f440acce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:48.348 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.339+0000 7f1f49b9c700 1 -- 172.21.15.60:0/3437132162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f340094f0 con 0x7f1f44159180 2023-10-06T04:31:48.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.340+0000 7f1f49b9c700 1 --2- 172.21.15.60:0/3437132162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f44159180 0x7f1f440ad220 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009e90 tx=0x7f1f3c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:48.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.340+0000 7f1f397fa700 1 -- 172.21.15.60:0/3437132162 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c00cb70 con 0x7f1f44159180 2023-10-06T04:31:48.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.340+0000 7f1f397fa700 1 -- 172.21.15.60:0/3437132162 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c00f040 con 0x7f1f44159180 2023-10-06T04:31:48.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.340+0000 7f1f397fa700 1 -- 172.21.15.60:0/3437132162 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c014480 con 0x7f1f44159180 2023-10-06T04:31:48.349 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.340+0000 7f1f4a39d700 1 -- 172.21.15.60:0/3437132162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f440ade20 con 0x7f1f44159180 2023-10-06T04:31:48.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.340+0000 7f1f4a39d700 1 -- 172.21.15.60:0/3437132162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4416dc90 con 0x7f1f44159180 2023-10-06T04:31:48.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.341+0000 7f1f4a39d700 1 -- 172.21.15.60:0/3437132162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f440ae620 con 0x7f1f44159180 2023-10-06T04:31:48.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.342+0000 7f1f397fa700 1 -- 172.21.15.60:0/3437132162 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f3c014830 con 0x7f1f44159180 2023-10-06T04:31:48.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.343+0000 7f1f397fa700 1 --2- 172.21.15.60:0/3437132162 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1f28066f30 0x7f1f280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:48.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.343+0000 7f1f397fa700 1 -- 172.21.15.60:0/3437132162 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f1f3c0852e0 con 0x7f1f44159180 2023-10-06T04:31:48.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.343+0000 7f1f4939b700 1 --2- 172.21.15.60:0/3437132162 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1f28066f30 0x7f1f280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:48.351 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.344+0000 7f1f4939b700 1 --2- 172.21.15.60:0/3437132162 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1f28066f30 0x7f1f280693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1f400069f0 tx=0x7f1f40009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:48.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.347+0000 7f1f397fa700 1 -- 172.21.15.60:0/3437132162 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f440ae620 con 0x7f1f44159180 2023-10-06T04:31:48.554 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.552+0000 7f1f4a39d700 1 -- 172.21.15.60:0/3437132162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f440ae620 con 0x7f1f44159180 2023-10-06T04:31:48.555 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.553+0000 7f1f397fa700 1 -- 172.21.15.60:0/3437132162 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+17167 (secure 0 0 0) 0x7f1f440ae620 con 0x7f1f44159180 2023-10-06T04:31:48.555 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:31:48.555 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":42,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:29:55.380007+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T04:29:18.102794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T04:29:19.405806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":5}]},{"pgid":"7.30","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:31:48.557 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.556+0000 7f1f4a39d700 1 -- 172.21.15.60:0/3437132162 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1f28066f30 msgr2=0x7f1f280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:48.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.556+0000 7f1f4a39d700 1 --2- 172.21.15.60:0/3437132162 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1f28066f30 0x7f1f280693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1f400069f0 tx=0x7f1f40009040 comp rx=0 tx=0).stop 2023-10-06T04:31:48.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.556+0000 7f1f4a39d700 1 -- 172.21.15.60:0/3437132162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f44159180 msgr2=0x7f1f440ad220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:48.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.556+0000 7f1f4a39d700 1 --2- 172.21.15.60:0/3437132162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f44159180 0x7f1f440ad220 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009e90 tx=0x7f1f3c00b040 comp rx=0 tx=0).stop 2023-10-06T04:31:48.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.556+0000 7f1f4a39d700 1 -- 172.21.15.60:0/3437132162 shutdown_connections 2023-10-06T04:31:48.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.556+0000 7f1f4a39d700 1 --2- 172.21.15.60:0/3437132162 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1f28066f30 0x7f1f280693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:48.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.556+0000 7f1f4a39d700 1 --2- 172.21.15.60:0/3437132162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f44159180 0x7f1f440ad220 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:48.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.556+0000 7f1f4a39d700 1 --2- 172.21.15.60:0/3437132162 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1f440c1590 0x7f1f4415aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:48.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.556+0000 7f1f4a39d700 1 --2- 172.21.15.60:0/3437132162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f44158db0 0x7f1f440acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:48.558 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.556+0000 7f1f4a39d700 1 -- 172.21.15.60:0/3437132162 >> 172.21.15.60:0/3437132162 conn(0x7f1f440cbeb0 msgr2=0x7f1f440c9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:48.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.556+0000 7f1f4a39d700 1 -- 172.21.15.60:0/3437132162 shutdown_connections 2023-10-06T04:31:48.559 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.556+0000 7f1f4a39d700 1 -- 172.21.15.60:0/3437132162 wait complete. 2023-10-06T04:31:48.578 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T04:31:48.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.765+0000 7f08f3fff700 1 Processor -- start 2023-10-06T04:31:48.767 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.765+0000 7f08f3fff700 1 -- start start 2023-10-06T04:31:48.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.766+0000 7f08f3fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f08f4159320 0x7f08f40cc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:48.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.766+0000 7f08f3fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f40c16f0 con 0x7f08f415cfb0 2023-10-06T04:31:48.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.767+0000 7f08f3fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f40c2550 con 0x7f08f415db60 2023-10-06T04:31:48.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.767+0000 7f08f3fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f40c1940 con 0x7f08f4159320 2023-10-06T04:31:48.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.767+0000 7f08f2ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f08f4159320 0x7f08f40cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:48.768 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.767+0000 7f08f2ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f08f4159320 0x7f08f40cc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42630/0 (socket says 172.21.15.60:42630) 2023-10-06T04:31:48.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.767+0000 7f08f27fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f08f415cfb0 0x7f08f415d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46644/0 (socket says 172.21.15.60:46644) 2023-10-06T04:31:48.769 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.767+0000 7f08f2ffd700 1 -- 172.21.15.60:0/1882003091 learned_addr learned my addr 172.21.15.60:0/1882003091 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:48.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.767+0000 7f08f2ffd700 1 -- 172.21.15.60:0/1882003091 >> v1:172.21.15.135:6789/0 conn(0x7f08f415db60 legacy=0x7f08f40675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:48.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.767+0000 7f08f2ffd700 1 -- 172.21.15.60:0/1882003091 >> v1:172.21.15.60:6789/0 conn(0x7f08f415cfb0 legacy=0x7f08f415d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:48.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.767+0000 7f08f2ffd700 1 -- 172.21.15.60:0/1882003091 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f40c1c20 con 0x7f08f4159320 2023-10-06T04:31:48.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.767+0000 7f08f1ffb700 1 -- 172.21.15.60:0/1882003091 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530273044 0 0) 0x7f08f40c16f0 con 0x7f08f415cfb0 2023-10-06T04:31:48.770 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.768+0000 7f08f2ffd700 1 --2- 172.21.15.60:0/1882003091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f4159320 0x7f08f40cc090 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f08e40099b0 tx=0x7f08e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f100d3031640309 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:48.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.768+0000 7f08f1ffb700 1 -- 172.21.15.60:0/1882003091 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e400b860 con 0x7f08f4159320 2023-10-06T04:31:48.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.768+0000 7f08f1ffb700 1 -- 172.21.15.60:0/1882003091 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e400b9c0 con 0x7f08f4159320 2023-10-06T04:31:48.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.768+0000 7f08f1ffb700 1 -- 172.21.15.60:0/1882003091 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e400bd60 con 0x7f08f4159320 2023-10-06T04:31:48.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.768+0000 7f08f3fff700 1 -- 172.21.15.60:0/1882003091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f4159320 msgr2=0x7f08f40cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:48.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.768+0000 7f08f3fff700 1 --2- 172.21.15.60:0/1882003091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f4159320 0x7f08f40cc090 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f08e40099b0 tx=0x7f08e4009250 comp rx=0 tx=0).stop 2023-10-06T04:31:48.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.768+0000 7f08f3fff700 1 -- 172.21.15.60:0/1882003091 shutdown_connections 2023-10-06T04:31:48.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.768+0000 7f08f3fff700 1 --2- 172.21.15.60:0/1882003091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f4159320 0x7f08f40cc090 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:48.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.768+0000 7f08f3fff700 1 -- 172.21.15.60:0/1882003091 >> 172.21.15.60:0/1882003091 conn(0x7f08f40c91a0 msgr2=0x7f08f40c95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:48.771 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.769+0000 7f08f3fff700 1 -- 172.21.15.60:0/1882003091 shutdown_connections 2023-10-06T04:31:48.772 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.769+0000 7f08f3fff700 1 -- 172.21.15.60:0/1882003091 wait complete. 2023-10-06T04:31:48.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.770+0000 7f08f3fff700 1 Processor -- start 2023-10-06T04:31:48.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.770+0000 7f08f3fff700 1 -- start start 2023-10-06T04:31:48.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.771+0000 7f08f3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f4159320 0x7f08f414a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:48.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.771+0000 7f08f3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08f415cfb0 0x7f08f40b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:48.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.771+0000 7f08f3fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08f415db60 0x7f08f40aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:48.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.771+0000 7f08f3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f415c690 con 0x7f08f4159320 2023-10-06T04:31:48.775 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.771+0000 7f08f3fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f414a7e0 con 0x7f08f415cfb0 2023-10-06T04:31:48.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.771+0000 7f08f3fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f415c0d0 con 0x7f08f415db60 2023-10-06T04:31:48.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.771+0000 7f08f2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f4159320 0x7f08f414a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:48.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.771+0000 7f08f2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f4159320 0x7f08f414a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42632/0 (socket says 172.21.15.60:42632) 2023-10-06T04:31:48.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.771+0000 7f08f2ffd700 1 -- 172.21.15.60:0/1412756871 learned_addr learned my addr 172.21.15.60:0/1412756871 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:48.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.771+0000 7f08f37fe700 1 --2- 172.21.15.60:0/1412756871 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08f415db60 0x7f08f40aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:48.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.771+0000 7f08f27fc700 1 --2- 172.21.15.60:0/1412756871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08f415cfb0 0x7f08f40b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:48.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.772+0000 7f08f2ffd700 1 -- 172.21.15.60:0/1412756871 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08f415db60 msgr2=0x7f08f40aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:48.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.772+0000 7f08f2ffd700 1 --2- 172.21.15.60:0/1412756871 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08f415db60 0x7f08f40aa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:48.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.772+0000 7f08f2ffd700 1 -- 172.21.15.60:0/1412756871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08f415cfb0 msgr2=0x7f08f40b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:48.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.772+0000 7f08f2ffd700 1 --2- 172.21.15.60:0/1412756871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08f415cfb0 0x7f08f40b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:48.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.772+0000 7f08f2ffd700 1 -- 172.21.15.60:0/1412756871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e40094f0 con 0x7f08f4159320 2023-10-06T04:31:48.776 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.772+0000 7f08f27fc700 1 --2- 172.21.15.60:0/1412756871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08f415cfb0 0x7f08f40b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:31:48.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.772+0000 7f08f2ffd700 1 --2- 172.21.15.60:0/1412756871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f4159320 0x7f08f414a2a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f08e4006f50 tx=0x7f08e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:48.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.772+0000 7f08daffd700 1 -- 172.21.15.60:0/1412756871 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e401f070 con 0x7f08f4159320 2023-10-06T04:31:48.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.772+0000 7f08daffd700 1 -- 172.21.15.60:0/1412756871 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e4011c60 con 0x7f08f4159320 2023-10-06T04:31:48.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.772+0000 7f08daffd700 1 -- 172.21.15.60:0/1412756871 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e4025420 con 0x7f08f4159320 2023-10-06T04:31:48.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.772+0000 7f08f3fff700 1 -- 172.21.15.60:0/1412756871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f415c3b0 con 0x7f08f4159320 2023-10-06T04:31:48.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.773+0000 7f08f3fff700 1 -- 172.21.15.60:0/1412756871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f40afa70 con 0x7f08f4159320 2023-10-06T04:31:48.777 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.773+0000 7f08f3fff700 1 -- 172.21.15.60:0/1412756871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f40af5f0 con 0x7f08f4159320 2023-10-06T04:31:48.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.774+0000 7f08daffd700 1 -- 172.21.15.60:0/1412756871 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f08e4023070 con 0x7f08f4159320 2023-10-06T04:31:48.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.775+0000 7f08daffd700 1 --2- 172.21.15.60:0/1412756871 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f08e0066f30 0x7f08e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:48.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.776+0000 7f08daffd700 1 -- 172.21.15.60:0/1412756871 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6436+0+0 (secure 0 0 0) 0x7f08e40859a0 con 0x7f08f4159320 2023-10-06T04:31:48.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.776+0000 7f08f27fc700 1 --2- 172.21.15.60:0/1412756871 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f08e0066f30 0x7f08e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:48.778 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.776+0000 7f08f27fc700 1 --2- 172.21.15.60:0/1412756871 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f08e0066f30 0x7f08e00693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f08e80011e0 tx=0x7f08e8007c70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:48.781 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:48.780+0000 7f08daffd700 1 -- 172.21.15.60:0/1412756871 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08f40af5f0 con 0x7f08f4159320 2023-10-06T04:31:49.029 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.028+0000 7f08f3fff700 1 -- 172.21.15.60:0/1412756871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f08f40af5f0 con 0x7f08f4159320 2023-10-06T04:31:49.029 INFO:tasks.ceph.mon.a.smithi060.stderr:2023-10-06T04:31:49.028+0000 7f7860df1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T04:31:49.034 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.032+0000 7f08daffd700 1 -- 172.21.15.60:0/1412756871 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f08f40af5f0 con 0x7f08f4159320 2023-10-06T04:31:49.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.036+0000 7f08f3fff700 1 -- 172.21.15.60:0/1412756871 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f08e0066f30 msgr2=0x7f08e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:49.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.036+0000 7f08f3fff700 1 --2- 172.21.15.60:0/1412756871 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f08e0066f30 0x7f08e00693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f08e80011e0 tx=0x7f08e8007c70 comp rx=0 tx=0).stop 2023-10-06T04:31:49.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.036+0000 7f08f3fff700 1 -- 172.21.15.60:0/1412756871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f4159320 msgr2=0x7f08f414a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:49.037 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.036+0000 7f08f3fff700 1 --2- 172.21.15.60:0/1412756871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f4159320 0x7f08f414a2a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f08e4006f50 tx=0x7f08e4017000 comp rx=0 tx=0).stop 2023-10-06T04:31:49.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.036+0000 7f08f3fff700 1 -- 172.21.15.60:0/1412756871 shutdown_connections 2023-10-06T04:31:49.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.036+0000 7f08f3fff700 1 --2- 172.21.15.60:0/1412756871 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f08e0066f30 0x7f08e00693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:49.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.036+0000 7f08f3fff700 1 --2- 172.21.15.60:0/1412756871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08f4159320 0x7f08f414a2a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:49.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.036+0000 7f08f3fff700 1 --2- 172.21.15.60:0/1412756871 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08f415db60 0x7f08f40aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:49.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.036+0000 7f08f3fff700 1 --2- 172.21.15.60:0/1412756871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08f415cfb0 0x7f08f40b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:49.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.036+0000 7f08f3fff700 1 -- 172.21.15.60:0/1412756871 >> 172.21.15.60:0/1412756871 conn(0x7f08f40c91a0 msgr2=0x7f08f415d450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:49.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.036+0000 7f08f3fff700 1 -- 172.21.15.60:0/1412756871 shutdown_connections 2023-10-06T04:31:49.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.036+0000 7f08f3fff700 1 -- 172.21.15.60:0/1412756871 wait complete. 2023-10-06T04:31:49.038 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T04:31:49.064 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T04:31:49.109 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2023-10-06T04:31:49.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.255+0000 7f4f3c9fe700 1 Processor -- start 2023-10-06T04:31:49.257 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.256+0000 7f4f3c9fe700 1 -- start start 2023-10-06T04:31:49.259 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.257+0000 7f4f3c9fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4f38155fc0 0x7f4f380c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:49.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.257+0000 7f4f3c9fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f3806e160 0x7f4f3806e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:49.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.257+0000 7f4f3c9fe700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f380ad610 con 0x7f4f380affe0 2023-10-06T04:31:49.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.257+0000 7f4f3c9fe700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f380c8ef0 con 0x7f4f38155fc0 2023-10-06T04:31:49.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.257+0000 7f4f3c9fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3806eaf0 con 0x7f4f3806e160 2023-10-06T04:31:49.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.257+0000 7f4f36d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4f38155fc0 0x7f4f380c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:49.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.257+0000 7f4f36d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4f38155fc0 0x7f4f380c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42664/0 (socket says 172.21.15.60:42664) 2023-10-06T04:31:49.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.257+0000 7f4f3759e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4f380affe0 0x7f4f380b0420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46666/0 (socket says 172.21.15.60:46666) 2023-10-06T04:31:49.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.257+0000 7f4f36d9d700 1 -- 172.21.15.60:0/545695205 learned_addr learned my addr 172.21.15.60:0/545695205 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:49.260 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.257+0000 7f4f3659c700 1 --2- 172.21.15.60:0/545695205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f3806e160 0x7f4f3806e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:49.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.258+0000 7f4f36d9d700 1 -- 172.21.15.60:0/545695205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f3806e160 msgr2=0x7f4f3806e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:49.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.258+0000 7f4f36d9d700 1 --2- 172.21.15.60:0/545695205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f3806e160 0x7f4f3806e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:49.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.258+0000 7f4f36d9d700 1 -- 172.21.15.60:0/545695205 >> v1:172.21.15.60:6789/0 conn(0x7f4f380affe0 legacy=0x7f4f380b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:49.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.258+0000 7f4f36d9d700 1 -- 172.21.15.60:0/545695205 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f380b0b30 con 0x7f4f38155fc0 2023-10-06T04:31:49.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.258+0000 7f4f35d9b700 1 -- 172.21.15.60:0/545695205 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659708888 0 0) 0x7f4f380ad610 con 0x7f4f380affe0 2023-10-06T04:31:49.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.258+0000 7f4f36d9d700 1 --2- 172.21.15.60:0/545695205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f38155fc0 0x7f4f380c89b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4f280099b0 tx=0x7f4f28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60035b9978d96ff4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:49.261 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.258+0000 7f4f35d9b700 1 -- 172.21.15.60:0/545695205 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f28009ea0 con 0x7f4f38155fc0 2023-10-06T04:31:49.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.258+0000 7f4f35d9b700 1 -- 172.21.15.60:0/545695205 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2800b8f0 con 0x7f4f38155fc0 2023-10-06T04:31:49.262 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.258+0000 7f4f35d9b700 1 -- 172.21.15.60:0/545695205 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2800bc90 con 0x7f4f38155fc0 2023-10-06T04:31:49.266 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.259+0000 7f4f3c9fe700 1 -- 172.21.15.60:0/545695205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f38155fc0 msgr2=0x7f4f380c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:49.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.259+0000 7f4f3c9fe700 1 --2- 172.21.15.60:0/545695205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f38155fc0 0x7f4f380c89b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4f280099b0 tx=0x7f4f28009250 comp rx=0 tx=0).stop 2023-10-06T04:31:49.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.259+0000 7f4f3c9fe700 1 -- 172.21.15.60:0/545695205 shutdown_connections 2023-10-06T04:31:49.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.259+0000 7f4f3c9fe700 1 --2- 172.21.15.60:0/545695205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f38155fc0 0x7f4f380c89b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:49.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.259+0000 7f4f3c9fe700 1 --2- 172.21.15.60:0/545695205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f3806e160 0x7f4f3806e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:49.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.259+0000 7f4f3c9fe700 1 -- 172.21.15.60:0/545695205 >> 172.21.15.60:0/545695205 conn(0x7f4f380cbe90 msgr2=0x7f4f380cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:49.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.259+0000 7f4f3c9fe700 1 -- 172.21.15.60:0/545695205 shutdown_connections 2023-10-06T04:31:49.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.259+0000 7f4f3c9fe700 1 -- 172.21.15.60:0/545695205 wait complete. 2023-10-06T04:31:49.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.260+0000 7f4f3c9fe700 1 Processor -- start 2023-10-06T04:31:49.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.260+0000 7f4f3c9fe700 1 -- start start 2023-10-06T04:31:49.267 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.261+0000 7f4f3c9fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f3806e160 0x7f4f380aaa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:49.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.261+0000 7f4f3c9fe700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f380affe0 0x7f4f3814fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:49.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.261+0000 7f4f3c9fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f38155fc0 0x7f4f38150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:49.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.261+0000 7f4f3c9fe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3815b090 con 0x7f4f38155fc0 2023-10-06T04:31:49.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.261+0000 7f4f3c9fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3815b370 con 0x7f4f3806e160 2023-10-06T04:31:49.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.261+0000 7f4f3c9fe700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3815b650 con 0x7f4f380affe0 2023-10-06T04:31:49.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.262+0000 7f4f3759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f38155fc0 0x7f4f38150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:49.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.262+0000 7f4f3759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f38155fc0 0x7f4f38150110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42678/0 (socket says 172.21.15.60:42678) 2023-10-06T04:31:49.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.262+0000 7f4f3759e700 1 -- 172.21.15.60:0/1322496020 learned_addr learned my addr 172.21.15.60:0/1322496020 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:49.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.262+0000 7f4f3659c700 1 --2- 172.21.15.60:0/1322496020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f380affe0 0x7f4f3814fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:49.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.262+0000 7f4f36d9d700 1 --2- 172.21.15.60:0/1322496020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f3806e160 0x7f4f380aaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:49.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.262+0000 7f4f3759e700 1 -- 172.21.15.60:0/1322496020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f380affe0 msgr2=0x7f4f3814fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:49.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.262+0000 7f4f3759e700 1 --2- 172.21.15.60:0/1322496020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f380affe0 0x7f4f3814fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:49.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.262+0000 7f4f3759e700 1 -- 172.21.15.60:0/1322496020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f3806e160 msgr2=0x7f4f380aaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:49.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.262+0000 7f4f3759e700 1 --2- 172.21.15.60:0/1322496020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f3806e160 0x7f4f380aaa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:49.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.262+0000 7f4f3759e700 1 -- 172.21.15.60:0/1322496020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f280094f0 con 0x7f4f38155fc0 2023-10-06T04:31:49.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.262+0000 7f4f3759e700 1 --2- 172.21.15.60:0/1322496020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f38155fc0 0x7f4f38150110 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4f3000cd50 tx=0x7f4f30001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:49.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.262+0000 7f4f1effd700 1 -- 172.21.15.60:0/1322496020 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f30005df0 con 0x7f4f38155fc0 2023-10-06T04:31:49.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.263+0000 7f4f1effd700 1 -- 172.21.15.60:0/1322496020 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3000a8b0 con 0x7f4f38155fc0 2023-10-06T04:31:49.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.263+0000 7f4f3c9fe700 1 -- 172.21.15.60:0/1322496020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3815b930 con 0x7f4f38155fc0 2023-10-06T04:31:49.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.263+0000 7f4f1effd700 1 -- 172.21.15.60:0/1322496020 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3000ac70 con 0x7f4f38155fc0 2023-10-06T04:31:49.269 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.263+0000 7f4f3c9fe700 1 -- 172.21.15.60:0/1322496020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3815bef0 con 0x7f4f38155fc0 2023-10-06T04:31:49.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.264+0000 7f4f3c9fe700 1 -- 172.21.15.60:0/1322496020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3815c110 con 0x7f4f38155fc0 2023-10-06T04:31:49.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.264+0000 7f4f1effd700 1 -- 172.21.15.60:0/1322496020 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f30007300 con 0x7f4f38155fc0 2023-10-06T04:31:49.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.265+0000 7f4f1effd700 1 --2- 172.21.15.60:0/1322496020 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4f24066f30 0x7f4f240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:49.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.265+0000 7f4f1effd700 1 -- 172.21.15.60:0/1322496020 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f4f30084970 con 0x7f4f38155fc0 2023-10-06T04:31:49.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.266+0000 7f4f36d9d700 1 --2- 172.21.15.60:0/1322496020 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4f24066f30 0x7f4f240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:49.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.266+0000 7f4f36d9d700 1 --2- 172.21.15.60:0/1322496020 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4f24066f30 0x7f4f240693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4f280099b0 tx=0x7f4f28017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:49.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.270+0000 7f4f1effd700 1 -- 172.21.15.60:0/1322496020 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f30051890 con 0x7f4f38155fc0 2023-10-06T04:31:49.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:49.520+0000 7f4f3c9fe700 1 -- 172.21.15.60:0/1322496020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4f3805f230 con 0x7f4f38155fc0 2023-10-06T04:31:50.038 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.037+0000 7f4f1effd700 1 -- 172.21.15.60:0/1322496020 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4f30054eb0 con 0x7f4f38155fc0 2023-10-06T04:31:50.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.039+0000 7f4f3c9fe700 1 -- 172.21.15.60:0/1322496020 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4f24066f30 msgr2=0x7f4f240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:50.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.039+0000 7f4f3c9fe700 1 --2- 172.21.15.60:0/1322496020 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4f24066f30 0x7f4f240693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4f280099b0 tx=0x7f4f28017000 comp rx=0 tx=0).stop 2023-10-06T04:31:50.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.039+0000 7f4f3c9fe700 1 -- 172.21.15.60:0/1322496020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f38155fc0 msgr2=0x7f4f38150110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:50.042 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.039+0000 7f4f3c9fe700 1 --2- 172.21.15.60:0/1322496020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f38155fc0 0x7f4f38150110 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4f3000cd50 tx=0x7f4f30001b10 comp rx=0 tx=0).stop 2023-10-06T04:31:50.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.039+0000 7f4f3c9fe700 1 -- 172.21.15.60:0/1322496020 shutdown_connections 2023-10-06T04:31:50.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.040+0000 7f4f3c9fe700 1 --2- 172.21.15.60:0/1322496020 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4f24066f30 0x7f4f240693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:50.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.040+0000 7f4f3c9fe700 1 --2- 172.21.15.60:0/1322496020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f38155fc0 0x7f4f38150110 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:50.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.040+0000 7f4f3c9fe700 1 --2- 172.21.15.60:0/1322496020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f3806e160 0x7f4f380aaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:50.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.040+0000 7f4f3c9fe700 1 --2- 172.21.15.60:0/1322496020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4f380affe0 0x7f4f3814fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:50.043 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.040+0000 7f4f3c9fe700 1 -- 172.21.15.60:0/1322496020 >> 172.21.15.60:0/1322496020 conn(0x7f4f380cbe90 msgr2=0x7f4f38069080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:50.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.040+0000 7f4f3c9fe700 1 -- 172.21.15.60:0/1322496020 shutdown_connections 2023-10-06T04:31:50.044 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.040+0000 7f4f3c9fe700 1 -- 172.21.15.60:0/1322496020 wait complete. 2023-10-06T04:31:50.061 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T04:31:50.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.291+0000 7f0c54f9d700 1 Processor -- start 2023-10-06T04:31:50.292 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.291+0000 7f0c54f9d700 1 -- start start 2023-10-06T04:31:50.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.292+0000 7f0c54f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0c500b5e10 0x7f0c500b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:50.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.292+0000 7f0c54f9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c500b4160 0x7f0c500b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:50.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.292+0000 7f0c54f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c500cff80 con 0x7f0c501592f0 2023-10-06T04:31:50.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.292+0000 7f0c54f9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c500afb70 con 0x7f0c500b4160 2023-10-06T04:31:50.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.292+0000 7f0c54f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c500b4550 con 0x7f0c500b5e10 2023-10-06T04:31:50.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.292+0000 7f0c4ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c500b4160 0x7f0c500b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:50.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.293+0000 7f0c4ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c500b4160 0x7f0c500b0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42694/0 (socket says 172.21.15.60:42694) 2023-10-06T04:31:50.294 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.293+0000 7f0c4ffff700 1 -- 172.21.15.60:0/3308237184 learned_addr learned my addr 172.21.15.60:0/3308237184 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:50.295 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.293+0000 7f0c4effd700 1 --2- 172.21.15.60:0/3308237184 >> v2:172.21.15.135:3300/0 conn(0x7f0c500b5e10 0x7f0c500b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:50.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.293+0000 7f0c4ffff700 1 -- 172.21.15.60:0/3308237184 >> v2:172.21.15.135:3300/0 conn(0x7f0c500b5e10 msgr2=0x7f0c500b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:50.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.293+0000 7f0c4ffff700 1 --2- 172.21.15.60:0/3308237184 >> v2:172.21.15.135:3300/0 conn(0x7f0c500b5e10 0x7f0c500b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:50.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.293+0000 7f0c4ffff700 1 -- 172.21.15.60:0/3308237184 >> v1:172.21.15.135:6789/0 conn(0x7f0c501592f0 legacy=0x7f0c500b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:50.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.293+0000 7f0c4ffff700 1 -- 172.21.15.60:0/3308237184 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c500afdc0 con 0x7f0c500b4160 2023-10-06T04:31:50.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.293+0000 7f0c4ffff700 1 --2- 172.21.15.60:0/3308237184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c500b4160 0x7f0c500b0b80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0c500b5d70 tx=0x7f0c48009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d404f50dd2d86a04 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:50.296 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.293+0000 7f0c4e7fc700 1 -- 172.21.15.60:0/3308237184 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4800e070 con 0x7f0c500b4160 2023-10-06T04:31:50.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.294+0000 7f0c4e7fc700 1 -- 172.21.15.60:0/3308237184 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4800ba20 con 0x7f0c500b4160 2023-10-06T04:31:50.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.294+0000 7f0c4e7fc700 1 -- 172.21.15.60:0/3308237184 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c480092e0 con 0x7f0c500b4160 2023-10-06T04:31:50.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.294+0000 7f0c54f9d700 1 -- 172.21.15.60:0/3308237184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c500b4160 msgr2=0x7f0c500b0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:50.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.294+0000 7f0c54f9d700 1 --2- 172.21.15.60:0/3308237184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c500b4160 0x7f0c500b0b80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0c500b5d70 tx=0x7f0c48009840 comp rx=0 tx=0).stop 2023-10-06T04:31:50.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.294+0000 7f0c54f9d700 1 -- 172.21.15.60:0/3308237184 shutdown_connections 2023-10-06T04:31:50.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.294+0000 7f0c54f9d700 1 --2- 172.21.15.60:0/3308237184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c500b4160 0x7f0c500b0b80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:50.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.294+0000 7f0c54f9d700 1 --2- 172.21.15.60:0/3308237184 >> v2:172.21.15.135:3300/0 conn(0x7f0c500b5e10 0x7f0c500b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:50.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.294+0000 7f0c54f9d700 1 -- 172.21.15.60:0/3308237184 >> 172.21.15.60:0/3308237184 conn(0x7f0c500994e0 msgr2=0x7f0c5006f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:50.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.294+0000 7f0c54f9d700 1 -- 172.21.15.60:0/3308237184 shutdown_connections 2023-10-06T04:31:50.297 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.294+0000 7f0c54f9d700 1 -- 172.21.15.60:0/3308237184 wait complete. 2023-10-06T04:31:50.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.296+0000 7f0c54f9d700 1 Processor -- start 2023-10-06T04:31:50.299 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.296+0000 7f0c54f9d700 1 -- start start 2023-10-06T04:31:50.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.297+0000 7f0c54f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c500b4160 0x7f0c5016d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:50.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.297+0000 7f0c54f9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c500b5e10 0x7f0c50150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:50.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.297+0000 7f0c54f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c501592f0 0x7f0c50157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:50.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.297+0000 7f0c54f9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5009de30 con 0x7f0c500b5e10 2023-10-06T04:31:50.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.297+0000 7f0c54f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5009c430 con 0x7f0c501592f0 2023-10-06T04:31:50.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.297+0000 7f0c54f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5016d030 con 0x7f0c500b4160 2023-10-06T04:31:50.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.297+0000 7f0c4effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c500b5e10 0x7f0c50150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:50.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.297+0000 7f0c4effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c500b5e10 0x7f0c50150750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42710/0 (socket says 172.21.15.60:42710) 2023-10-06T04:31:50.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.297+0000 7f0c4effd700 1 -- 172.21.15.60:0/3774967448 learned_addr learned my addr 172.21.15.60:0/3774967448 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:50.300 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.297+0000 7f0c4ffff700 1 --2- 172.21.15.60:0/3774967448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c501592f0 0x7f0c50157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:50.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.297+0000 7f0c4f7fe700 1 --2- 172.21.15.60:0/3774967448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c500b4160 0x7f0c5016d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:50.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.297+0000 7f0c4effd700 1 -- 172.21.15.60:0/3774967448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c500b4160 msgr2=0x7f0c5016d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:50.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.297+0000 7f0c4effd700 1 --2- 172.21.15.60:0/3774967448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c500b4160 0x7f0c5016d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:50.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.297+0000 7f0c4effd700 1 -- 172.21.15.60:0/3774967448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c501592f0 msgr2=0x7f0c50157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:50.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.297+0000 7f0c4effd700 1 --2- 172.21.15.60:0/3774967448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c501592f0 0x7f0c50157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:50.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.297+0000 7f0c4effd700 1 -- 172.21.15.60:0/3774967448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c48009ae0 con 0x7f0c500b5e10 2023-10-06T04:31:50.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.298+0000 7f0c4effd700 1 --2- 172.21.15.60:0/3774967448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c500b5e10 0x7f0c50150750 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400ec80 tx=0x7f0c440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:50.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.298+0000 7f0c377fe700 1 -- 172.21.15.60:0/3774967448 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4400c9d0 con 0x7f0c500b5e10 2023-10-06T04:31:50.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.298+0000 7f0c377fe700 1 -- 172.21.15.60:0/3774967448 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4400cb30 con 0x7f0c500b5e10 2023-10-06T04:31:50.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.298+0000 7f0c54f9d700 1 -- 172.21.15.60:0/3774967448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c5016ca20 con 0x7f0c500b5e10 2023-10-06T04:31:50.301 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.298+0000 7f0c377fe700 1 -- 172.21.15.60:0/3774967448 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44013470 con 0x7f0c500b5e10 2023-10-06T04:31:50.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.298+0000 7f0c54f9d700 1 -- 172.21.15.60:0/3774967448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5016ccc0 con 0x7f0c500b5e10 2023-10-06T04:31:50.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.299+0000 7f0c54f9d700 1 -- 172.21.15.60:0/3774967448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5016d1a0 con 0x7f0c500b5e10 2023-10-06T04:31:50.302 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.300+0000 7f0c377fe700 1 -- 172.21.15.60:0/3774967448 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c44013820 con 0x7f0c500b5e10 2023-10-06T04:31:50.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.301+0000 7f0c377fe700 1 --2- 172.21.15.60:0/3774967448 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0c3c066f30 0x7f0c3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:50.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.301+0000 7f0c377fe700 1 -- 172.21.15.60:0/3774967448 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f0c44084c90 con 0x7f0c500b5e10 2023-10-06T04:31:50.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.301+0000 7f0c4f7fe700 1 --2- 172.21.15.60:0/3774967448 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0c3c066f30 0x7f0c3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:50.303 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.302+0000 7f0c4f7fe700 1 --2- 172.21.15.60:0/3774967448 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0c3c066f30 0x7f0c3c0693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0c40000c00 tx=0x7f0c40009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:50.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.305+0000 7f0c377fe700 1 -- 172.21.15.60:0/3774967448 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c44051b30 con 0x7f0c500b5e10 2023-10-06T04:31:50.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:50.507+0000 7f0c54f9d700 1 -- 172.21.15.60:0/3774967448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0c5005f230 con 0x7f0c500b5e10 2023-10-06T04:31:51.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.395+0000 7f0c377fe700 1 -- 172.21.15.60:0/3774967448 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0c44055150 con 0x7f0c500b5e10 2023-10-06T04:31:51.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.400+0000 7f0c54f9d700 1 -- 172.21.15.60:0/3774967448 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0c3c066f30 msgr2=0x7f0c3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:51.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.400+0000 7f0c54f9d700 1 --2- 172.21.15.60:0/3774967448 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0c3c066f30 0x7f0c3c0693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0c40000c00 tx=0x7f0c40009040 comp rx=0 tx=0).stop 2023-10-06T04:31:51.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.400+0000 7f0c54f9d700 1 -- 172.21.15.60:0/3774967448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c500b5e10 msgr2=0x7f0c50150750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:51.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.400+0000 7f0c54f9d700 1 --2- 172.21.15.60:0/3774967448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c500b5e10 0x7f0c50150750 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400ec80 tx=0x7f0c440091a0 comp rx=0 tx=0).stop 2023-10-06T04:31:51.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.400+0000 7f0c54f9d700 1 -- 172.21.15.60:0/3774967448 shutdown_connections 2023-10-06T04:31:51.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.400+0000 7f0c54f9d700 1 --2- 172.21.15.60:0/3774967448 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0c3c066f30 0x7f0c3c0693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:51.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.400+0000 7f0c54f9d700 1 --2- 172.21.15.60:0/3774967448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c501592f0 0x7f0c50157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:51.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.400+0000 7f0c54f9d700 1 --2- 172.21.15.60:0/3774967448 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0c500b4160 0x7f0c5016d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:51.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.400+0000 7f0c54f9d700 1 --2- 172.21.15.60:0/3774967448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c500b5e10 0x7f0c50150750 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:51.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.400+0000 7f0c54f9d700 1 -- 172.21.15.60:0/3774967448 >> 172.21.15.60:0/3774967448 conn(0x7f0c500994e0 msgr2=0x7f0c50068210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:51.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.401+0000 7f0c54f9d700 1 -- 172.21.15.60:0/3774967448 shutdown_connections 2023-10-06T04:31:51.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.401+0000 7f0c54f9d700 1 -- 172.21.15.60:0/3774967448 wait complete. 2023-10-06T04:31:51.403 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2023-10-06T04:31:51.425 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T04:31:51.620 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.619+0000 7fb65899d700 1 Processor -- start 2023-10-06T04:31:51.621 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.619+0000 7fb65899d700 1 -- start start 2023-10-06T04:31:51.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.620+0000 7fb65899d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb6541592f0 0x7fb6540b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:51.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.620+0000 7fb65899d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb6540b5e10 0x7fb6540b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:51.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.620+0000 7fb65899d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6540cff80 con 0x7fb6540b4160 2023-10-06T04:31:51.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.620+0000 7fb65899d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6540afb70 con 0x7fb6540b5e10 2023-10-06T04:31:51.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.620+0000 7fb65899d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6540b2ae0 con 0x7fb6541592f0 2023-10-06T04:31:51.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.621+0000 7fb652ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb6540b5e10 0x7fb6540b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:51.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.621+0000 7fb652ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb6540b5e10 0x7fb6540b3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42724/0 (socket says 172.21.15.60:42724) 2023-10-06T04:31:51.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.621+0000 7fb652ffd700 1 -- 172.21.15.60:0/1315402411 learned_addr learned my addr 172.21.15.60:0/1315402411 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:51.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.621+0000 7fb652ffd700 1 -- 172.21.15.60:0/1315402411 >> v2:172.21.15.135:3300/0 conn(0x7fb6541592f0 msgr2=0x7fb6540b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:51.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.621+0000 7fb6537fe700 1 --2- 172.21.15.60:0/1315402411 >> v2:172.21.15.135:3300/0 conn(0x7fb6541592f0 0x7fb6540b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:51.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.621+0000 7fb652ffd700 1 --2- 172.21.15.60:0/1315402411 >> v2:172.21.15.135:3300/0 conn(0x7fb6541592f0 0x7fb6540b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:51.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.621+0000 7fb652ffd700 1 -- 172.21.15.60:0/1315402411 >> v1:172.21.15.135:6789/0 conn(0x7fb6540b4160 legacy=0x7fb6540b0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:51.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.621+0000 7fb652ffd700 1 -- 172.21.15.60:0/1315402411 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6540b4550 con 0x7fb6540b5e10 2023-10-06T04:31:51.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.621+0000 7fb6537fe700 1 --2- 172.21.15.60:0/1315402411 >> v2:172.21.15.135:3300/0 conn(0x7fb6541592f0 0x7fb6540b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:31:51.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.621+0000 7fb652ffd700 1 --2- 172.21.15.60:0/1315402411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6540b5e10 0x7fb6540b3c20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb654089090 tx=0x7fb648009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70298729ac2d09ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:51.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.622+0000 7fb6527fc700 1 -- 172.21.15.60:0/1315402411 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64800b820 con 0x7fb6540b5e10 2023-10-06T04:31:51.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.622+0000 7fb6527fc700 1 -- 172.21.15.60:0/1315402411 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64800b980 con 0x7fb6540b5e10 2023-10-06T04:31:51.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.622+0000 7fb6527fc700 1 -- 172.21.15.60:0/1315402411 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64800bd20 con 0x7fb6540b5e10 2023-10-06T04:31:51.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.622+0000 7fb65899d700 1 -- 172.21.15.60:0/1315402411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6540b5e10 msgr2=0x7fb6540b3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:51.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.622+0000 7fb65899d700 1 --2- 172.21.15.60:0/1315402411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6540b5e10 0x7fb6540b3c20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb654089090 tx=0x7fb648009250 comp rx=0 tx=0).stop 2023-10-06T04:31:51.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.622+0000 7fb65899d700 1 -- 172.21.15.60:0/1315402411 shutdown_connections 2023-10-06T04:31:51.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.622+0000 7fb65899d700 1 --2- 172.21.15.60:0/1315402411 >> v2:172.21.15.135:3300/0 conn(0x7fb6541592f0 0x7fb6540b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:51.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.622+0000 7fb65899d700 1 --2- 172.21.15.60:0/1315402411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6540b5e10 0x7fb6540b3c20 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:51.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.622+0000 7fb65899d700 1 -- 172.21.15.60:0/1315402411 >> 172.21.15.60:0/1315402411 conn(0x7fb6540994e0 msgr2=0x7fb65406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:51.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.622+0000 7fb65899d700 1 -- 172.21.15.60:0/1315402411 shutdown_connections 2023-10-06T04:31:51.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.622+0000 7fb65899d700 1 -- 172.21.15.60:0/1315402411 wait complete. 2023-10-06T04:31:51.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.624+0000 7fb65899d700 1 Processor -- start 2023-10-06T04:31:51.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.624+0000 7fb65899d700 1 -- start start 2023-10-06T04:31:51.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.625+0000 7fb65899d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6540b4160 0x7fb65416a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:51.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.625+0000 7fb65899d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6540b5e10 0x7fb65416a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:51.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.625+0000 7fb65899d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6541592f0 0x7fb654154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:51.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.625+0000 7fb65899d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65416a610 con 0x7fb6541592f0 2023-10-06T04:31:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.625+0000 7fb65899d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65416ad70 con 0x7fb6540b4160 2023-10-06T04:31:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.625+0000 7fb65899d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65409d910 con 0x7fb6540b5e10 2023-10-06T04:31:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.625+0000 7fb653fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6541592f0 0x7fb654154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.625+0000 7fb653fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6541592f0 0x7fb654154e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42732/0 (socket says 172.21.15.60:42732) 2023-10-06T04:31:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.625+0000 7fb653fff700 1 -- 172.21.15.60:0/2150283998 learned_addr learned my addr 172.21.15.60:0/2150283998 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.625+0000 7fb6537fe700 1 --2- 172.21.15.60:0/2150283998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6540b4160 0x7fb65416a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.625+0000 7fb652ffd700 1 --2- 172.21.15.60:0/2150283998 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6540b5e10 0x7fb65416a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.625+0000 7fb653fff700 1 -- 172.21.15.60:0/2150283998 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6540b5e10 msgr2=0x7fb65416a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.625+0000 7fb653fff700 1 --2- 172.21.15.60:0/2150283998 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6540b5e10 0x7fb65416a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.625+0000 7fb653fff700 1 -- 172.21.15.60:0/2150283998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6540b4160 msgr2=0x7fb65416a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.625+0000 7fb653fff700 1 --2- 172.21.15.60:0/2150283998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6540b4160 0x7fb65416a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:51.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.625+0000 7fb653fff700 1 -- 172.21.15.60:0/2150283998 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6480094f0 con 0x7fb6541592f0 2023-10-06T04:31:51.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.626+0000 7fb653fff700 1 --2- 172.21.15.60:0/2150283998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6541592f0 0x7fb654154e90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb64c00c960 tx=0x7fb64c0026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:51.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.626+0000 7fb63b7fe700 1 -- 172.21.15.60:0/2150283998 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c00cea0 con 0x7fb6541592f0 2023-10-06T04:31:51.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.626+0000 7fb63b7fe700 1 -- 172.21.15.60:0/2150283998 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64c00a7a0 con 0x7fb6541592f0 2023-10-06T04:31:51.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.626+0000 7fb63b7fe700 1 -- 172.21.15.60:0/2150283998 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c00ab40 con 0x7fb6541592f0 2023-10-06T04:31:51.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.626+0000 7fb65899d700 1 -- 172.21.15.60:0/2150283998 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6540c5180 con 0x7fb6541592f0 2023-10-06T04:31:51.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.626+0000 7fb65899d700 1 -- 172.21.15.60:0/2150283998 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6540c5420 con 0x7fb6541592f0 2023-10-06T04:31:51.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.627+0000 7fb65899d700 1 -- 172.21.15.60:0/2150283998 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65405f230 con 0x7fb6541592f0 2023-10-06T04:31:51.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.628+0000 7fb63b7fe700 1 -- 172.21.15.60:0/2150283998 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb64c012420 con 0x7fb6541592f0 2023-10-06T04:31:51.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.629+0000 7fb63b7fe700 1 --2- 172.21.15.60:0/2150283998 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb640066f30 0x7fb6400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:51.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.629+0000 7fb63b7fe700 1 -- 172.21.15.60:0/2150283998 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6084+0+0 (secure 0 0 0) 0x7fb64c084a90 con 0x7fb6541592f0 2023-10-06T04:31:51.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.629+0000 7fb6537fe700 1 --2- 172.21.15.60:0/2150283998 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb640066f30 0x7fb6400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:51.631 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.630+0000 7fb6537fe700 1 --2- 172.21.15.60:0/2150283998 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb640066f30 0x7fb6400693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb644006fd0 tx=0x7fb644008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:51.635 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.634+0000 7fb63b7fe700 1 -- 172.21.15.60:0/2150283998 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb64c051ae0 con 0x7fb6541592f0 2023-10-06T04:31:51.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:51.835+0000 7fb65899d700 1 -- 172.21.15.60:0/2150283998 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb6540891d0 con 0x7fb6541592f0 2023-10-06T04:31:52.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.400+0000 7fb63b7fe700 1 -- 172.21.15.60:0/2150283998 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb64c055100 con 0x7fb6541592f0 2023-10-06T04:31:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.404+0000 7fb65899d700 1 -- 172.21.15.60:0/2150283998 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb640066f30 msgr2=0x7fb6400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.404+0000 7fb65899d700 1 --2- 172.21.15.60:0/2150283998 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb640066f30 0x7fb6400693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb644006fd0 tx=0x7fb644008040 comp rx=0 tx=0).stop 2023-10-06T04:31:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.404+0000 7fb65899d700 1 -- 172.21.15.60:0/2150283998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6541592f0 msgr2=0x7fb654154e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.404+0000 7fb65899d700 1 --2- 172.21.15.60:0/2150283998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6541592f0 0x7fb654154e90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb64c00c960 tx=0x7fb64c0026e0 comp rx=0 tx=0).stop 2023-10-06T04:31:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.404+0000 7fb65899d700 1 -- 172.21.15.60:0/2150283998 shutdown_connections 2023-10-06T04:31:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.404+0000 7fb65899d700 1 --2- 172.21.15.60:0/2150283998 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb640066f30 0x7fb6400693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.404+0000 7fb65899d700 1 --2- 172.21.15.60:0/2150283998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6541592f0 0x7fb654154e90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.404+0000 7fb65899d700 1 --2- 172.21.15.60:0/2150283998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6540b4160 0x7fb65416a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:52.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.404+0000 7fb65899d700 1 --2- 172.21.15.60:0/2150283998 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb6540b5e10 0x7fb65416a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:52.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.404+0000 7fb65899d700 1 -- 172.21.15.60:0/2150283998 >> 172.21.15.60:0/2150283998 conn(0x7fb6540994e0 msgr2=0x7fb654068320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:52.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.404+0000 7fb65899d700 1 -- 172.21.15.60:0/2150283998 shutdown_connections 2023-10-06T04:31:52.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.404+0000 7fb65899d700 1 -- 172.21.15.60:0/2150283998 wait complete. 2023-10-06T04:31:52.407 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2023-10-06T04:31:52.426 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T04:31:52.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.616+0000 7fa77239d700 1 Processor -- start 2023-10-06T04:31:52.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.616+0000 7fa77239d700 1 -- start start 2023-10-06T04:31:52.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.617+0000 7fa77239d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa76c0cf4e0 0x7fa76c0cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:52.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.617+0000 7fa77239d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76c0cf050 con 0x7fa76c15d960 2023-10-06T04:31:52.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.617+0000 7fa77239d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76c0ce440 con 0x7fa76c15d590 2023-10-06T04:31:52.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.617+0000 7fa77239d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0ce720 con 0x7fa76c0cf4e0 2023-10-06T04:31:52.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.618+0000 7fa771b9c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa76c15d960 0x7fa76c159260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46672/0 (socket says 172.21.15.60:46672) 2023-10-06T04:31:52.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.618+0000 7fa771b9c700 1 -- 172.21.15.60:0/4155113968 learned_addr learned my addr 172.21.15.60:0/4155113968 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:31:52.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.618+0000 7fa770b9a700 1 --2- 172.21.15.60:0/4155113968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa76c0cf4e0 0x7fa76c0cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:52.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.618+0000 7fa763fff700 1 -- 172.21.15.60:0/4155113968 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336107855 0 0) 0x7fa76c0cf050 con 0x7fa76c15d960 2023-10-06T04:31:52.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.618+0000 7fa763fff700 1 -- 172.21.15.60:0/4155113968 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa758003570 con 0x7fa76c15d960 2023-10-06T04:31:52.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.618+0000 7fa763fff700 1 -- 172.21.15.60:0/4155113968 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418242354 0 0) 0x7fa76c0ce440 con 0x7fa76c15d590 2023-10-06T04:31:52.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.618+0000 7fa763fff700 1 -- 172.21.15.60:0/4155113968 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa76c0cf050 con 0x7fa76c15d590 2023-10-06T04:31:52.622 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.618+0000 7fa763fff700 1 -- 172.21.15.60:0/4155113968 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 121970319 0 0) 0x7fa758003570 con 0x7fa76c15d960 2023-10-06T04:31:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.618+0000 7fa763fff700 1 -- 172.21.15.60:0/4155113968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa76c0cf4e0 msgr2=0x7fa76c0cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.618+0000 7fa763fff700 1 --2- 172.21.15.60:0/4155113968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa76c0cf4e0 0x7fa76c0cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.619+0000 7fa763fff700 1 -- 172.21.15.60:0/4155113968 >> v1:172.21.15.135:6789/0 conn(0x7fa76c15d590 legacy=0x7fa76c0cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.619+0000 7fa763fff700 1 -- 172.21.15.60:0/4155113968 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c0cea00 con 0x7fa76c15d960 2023-10-06T04:31:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.619+0000 7fa763fff700 1 -- 172.21.15.60:0/4155113968 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7fa7640017f0 con 0x7fa76c15d960 2023-10-06T04:31:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.619+0000 7fa763fff700 1 -- 172.21.15.60:0/4155113968 >> v1:172.21.15.60:6789/0 conn(0x7fa76c15d960 legacy=0x7fa76c159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.619+0000 7fa763fff700 1 --2- 172.21.15.60:0/4155113968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa758003c20 0x7fa758004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.619+0000 7fa763fff700 1 --2- 172.21.15.60:0/4155113968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa76c0cf4e0 0x7fa758004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.619+0000 7fa763fff700 1 --2- 172.21.15.60:0/4155113968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa758004d50 0x7fa7580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.619+0000 7fa763fff700 1 -- 172.21.15.60:0/4155113968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0ce720 con 0x7fa758004d50 2023-10-06T04:31:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.619+0000 7fa763fff700 1 -- 172.21.15.60:0/4155113968 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75800bbf0 con 0x7fa758003c20 2023-10-06T04:31:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.619+0000 7fa763fff700 1 -- 172.21.15.60:0/4155113968 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75800bd60 con 0x7fa76c0cf4e0 2023-10-06T04:31:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.619+0000 7fa771b9c700 1 --2- 172.21.15.60:0/4155113968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa758004d50 0x7fa7580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.619+0000 7fa77139b700 1 --2- 172.21.15.60:0/4155113968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa758003c20 0x7fa758004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.619+0000 7fa770b9a700 1 --2- 172.21.15.60:0/4155113968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa76c0cf4e0 0x7fa758004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.619+0000 7fa771b9c700 1 -- 172.21.15.60:0/4155113968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa76c0cf4e0 msgr2=0x7fa758004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.619+0000 7fa771b9c700 1 --2- 172.21.15.60:0/4155113968 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa76c0cf4e0 0x7fa758004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.619+0000 7fa771b9c700 1 -- 172.21.15.60:0/4155113968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa758003c20 msgr2=0x7fa758004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.619+0000 7fa771b9c700 1 --2- 172.21.15.60:0/4155113968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa758003c20 0x7fa758004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.619+0000 7fa771b9c700 1 -- 172.21.15.60:0/4155113968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa758003570 con 0x7fa758004d50 2023-10-06T04:31:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.620+0000 7fa771b9c700 1 --2- 172.21.15.60:0/4155113968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa758004d50 0x7fa7580051c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa76400a7d0 tx=0x7fa76c0cefc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aee00b9732d7c2c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.620+0000 7fa763fff700 1 -- 172.21.15.60:0/4155113968 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7640070d0 con 0x7fa758004d50 2023-10-06T04:31:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.620+0000 7fa763fff700 1 -- 172.21.15.60:0/4155113968 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa764007230 con 0x7fa758004d50 2023-10-06T04:31:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.620+0000 7fa763fff700 1 -- 172.21.15.60:0/4155113968 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7640075d0 con 0x7fa758004d50 2023-10-06T04:31:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.620+0000 7fa77239d700 1 -- 172.21.15.60:0/4155113968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa758004d50 msgr2=0x7fa7580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.620+0000 7fa77239d700 1 --2- 172.21.15.60:0/4155113968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa758004d50 0x7fa7580051c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa76400a7d0 tx=0x7fa76c0cefc0 comp rx=0 tx=0).stop 2023-10-06T04:31:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.620+0000 7fa771b9c700 1 -- 172.21.15.60:0/4155113968 reap_dead start 2023-10-06T04:31:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.621+0000 7fa77239d700 1 -- 172.21.15.60:0/4155113968 shutdown_connections 2023-10-06T04:31:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.621+0000 7fa77239d700 1 -- 172.21.15.60:0/4155113968 >> 172.21.15.60:0/4155113968 conn(0x7fa76c0994e0 msgr2=0x7fa76c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.621+0000 7fa77239d700 1 -- 172.21.15.60:0/4155113968 shutdown_connections 2023-10-06T04:31:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.621+0000 7fa77239d700 1 -- 172.21.15.60:0/4155113968 wait complete. 2023-10-06T04:31:52.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.622+0000 7fa77239d700 1 Processor -- start 2023-10-06T04:31:52.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.622+0000 7fa77239d700 1 -- start start 2023-10-06T04:31:52.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.623+0000 7fa77239d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa76c151d40 0x7fa76c0b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:52.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.623+0000 7fa77239d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa76c0c94b0 0x7fa76c153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:52.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.623+0000 7fa77239d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa76c153ab0 0x7fa76c0c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:52.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.623+0000 7fa77239d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c153f30 con 0x7fa76c151d40 2023-10-06T04:31:52.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.623+0000 7fa77239d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0ca240 con 0x7fa76c0c94b0 2023-10-06T04:31:52.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.623+0000 7fa77239d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0c9c80 con 0x7fa76c153ab0 2023-10-06T04:31:52.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.623+0000 7fa77139b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa76c151d40 0x7fa76c0b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:52.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.623+0000 7fa77139b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa76c151d40 0x7fa76c0b5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42756/0 (socket says 172.21.15.60:42756) 2023-10-06T04:31:52.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.623+0000 7fa77139b700 1 -- 172.21.15.60:0/1128076802 learned_addr learned my addr 172.21.15.60:0/1128076802 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:52.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.623+0000 7fa771b9c700 1 --2- 172.21.15.60:0/1128076802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa76c153ab0 0x7fa76c0c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:52.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.623+0000 7fa770b9a700 1 --2- 172.21.15.60:0/1128076802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa76c0c94b0 0x7fa76c153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:52.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.624+0000 7fa77139b700 1 -- 172.21.15.60:0/1128076802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa76c153ab0 msgr2=0x7fa76c0c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:52.628 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.624+0000 7fa77139b700 1 --2- 172.21.15.60:0/1128076802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa76c153ab0 0x7fa76c0c6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:52.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.624+0000 7fa77139b700 1 -- 172.21.15.60:0/1128076802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa76c0c94b0 msgr2=0x7fa76c153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:52.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.624+0000 7fa77139b700 1 --2- 172.21.15.60:0/1128076802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa76c0c94b0 0x7fa76c153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:52.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.624+0000 7fa77139b700 1 -- 172.21.15.60:0/1128076802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c0c9f60 con 0x7fa76c151d40 2023-10-06T04:31:52.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.624+0000 7fa77139b700 1 --2- 172.21.15.60:0/1128076802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa76c151d40 0x7fa76c0b5ad0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa768002b20 tx=0x7fa768007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:52.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.624+0000 7fa7617fa700 1 -- 172.21.15.60:0/1128076802 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7680034f0 con 0x7fa76c151d40 2023-10-06T04:31:52.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.624+0000 7fa7617fa700 1 -- 172.21.15.60:0/1128076802 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76800f9a0 con 0x7fa76c151d40 2023-10-06T04:31:52.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.624+0000 7fa7617fa700 1 -- 172.21.15.60:0/1128076802 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76800fd80 con 0x7fa76c151d40 2023-10-06T04:31:52.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.624+0000 7fa77239d700 1 -- 172.21.15.60:0/1128076802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76c0b3160 con 0x7fa76c151d40 2023-10-06T04:31:52.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.624+0000 7fa77239d700 1 -- 172.21.15.60:0/1128076802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76c169920 con 0x7fa76c151d40 2023-10-06T04:31:52.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.625+0000 7fa77239d700 1 -- 172.21.15.60:0/1128076802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76c0b3680 con 0x7fa76c151d40 2023-10-06T04:31:52.629 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.626+0000 7fa7617fa700 1 -- 172.21.15.60:0/1128076802 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa768013600 con 0x7fa76c151d40 2023-10-06T04:31:52.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.627+0000 7fa7617fa700 1 --2- 172.21.15.60:0/1128076802 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa750066f30 0x7fa7500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:52.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.627+0000 7fa7617fa700 1 -- 172.21.15.60:0/1128076802 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fa768084580 con 0x7fa76c151d40 2023-10-06T04:31:52.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.627+0000 7fa770b9a700 1 --2- 172.21.15.60:0/1128076802 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa750066f30 0x7fa7500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:52.630 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.628+0000 7fa770b9a700 1 --2- 172.21.15.60:0/1128076802 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa750066f30 0x7fa7500693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa75c006f00 tx=0x7fa75c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:52.632 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.631+0000 7fa7617fa700 1 -- 172.21.15.60:0/1128076802 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa76c0b3680 con 0x7fa76c151d40 2023-10-06T04:31:52.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.834+0000 7fa77239d700 1 -- 172.21.15.60:0/1128076802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa76c0b3680 con 0x7fa76c151d40 2023-10-06T04:31:52.839 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.838+0000 7fa7617fa700 1 -- 172.21.15.60:0/1128076802 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa76c0b3680 con 0x7fa76c151d40 2023-10-06T04:31:52.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.840+0000 7fa77239d700 1 -- 172.21.15.60:0/1128076802 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa750066f30 msgr2=0x7fa7500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:52.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.840+0000 7fa77239d700 1 --2- 172.21.15.60:0/1128076802 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa750066f30 0x7fa7500693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa75c006f00 tx=0x7fa75c008040 comp rx=0 tx=0).stop 2023-10-06T04:31:52.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.840+0000 7fa77239d700 1 -- 172.21.15.60:0/1128076802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa76c151d40 msgr2=0x7fa76c0b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:52.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.840+0000 7fa77239d700 1 --2- 172.21.15.60:0/1128076802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa76c151d40 0x7fa76c0b5ad0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa768002b20 tx=0x7fa768007d30 comp rx=0 tx=0).stop 2023-10-06T04:31:52.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.840+0000 7fa77239d700 1 -- 172.21.15.60:0/1128076802 shutdown_connections 2023-10-06T04:31:52.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.840+0000 7fa77239d700 1 --2- 172.21.15.60:0/1128076802 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa750066f30 0x7fa7500693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:52.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.840+0000 7fa77239d700 1 --2- 172.21.15.60:0/1128076802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa76c151d40 0x7fa76c0b5ad0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:52.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.840+0000 7fa77239d700 1 --2- 172.21.15.60:0/1128076802 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa76c153ab0 0x7fa76c0c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:52.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.840+0000 7fa77239d700 1 --2- 172.21.15.60:0/1128076802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa76c0c94b0 0x7fa76c153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:52.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.840+0000 7fa77239d700 1 -- 172.21.15.60:0/1128076802 >> 172.21.15.60:0/1128076802 conn(0x7fa76c0994e0 msgr2=0x7fa76c0d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:52.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.840+0000 7fa77239d700 1 -- 172.21.15.60:0/1128076802 shutdown_connections 2023-10-06T04:31:52.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:52.840+0000 7fa77239d700 1 -- 172.21.15.60:0/1128076802 wait complete. 2023-10-06T04:31:52.860 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_acls.TestACLs.test_acls' 2023-10-06T04:31:53.049 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.048+0000 7fbf245ff700 1 Processor -- start 2023-10-06T04:31:53.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.048+0000 7fbf245ff700 1 -- start start 2023-10-06T04:31:53.050 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.049+0000 7fbf245ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbf1c159560 0x7fbf1c0aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:53.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.049+0000 7fbf245ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf1c0b49a0 0x7fbf1c0aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:53.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.049+0000 7fbf245ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1c0b0c60 con 0x7fbf1c0b0760 2023-10-06T04:31:53.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.049+0000 7fbf245ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf1c0b0f40 con 0x7fbf1c159560 2023-10-06T04:31:53.051 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.049+0000 7fbf245ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c0b1220 con 0x7fbf1c0b49a0 2023-10-06T04:31:53.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.050+0000 7fbf2239b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbf1c159560 0x7fbf1c0aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:53.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.050+0000 7fbf21b9a700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf1c0b49a0 0x7fbf1c0aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:53.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.050+0000 7fbf2239b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbf1c159560 0x7fbf1c0aa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:39374/0 (socket says 172.21.15.60:39374) 2023-10-06T04:31:53.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.050+0000 7fbf2239b700 1 -- 172.21.15.60:0/4121659740 learned_addr learned my addr 172.21.15.60:0/4121659740 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:53.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.050+0000 7fbf21b9a700 1 -- 172.21.15.60:0/4121659740 >> v2:172.21.15.135:3300/0 conn(0x7fbf1c159560 msgr2=0x7fbf1c0aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:53.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.050+0000 7fbf21b9a700 1 --2- 172.21.15.60:0/4121659740 >> v2:172.21.15.135:3300/0 conn(0x7fbf1c159560 0x7fbf1c0aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:53.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.050+0000 7fbf21b9a700 1 -- 172.21.15.60:0/4121659740 >> v1:172.21.15.135:6789/0 conn(0x7fbf1c0b0760 legacy=0x7fbf1c0b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:53.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.050+0000 7fbf21b9a700 1 -- 172.21.15.60:0/4121659740 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c0b1500 con 0x7fbf1c0b49a0 2023-10-06T04:31:53.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.050+0000 7fbf2239b700 1 --2- 172.21.15.60:0/4121659740 >> v2:172.21.15.135:3300/0 conn(0x7fbf1c159560 0x7fbf1c0aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:31:53.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.051+0000 7fbf21b9a700 1 --2- 172.21.15.60:0/4121659740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf1c0b49a0 0x7fbf1c0aaa70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0098e0 tx=0x7fbf0c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0869e6749fb309f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:53.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.051+0000 7fbf21399700 1 -- 172.21.15.60:0/4121659740 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c00b640 con 0x7fbf1c0b49a0 2023-10-06T04:31:53.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.051+0000 7fbf21399700 1 -- 172.21.15.60:0/4121659740 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c00b7a0 con 0x7fbf1c0b49a0 2023-10-06T04:31:53.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.051+0000 7fbf21399700 1 -- 172.21.15.60:0/4121659740 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c00bb40 con 0x7fbf1c0b49a0 2023-10-06T04:31:53.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.052+0000 7fbf245ff700 1 -- 172.21.15.60:0/4121659740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf1c0b49a0 msgr2=0x7fbf1c0aaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:53.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.052+0000 7fbf245ff700 1 --2- 172.21.15.60:0/4121659740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf1c0b49a0 0x7fbf1c0aaa70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0098e0 tx=0x7fbf0c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:31:53.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.052+0000 7fbf245ff700 1 -- 172.21.15.60:0/4121659740 shutdown_connections 2023-10-06T04:31:53.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.052+0000 7fbf245ff700 1 --2- 172.21.15.60:0/4121659740 >> v2:172.21.15.135:3300/0 conn(0x7fbf1c159560 0x7fbf1c0aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:53.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.052+0000 7fbf245ff700 1 --2- 172.21.15.60:0/4121659740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf1c0b49a0 0x7fbf1c0aaa70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:53.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.052+0000 7fbf245ff700 1 -- 172.21.15.60:0/4121659740 >> 172.21.15.60:0/4121659740 conn(0x7fbf1c0997f0 msgr2=0x7fbf1c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:53.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.052+0000 7fbf245ff700 1 -- 172.21.15.60:0/4121659740 shutdown_connections 2023-10-06T04:31:53.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.052+0000 7fbf245ff700 1 -- 172.21.15.60:0/4121659740 wait complete. 2023-10-06T04:31:53.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.053+0000 7fbf245ff700 1 Processor -- start 2023-10-06T04:31:53.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.054+0000 7fbf245ff700 1 -- start start 2023-10-06T04:31:53.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.054+0000 7fbf245ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf1c0b0760 0x7fbf1c16ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.055+0000 7fbf245ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf1c0b49a0 0x7fbf1c09bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.055+0000 7fbf245ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf1c159560 0x7fbf1c14a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.055+0000 7fbf245ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c16e330 con 0x7fbf1c159560 2023-10-06T04:31:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.055+0000 7fbf245ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c09dd60 con 0x7fbf1c0b49a0 2023-10-06T04:31:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.055+0000 7fbf245ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c09a430 con 0x7fbf1c0b0760 2023-10-06T04:31:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.055+0000 7fbf22b9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf1c159560 0x7fbf1c14a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.055+0000 7fbf22b9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf1c159560 0x7fbf1c14a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42534/0 (socket says 172.21.15.60:42534) 2023-10-06T04:31:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.055+0000 7fbf22b9c700 1 -- 172.21.15.60:0/1618629331 learned_addr learned my addr 172.21.15.60:0/1618629331 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.055+0000 7fbf2239b700 1 --2- 172.21.15.60:0/1618629331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf1c0b0760 0x7fbf1c16ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.055+0000 7fbf21b9a700 1 --2- 172.21.15.60:0/1618629331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf1c0b49a0 0x7fbf1c09bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.055+0000 7fbf22b9c700 1 -- 172.21.15.60:0/1618629331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf1c0b0760 msgr2=0x7fbf1c16ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.055+0000 7fbf22b9c700 1 --2- 172.21.15.60:0/1618629331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf1c0b0760 0x7fbf1c16ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:53.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.055+0000 7fbf22b9c700 1 -- 172.21.15.60:0/1618629331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf1c0b49a0 msgr2=0x7fbf1c09bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:53.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.055+0000 7fbf22b9c700 1 --2- 172.21.15.60:0/1618629331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf1c0b49a0 0x7fbf1c09bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:53.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.055+0000 7fbf22b9c700 1 -- 172.21.15.60:0/1618629331 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf18009480 con 0x7fbf1c159560 2023-10-06T04:31:53.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.055+0000 7fbf21b9a700 1 --2- 172.21.15.60:0/1618629331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf1c0b49a0 0x7fbf1c09bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:31:53.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.056+0000 7fbf22b9c700 1 --2- 172.21.15.60:0/1618629331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf1c159560 0x7fbf1c14a5f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbf1400c8e0 tx=0x7fbf14001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:53.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.056+0000 7fbf127fc700 1 -- 172.21.15.60:0/1618629331 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf14012630 con 0x7fbf1c159560 2023-10-06T04:31:53.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.056+0000 7fbf127fc700 1 -- 172.21.15.60:0/1618629331 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf14012790 con 0x7fbf1c159560 2023-10-06T04:31:53.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.056+0000 7fbf127fc700 1 -- 172.21.15.60:0/1618629331 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf14012b50 con 0x7fbf1c159560 2023-10-06T04:31:53.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.056+0000 7fbf245ff700 1 -- 172.21.15.60:0/1618629331 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0c009420 con 0x7fbf1c159560 2023-10-06T04:31:53.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.056+0000 7fbf245ff700 1 -- 172.21.15.60:0/1618629331 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf1c09a9f0 con 0x7fbf1c159560 2023-10-06T04:31:53.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.057+0000 7fbf245ff700 1 -- 172.21.15.60:0/1618629331 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf1c064a90 con 0x7fbf1c159560 2023-10-06T04:31:53.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.058+0000 7fbf127fc700 1 -- 172.21.15.60:0/1618629331 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf1400a3b0 con 0x7fbf1c159560 2023-10-06T04:31:53.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.059+0000 7fbf127fc700 1 --2- 172.21.15.60:0/1618629331 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf00066f30 0x7fbf000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:53.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.059+0000 7fbf127fc700 1 -- 172.21.15.60:0/1618629331 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fbf14084800 con 0x7fbf1c159560 2023-10-06T04:31:53.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.059+0000 7fbf2239b700 1 --2- 172.21.15.60:0/1618629331 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf00066f30 0x7fbf000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:53.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.060+0000 7fbf2239b700 1 --2- 172.21.15.60:0/1618629331 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf00066f30 0x7fbf000693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbf18009e90 tx=0x7fbf18009220 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:53.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.063+0000 7fbf127fc700 1 -- 172.21.15.60:0/1618629331 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf140554c0 con 0x7fbf1c159560 2023-10-06T04:31:53.345 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.344+0000 7fbf245ff700 1 -- 172.21.15.60:0/1618629331 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_acls.TestACLs.test_acls"]} v 0) v1 -- 0x7fbf1c0b17e0 con 0x7fbf1c159560 2023-10-06T04:31:53.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.411+0000 7fbf127fc700 1 -- 172.21.15.60:0/1618629331 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_acls.TestACLs.test_acls"]}]=0 v175) v1 ==== 120+0+0 (secure 0 0 0) 0x7fbf14055050 con 0x7fbf1c159560 2023-10-06T04:31:53.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.413+0000 7fbf245ff700 1 -- 172.21.15.60:0/1618629331 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf00066f30 msgr2=0x7fbf000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:53.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.413+0000 7fbf245ff700 1 --2- 172.21.15.60:0/1618629331 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf00066f30 0x7fbf000693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbf18009e90 tx=0x7fbf18009220 comp rx=0 tx=0).stop 2023-10-06T04:31:53.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.413+0000 7fbf245ff700 1 -- 172.21.15.60:0/1618629331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf1c159560 msgr2=0x7fbf1c14a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:53.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.413+0000 7fbf245ff700 1 --2- 172.21.15.60:0/1618629331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf1c159560 0x7fbf1c14a5f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbf1400c8e0 tx=0x7fbf14001710 comp rx=0 tx=0).stop 2023-10-06T04:31:53.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.413+0000 7fbf245ff700 1 -- 172.21.15.60:0/1618629331 shutdown_connections 2023-10-06T04:31:53.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.413+0000 7fbf245ff700 1 --2- 172.21.15.60:0/1618629331 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fbf00066f30 0x7fbf000693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:53.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.413+0000 7fbf245ff700 1 --2- 172.21.15.60:0/1618629331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf1c159560 0x7fbf1c14a5f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:53.415 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.413+0000 7fbf245ff700 1 --2- 172.21.15.60:0/1618629331 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbf1c0b0760 0x7fbf1c16ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:53.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.413+0000 7fbf245ff700 1 --2- 172.21.15.60:0/1618629331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf1c0b49a0 0x7fbf1c09bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:53.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.413+0000 7fbf245ff700 1 -- 172.21.15.60:0/1618629331 >> 172.21.15.60:0/1618629331 conn(0x7fbf1c0997f0 msgr2=0x7fbf1c0cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:53.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.413+0000 7fbf245ff700 1 -- 172.21.15.60:0/1618629331 shutdown_connections 2023-10-06T04:31:53.416 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:53.413+0000 7fbf245ff700 1 -- 172.21.15.60:0/1618629331 wait complete. 2023-10-06T04:31:53.433 INFO:tasks.cephfs_test_runner:test_acls (tasks.cephfs.test_acls.TestACLs) ... ok 2023-10-06T04:31:53.433 INFO:tasks.cephfs_test_runner: 2023-10-06T04:31:53.433 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T04:31:53.433 INFO:tasks.cephfs_test_runner:Ran 1 test in 175.017s 2023-10-06T04:31:53.433 INFO:tasks.cephfs_test_runner: 2023-10-06T04:31:53.433 INFO:tasks.cephfs_test_runner:OK 2023-10-06T04:31:53.434 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T04:31:53.445 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-06T04:31:53.456 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-06T04:31:53.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:31:53.456 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-06T04:31:53.494 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T04:31:53.494 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T04:31:53.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:31:53.495 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T04:31:53.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:31:53.597 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T04:31:53.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:31:53.671 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2023-10-06T04:31:53.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:31:53.807 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2023-10-06T04:31:53.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:31:53.847 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2023-10-06T04:31:53.967 INFO:teuthology.orchestra.run.smithi060.stderr:Cannot find device "ceph-brx" 2023-10-06T04:31:53.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:31:53.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:31:53.971 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-10-06T04:31:54.011 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T04:31:54.011 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T04:31:54.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:31:54.011 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T04:31:54.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:31:54.117 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T04:31:54.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:31:54.193 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2023-10-06T04:31:54.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:31:54.323 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2023-10-06T04:31:54.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T04:31:54.361 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2023-10-06T04:31:54.467 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2023-10-06T04:31:54.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:31:54.470 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T04:31:54.479 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T04:31:54.479 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:31:54.671 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.670+0000 7f1a9df9d700 1 Processor -- start 2023-10-06T04:31:54.672 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.670+0000 7f1a9df9d700 1 -- start start 2023-10-06T04:31:54.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.671+0000 7f1a9df9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1a98159180 0x7f1a9806d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:54.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.671+0000 7f1a9df9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1a980c1590 0x7f1a980c19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:54.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.671+0000 7f1a9df9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a980c79c0 con 0x7f1a98158db0 2023-10-06T04:31:54.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.671+0000 7f1a9df9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a9806e910 con 0x7f1a980c1590 2023-10-06T04:31:54.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.671+0000 7f1a9df9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a980c1f10 con 0x7f1a98159180 2023-10-06T04:31:54.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.671+0000 7f1a9d79c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1a980c1590 0x7f1a980c19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:54.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.671+0000 7f1a9d79c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1a980c1590 0x7f1a980c19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42544/0 (socket says 172.21.15.60:42544) 2023-10-06T04:31:54.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.671+0000 7f1a9d79c700 1 -- 172.21.15.60:0/1687561769 learned_addr learned my addr 172.21.15.60:0/1687561769 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:54.673 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.671+0000 7f1a9cf9b700 1 --1- 172.21.15.60:0/1687561769 >> v1:172.21.15.60:6789/0 conn(0x7f1a98158db0 0x7f1a980c72b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34900/0 (socket says 172.21.15.60:34900) 2023-10-06T04:31:54.674 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.672+0000 7f1a97fff700 1 --2- 172.21.15.60:0/1687561769 >> v2:172.21.15.135:3300/0 conn(0x7f1a98159180 0x7f1a9806d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:54.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.672+0000 7f1a9d79c700 1 -- 172.21.15.60:0/1687561769 >> v2:172.21.15.135:3300/0 conn(0x7f1a98159180 msgr2=0x7f1a9806d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:54.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.672+0000 7f1a9d79c700 1 --2- 172.21.15.60:0/1687561769 >> v2:172.21.15.135:3300/0 conn(0x7f1a98159180 0x7f1a9806d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:54.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.672+0000 7f1a9d79c700 1 -- 172.21.15.60:0/1687561769 >> v1:172.21.15.60:6789/0 conn(0x7f1a98158db0 legacy=0x7f1a980c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:54.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.672+0000 7f1a9d79c700 1 -- 172.21.15.60:0/1687561769 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a980caa90 con 0x7f1a980c1590 2023-10-06T04:31:54.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.672+0000 7f1a977fe700 1 -- 172.21.15.60:0/1687561769 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523911318 0 0) 0x7f1a980c79c0 con 0x7f1a98158db0 2023-10-06T04:31:54.676 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.672+0000 7f1a9d79c700 1 --2- 172.21.15.60:0/1687561769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a980c1590 0x7f1a980c19d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1a98070010 tx=0x7f1a90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfd935fa3b81fbc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:54.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.672+0000 7f1a977fe700 1 -- 172.21.15.60:0/1687561769 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9000e070 con 0x7f1a980c1590 2023-10-06T04:31:54.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.672+0000 7f1a977fe700 1 -- 172.21.15.60:0/1687561769 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9000ba40 con 0x7f1a980c1590 2023-10-06T04:31:54.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.672+0000 7f1a977fe700 1 -- 172.21.15.60:0/1687561769 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a900092e0 con 0x7f1a980c1590 2023-10-06T04:31:54.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.673+0000 7f1a9df9d700 1 -- 172.21.15.60:0/1687561769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a980c1590 msgr2=0x7f1a980c19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:54.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.673+0000 7f1a9df9d700 1 --2- 172.21.15.60:0/1687561769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a980c1590 0x7f1a980c19d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1a98070010 tx=0x7f1a90009840 comp rx=0 tx=0).stop 2023-10-06T04:31:54.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.673+0000 7f1a9df9d700 1 -- 172.21.15.60:0/1687561769 shutdown_connections 2023-10-06T04:31:54.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.673+0000 7f1a9df9d700 1 --2- 172.21.15.60:0/1687561769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a980c1590 0x7f1a980c19d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:54.677 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.673+0000 7f1a9df9d700 1 --2- 172.21.15.60:0/1687561769 >> v2:172.21.15.135:3300/0 conn(0x7f1a98159180 0x7f1a9806d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:54.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.673+0000 7f1a9df9d700 1 -- 172.21.15.60:0/1687561769 >> 172.21.15.60:0/1687561769 conn(0x7f1a980cbeb0 msgr2=0x7f1a980cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:54.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.673+0000 7f1a9df9d700 1 -- 172.21.15.60:0/1687561769 shutdown_connections 2023-10-06T04:31:54.678 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.673+0000 7f1a9df9d700 1 -- 172.21.15.60:0/1687561769 wait complete. 2023-10-06T04:31:54.680 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.675+0000 7f1a9df9d700 1 Processor -- start 2023-10-06T04:31:54.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.675+0000 7f1a9df9d700 1 -- start start 2023-10-06T04:31:54.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.676+0000 7f1a9df9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a980c1590 0x7f1a981495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:54.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.676+0000 7f1a9df9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a98158db0 0x7f1a980c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:54.681 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.676+0000 7f1a9df9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a98159180 0x7f1a9814e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:54.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.676+0000 7f1a9df9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9814a5e0 con 0x7f1a98158db0 2023-10-06T04:31:54.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.676+0000 7f1a9df9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a98149b20 con 0x7f1a98159180 2023-10-06T04:31:54.682 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.676+0000 7f1a9df9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a980c4bd0 con 0x7f1a980c1590 2023-10-06T04:31:54.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.676+0000 7f1a97fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a98158db0 0x7f1a980c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:54.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.676+0000 7f1a97fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a98158db0 0x7f1a980c4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42552/0 (socket says 172.21.15.60:42552) 2023-10-06T04:31:54.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.676+0000 7f1a97fff700 1 -- 172.21.15.60:0/1311663100 learned_addr learned my addr 172.21.15.60:0/1311663100 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:54.683 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.676+0000 7f1a9cf9b700 1 --2- 172.21.15.60:0/1311663100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a980c1590 0x7f1a981495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:54.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.676+0000 7f1a9d79c700 1 --2- 172.21.15.60:0/1311663100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a98159180 0x7f1a9814e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:54.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.677+0000 7f1a97fff700 1 -- 172.21.15.60:0/1311663100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a980c1590 msgr2=0x7f1a981495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:54.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.677+0000 7f1a97fff700 1 --2- 172.21.15.60:0/1311663100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a980c1590 0x7f1a981495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:54.684 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.677+0000 7f1a97fff700 1 -- 172.21.15.60:0/1311663100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a98159180 msgr2=0x7f1a9814e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:54.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.677+0000 7f1a97fff700 1 --2- 172.21.15.60:0/1311663100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a98159180 0x7f1a9814e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:54.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.677+0000 7f1a97fff700 1 -- 172.21.15.60:0/1311663100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a90009ae0 con 0x7f1a98158db0 2023-10-06T04:31:54.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.677+0000 7f1a9d79c700 1 --2- 172.21.15.60:0/1311663100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a98159180 0x7f1a9814e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:31:54.685 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.677+0000 7f1a97fff700 1 --2- 172.21.15.60:0/1311663100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a98158db0 0x7f1a980c4690 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400d860 tx=0x7f1a84008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:54.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.677+0000 7f1a94ff9700 1 -- 172.21.15.60:0/1311663100 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a840125f0 con 0x7f1a98158db0 2023-10-06T04:31:54.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.677+0000 7f1a94ff9700 1 -- 172.21.15.60:0/1311663100 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a84012750 con 0x7f1a98158db0 2023-10-06T04:31:54.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.677+0000 7f1a9df9d700 1 -- 172.21.15.60:0/1311663100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a980c5c00 con 0x7f1a98158db0 2023-10-06T04:31:54.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.677+0000 7f1a94ff9700 1 -- 172.21.15.60:0/1311663100 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a84012af0 con 0x7f1a98158db0 2023-10-06T04:31:54.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.677+0000 7f1a9df9d700 1 -- 172.21.15.60:0/1311663100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a980c5360 con 0x7f1a98158db0 2023-10-06T04:31:54.686 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.678+0000 7f1a9df9d700 1 -- 172.21.15.60:0/1311663100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a9806cd90 con 0x7f1a98158db0 2023-10-06T04:31:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.679+0000 7f1a94ff9700 1 -- 172.21.15.60:0/1311663100 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a8401e460 con 0x7f1a98158db0 2023-10-06T04:31:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.680+0000 7f1a94ff9700 1 --2- 172.21.15.60:0/1311663100 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1a7c066f30 0x7f1a7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:54.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.680+0000 7f1a94ff9700 1 -- 172.21.15.60:0/1311663100 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f1a84084b10 con 0x7f1a98158db0 2023-10-06T04:31:54.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.680+0000 7f1a9cf9b700 1 --2- 172.21.15.60:0/1311663100 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1a7c066f30 0x7f1a7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:54.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.681+0000 7f1a9cf9b700 1 --2- 172.21.15.60:0/1311663100 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1a7c066f30 0x7f1a7c0693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c007fd0 tx=0x7f1a8c007d50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:54.688 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.684+0000 7f1a94ff9700 1 -- 172.21.15.60:0/1311663100 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a84051d40 con 0x7f1a98158db0 2023-10-06T04:31:54.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.888+0000 7f1a9df9d700 1 -- 172.21.15.60:0/1311663100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a980c5d90 con 0x7f1a98158db0 2023-10-06T04:31:54.889 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.888+0000 7f1a94ff9700 1 -- 172.21.15.60:0/1311663100 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+13982 (secure 0 0 0) 0x7f1a84055360 con 0x7f1a98158db0 2023-10-06T04:31:54.890 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:31:54.890 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":45,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:31:52.393891+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:6837/749877170":"2023-10-07T04:31:49.028847+0000","172.21.15.60:6835/749877170":"2023-10-07T04:31:49.028847+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:31:54.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.891+0000 7f1a9df9d700 1 -- 172.21.15.60:0/1311663100 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1a7c066f30 msgr2=0x7f1a7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:54.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.891+0000 7f1a9df9d700 1 --2- 172.21.15.60:0/1311663100 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1a7c066f30 0x7f1a7c0693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c007fd0 tx=0x7f1a8c007d50 comp rx=0 tx=0).stop 2023-10-06T04:31:54.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.891+0000 7f1a9df9d700 1 -- 172.21.15.60:0/1311663100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a98158db0 msgr2=0x7f1a980c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:54.892 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.891+0000 7f1a9df9d700 1 --2- 172.21.15.60:0/1311663100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a98158db0 0x7f1a980c4690 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400d860 tx=0x7f1a84008040 comp rx=0 tx=0).stop 2023-10-06T04:31:54.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.891+0000 7f1a9df9d700 1 -- 172.21.15.60:0/1311663100 shutdown_connections 2023-10-06T04:31:54.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.891+0000 7f1a9df9d700 1 --2- 172.21.15.60:0/1311663100 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1a7c066f30 0x7f1a7c0693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:54.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.891+0000 7f1a9df9d700 1 --2- 172.21.15.60:0/1311663100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a98159180 0x7f1a9814e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:54.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.891+0000 7f1a9df9d700 1 --2- 172.21.15.60:0/1311663100 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a980c1590 0x7f1a981495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:54.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.891+0000 7f1a9df9d700 1 --2- 172.21.15.60:0/1311663100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a98158db0 0x7f1a980c4690 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:54.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.891+0000 7f1a9df9d700 1 -- 172.21.15.60:0/1311663100 >> 172.21.15.60:0/1311663100 conn(0x7f1a980cbeb0 msgr2=0x7f1a980cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:54.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.891+0000 7f1a9df9d700 1 -- 172.21.15.60:0/1311663100 shutdown_connections 2023-10-06T04:31:54.893 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:54.891+0000 7f1a9df9d700 1 -- 172.21.15.60:0/1311663100 wait complete. 2023-10-06T04:31:54.910 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T04:31:54.910 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:31:55.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.095+0000 7f6e54f9d700 1 Processor -- start 2023-10-06T04:31:55.096 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.095+0000 7f6e54f9d700 1 -- start start 2023-10-06T04:31:55.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.096+0000 7f6e54f9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6e50159320 0x7f6e500cc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:55.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.096+0000 7f6e54f9d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e500c16f0 con 0x7f6e5015cfb0 2023-10-06T04:31:55.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.096+0000 7f6e54f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e500c2550 con 0x7f6e5015db60 2023-10-06T04:31:55.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.096+0000 7f6e54f9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e500c1940 con 0x7f6e50159320 2023-10-06T04:31:55.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.097+0000 7f6e4f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6e50159320 0x7f6e500cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:55.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.097+0000 7f6e4effd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6e5015cfb0 0x7f6e5015d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34916/0 (socket says 172.21.15.60:34916) 2023-10-06T04:31:55.098 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.097+0000 7f6e4f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6e50159320 0x7f6e500cc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42556/0 (socket says 172.21.15.60:42556) 2023-10-06T04:31:55.099 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.097+0000 7f6e4effd700 1 -- 172.21.15.60:0/1106681636 learned_addr learned my addr 172.21.15.60:0/1106681636 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:31:55.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.097+0000 7f6e4f7fe700 1 -- 172.21.15.60:0/1106681636 >> v1:172.21.15.135:6789/0 conn(0x7f6e5015db60 legacy=0x7f6e500675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:55.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.097+0000 7f6e4f7fe700 1 -- 172.21.15.60:0/1106681636 >> v1:172.21.15.60:6789/0 conn(0x7f6e5015cfb0 legacy=0x7f6e5015d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:55.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.097+0000 7f6e4f7fe700 1 -- 172.21.15.60:0/1106681636 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e500c1c20 con 0x7f6e50159320 2023-10-06T04:31:55.100 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.097+0000 7f6e4f7fe700 1 --2- 172.21.15.60:0/1106681636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e50159320 0x7f6e500cc090 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6e400098e0 tx=0x7f6e400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26c30298fee806a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:55.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.098+0000 7f6e4e7fc700 1 -- 172.21.15.60:0/1106681636 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e40009e80 con 0x7f6e50159320 2023-10-06T04:31:55.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.098+0000 7f6e4e7fc700 1 -- 172.21.15.60:0/1106681636 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4000b860 con 0x7f6e50159320 2023-10-06T04:31:55.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.098+0000 7f6e4e7fc700 1 -- 172.21.15.60:0/1106681636 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4000bbe0 con 0x7f6e50159320 2023-10-06T04:31:55.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.098+0000 7f6e54f9d700 1 -- 172.21.15.60:0/1106681636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e50159320 msgr2=0x7f6e500cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:55.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.098+0000 7f6e54f9d700 1 --2- 172.21.15.60:0/1106681636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e50159320 0x7f6e500cc090 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6e400098e0 tx=0x7f6e400091a0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.098+0000 7f6e54f9d700 1 -- 172.21.15.60:0/1106681636 shutdown_connections 2023-10-06T04:31:55.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.098+0000 7f6e54f9d700 1 --2- 172.21.15.60:0/1106681636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e50159320 0x7f6e500cc090 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.098+0000 7f6e54f9d700 1 -- 172.21.15.60:0/1106681636 >> 172.21.15.60:0/1106681636 conn(0x7f6e500c91a0 msgr2=0x7f6e500c95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:55.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.098+0000 7f6e54f9d700 1 -- 172.21.15.60:0/1106681636 shutdown_connections 2023-10-06T04:31:55.101 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.098+0000 7f6e54f9d700 1 -- 172.21.15.60:0/1106681636 wait complete. 2023-10-06T04:31:55.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.100+0000 7f6e54f9d700 1 Processor -- start 2023-10-06T04:31:55.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.100+0000 7f6e54f9d700 1 -- start start 2023-10-06T04:31:55.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.101+0000 7f6e54f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e50159320 0x7f6e5015c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:55.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.101+0000 7f6e54f9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e5015cfb0 0x7f6e5015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:55.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.101+0000 7f6e54f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e5015db60 0x7f6e500af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:55.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.101+0000 7f6e54f9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5015ad00 con 0x7f6e5015cfb0 2023-10-06T04:31:55.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.101+0000 7f6e54f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5015c7d0 con 0x7f6e50159320 2023-10-06T04:31:55.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.101+0000 7f6e54f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e500b0670 con 0x7f6e5015db60 2023-10-06T04:31:55.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.101+0000 7f6e4effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e5015cfb0 0x7f6e5015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:55.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.101+0000 7f6e4effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e5015cfb0 0x7f6e5015a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42564/0 (socket says 172.21.15.60:42564) 2023-10-06T04:31:55.104 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.101+0000 7f6e4effd700 1 -- 172.21.15.60:0/2668599887 learned_addr learned my addr 172.21.15.60:0/2668599887 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:55.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.102+0000 7f6e4effd700 1 -- 172.21.15.60:0/2668599887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e5015db60 msgr2=0x7f6e500af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:55.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.102+0000 7f6e4ffff700 1 --2- 172.21.15.60:0/2668599887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e5015db60 0x7f6e500af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:55.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.102+0000 7f6e4f7fe700 1 --2- 172.21.15.60:0/2668599887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e50159320 0x7f6e5015c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:55.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.102+0000 7f6e4effd700 1 --2- 172.21.15.60:0/2668599887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e5015db60 0x7f6e500af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.102+0000 7f6e4effd700 1 -- 172.21.15.60:0/2668599887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e50159320 msgr2=0x7f6e5015c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:55.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.102+0000 7f6e4effd700 1 --2- 172.21.15.60:0/2668599887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e50159320 0x7f6e5015c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.102+0000 7f6e4effd700 1 -- 172.21.15.60:0/2668599887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e40009420 con 0x7f6e5015cfb0 2023-10-06T04:31:55.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.102+0000 7f6e4ffff700 1 --2- 172.21.15.60:0/2668599887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e5015db60 0x7f6e500af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:31:55.105 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.102+0000 7f6e4f7fe700 1 --2- 172.21.15.60:0/2668599887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e50159320 0x7f6e5015c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:31:55.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.102+0000 7f6e4effd700 1 --2- 172.21.15.60:0/2668599887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e5015cfb0 0x7f6e5015a7c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400c7c0 tx=0x7f6e44007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:55.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.102+0000 7f6e377fe700 1 -- 172.21.15.60:0/2668599887 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44005b30 con 0x7f6e5015cfb0 2023-10-06T04:31:55.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.102+0000 7f6e377fe700 1 -- 172.21.15.60:0/2668599887 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e44005cb0 con 0x7f6e5015cfb0 2023-10-06T04:31:55.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.102+0000 7f6e54f9d700 1 -- 172.21.15.60:0/2668599887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e500b0950 con 0x7f6e5015cfb0 2023-10-06T04:31:55.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.102+0000 7f6e377fe700 1 -- 172.21.15.60:0/2668599887 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44004a80 con 0x7f6e5015cfb0 2023-10-06T04:31:55.106 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.102+0000 7f6e54f9d700 1 -- 172.21.15.60:0/2668599887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e50169e40 con 0x7f6e5015cfb0 2023-10-06T04:31:55.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.103+0000 7f6e54f9d700 1 -- 172.21.15.60:0/2668599887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5016a030 con 0x7f6e5015cfb0 2023-10-06T04:31:55.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.104+0000 7f6e377fe700 1 -- 172.21.15.60:0/2668599887 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e440070f0 con 0x7f6e5015cfb0 2023-10-06T04:31:55.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.105+0000 7f6e377fe700 1 --2- 172.21.15.60:0/2668599887 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6e3c066f30 0x7f6e3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:55.107 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.105+0000 7f6e377fe700 1 -- 172.21.15.60:0/2668599887 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f6e44083900 con 0x7f6e5015cfb0 2023-10-06T04:31:55.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.105+0000 7f6e4f7fe700 1 --2- 172.21.15.60:0/2668599887 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6e3c066f30 0x7f6e3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:55.108 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.106+0000 7f6e4f7fe700 1 --2- 172.21.15.60:0/2668599887 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6e3c066f30 0x7f6e3c0693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6e40003080 tx=0x7f6e40017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:55.110 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.109+0000 7f6e377fe700 1 -- 172.21.15.60:0/2668599887 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e44050bb0 con 0x7f6e5015cfb0 2023-10-06T04:31:55.306 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.304+0000 7f6e54f9d700 1 -- 172.21.15.60:0/2668599887 --> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e5005f230 con 0x7f6e3c066f30 2023-10-06T04:31:55.309 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.307+0000 7f6e377fe700 1 -- 172.21.15.60:0/2668599887 <== mgr.4098 v2:172.21.15.60:6832/85285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73196 (secure 0 0 0) 0x7f6e5005f230 con 0x7f6e3c066f30 2023-10-06T04:31:55.310 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:31:55.311 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.310+0000 7f6e54f9d700 1 -- 172.21.15.60:0/2668599887 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6e3c066f30 msgr2=0x7f6e3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.310+0000 7f6e54f9d700 1 --2- 172.21.15.60:0/2668599887 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6e3c066f30 0x7f6e3c0693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6e40003080 tx=0x7f6e40017000 comp rx=0 tx=0).stop 2023-10-06T04:31:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.310+0000 7f6e54f9d700 1 -- 172.21.15.60:0/2668599887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e5015cfb0 msgr2=0x7f6e5015a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.310+0000 7f6e54f9d700 1 --2- 172.21.15.60:0/2668599887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e5015cfb0 0x7f6e5015a7c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400c7c0 tx=0x7f6e44007f70 comp rx=0 tx=0).stop 2023-10-06T04:31:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.310+0000 7f6e54f9d700 1 -- 172.21.15.60:0/2668599887 shutdown_connections 2023-10-06T04:31:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.310+0000 7f6e54f9d700 1 --2- 172.21.15.60:0/2668599887 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f6e3c066f30 0x7f6e3c0693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.310+0000 7f6e54f9d700 1 --2- 172.21.15.60:0/2668599887 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6e5015db60 0x7f6e500af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.310+0000 7f6e54f9d700 1 --2- 172.21.15.60:0/2668599887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e50159320 0x7f6e5015c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.310+0000 7f6e54f9d700 1 --2- 172.21.15.60:0/2668599887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e5015cfb0 0x7f6e5015a7c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.310+0000 7f6e54f9d700 1 -- 172.21.15.60:0/2668599887 >> 172.21.15.60:0/2668599887 conn(0x7f6e500c91a0 msgr2=0x7f6e500c29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:55.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.310+0000 7f6e54f9d700 1 -- 172.21.15.60:0/2668599887 shutdown_connections 2023-10-06T04:31:55.313 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.310+0000 7f6e54f9d700 1 -- 172.21.15.60:0/2668599887 wait complete. 2023-10-06T04:31:55.313 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-06T04:31:55.329 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2023-10-06T04:31:53.356104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2405300,"kb_used_data":6516,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752569420,"statfs":{"total":773094113280,"available":770631086080,"internally_reserved":0,"allocated":6672384,"data_stored":4485120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-763442,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-5,"num_write":-139,"num_write_kb":-795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000978"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":34,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:29:54.383797+0000","last_change":"2023-10-06T04:28:00.325832+0000","last_active":"2023-10-06T04:29:54.383797+0000","last_peered":"2023-10-06T04:29:54.383797+0000","last_clean":"2023-10-06T04:29:54.383797+0000","last_became_active":"2023-10-06T04:28:00.325466+0000","last_became_peered":"2023-10-06T04:28:00.325466+0000","last_unstale":"2023-10-06T04:29:54.383797+0000","last_undegraded":"2023-10-06T04:29:54.383797+0000","last_fullsized":"2023-10-06T04:29:54.383797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":33,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:29:54.382177+0000","last_change":"2023-10-06T04:28:00.175241+0000","last_active":"2023-10-06T04:29:54.382177+0000","last_peered":"2023-10-06T04:29:54.382177+0000","last_clean":"2023-10-06T04:29:54.382177+0000","last_became_active":"2023-10-06T04:28:00.174814+0000","last_became_peered":"2023-10-06T04:28:00.174814+0000","last_unstale":"2023-10-06T04:29:54.382177+0000","last_undegraded":"2023-10-06T04:29:54.382177+0000","last_fullsized":"2023-10-06T04:29:54.382177+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:29:54.461857+0000","last_change":"2023-10-06T04:28:00.175086+0000","last_active":"2023-10-06T04:29:54.461857+0000","last_peered":"2023-10-06T04:29:54.461857+0000","last_clean":"2023-10-06T04:29:54.461857+0000","last_became_active":"2023-10-06T04:28:00.174735+0000","last_became_peered":"2023-10-06T04:28:00.174735+0000","last_unstale":"2023-10-06T04:29:54.461857+0000","last_undegraded":"2023-10-06T04:29:54.461857+0000","last_fullsized":"2023-10-06T04:29:54.461857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":182,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:29:54.383420+0000","last_change":"2023-10-06T04:28:01.176177+0000","last_active":"2023-10-06T04:29:54.383420+0000","last_peered":"2023-10-06T04:29:54.383420+0000","last_clean":"2023-10-06T04:29:54.383420+0000","last_became_active":"2023-10-06T04:28:01.175255+0000","last_became_peered":"2023-10-06T04:28:01.175255+0000","last_unstale":"2023-10-06T04:29:54.383420+0000","last_undegraded":"2023-10-06T04:29:54.383420+0000","last_fullsized":"2023-10-06T04:29:54.383420+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:00.161020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:00.161020+0000","last_clean_scrub_stamp":"2023-10-06T04:28:00.161020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:29.208067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:29:54.383858+0000","last_change":"2023-10-06T04:28:00.344573+0000","last_active":"2023-10-06T04:29:54.383858+0000","last_peered":"2023-10-06T04:29:54.383858+0000","last_clean":"2023-10-06T04:29:54.383858+0000","last_became_active":"2023-10-06T04:28:00.344324+0000","last_became_peered":"2023-10-06T04:28:00.344324+0000","last_unstale":"2023-10-06T04:29:54.383858+0000","last_undegraded":"2023-10-06T04:29:54.383858+0000","last_fullsized":"2023-10-06T04:29:54.383858+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:24.184826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:29:54.383384+0000","last_change":"2023-10-06T04:28:00.343571+0000","last_active":"2023-10-06T04:29:54.383384+0000","last_peered":"2023-10-06T04:29:54.383384+0000","last_clean":"2023-10-06T04:29:54.383384+0000","last_became_active":"2023-10-06T04:28:00.343268+0000","last_became_peered":"2023-10-06T04:28:00.343268+0000","last_unstale":"2023-10-06T04:29:54.383384+0000","last_undegraded":"2023-10-06T04:29:54.383384+0000","last_fullsized":"2023-10-06T04:29:54.383384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:00.931419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":32,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:29:54.462150+0000","last_change":"2023-10-06T04:28:00.344460+0000","last_active":"2023-10-06T04:29:54.462150+0000","last_peered":"2023-10-06T04:29:54.462150+0000","last_clean":"2023-10-06T04:29:54.462150+0000","last_became_active":"2023-10-06T04:28:00.343280+0000","last_became_peered":"2023-10-06T04:28:00.343280+0000","last_unstale":"2023-10-06T04:29:54.462150+0000","last_undegraded":"2023-10-06T04:29:54.462150+0000","last_fullsized":"2023-10-06T04:29:54.462150+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":34,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:29:54.462939+0000","last_change":"2023-10-06T04:28:00.343592+0000","last_active":"2023-10-06T04:29:54.462939+0000","last_peered":"2023-10-06T04:29:54.462939+0000","last_clean":"2023-10-06T04:29:54.462939+0000","last_became_active":"2023-10-06T04:28:00.343313+0000","last_became_peered":"2023-10-06T04:28:00.343313+0000","last_unstale":"2023-10-06T04:29:54.462939+0000","last_undegraded":"2023-10-06T04:29:54.462939+0000","last_fullsized":"2023-10-06T04:29:54.462939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:24.184826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":34,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T04:29:54.463137+0000","last_change":"2023-10-06T04:28:00.174563+0000","last_active":"2023-10-06T04:29:54.463137+0000","last_peered":"2023-10-06T04:29:54.463137+0000","last_clean":"2023-10-06T04:29:54.463137+0000","last_became_active":"2023-10-06T04:28:00.174265+0000","last_became_peered":"2023-10-06T04:28:00.174265+0000","last_unstale":"2023-10-06T04:29:54.463137+0000","last_undegraded":"2023-10-06T04:29:54.463137+0000","last_fullsized":"2023-10-06T04:29:54.463137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:00.931419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302440,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069400,"statfs":{"total":96636764160,"available":96327065600,"internally_reserved":0,"allocated":1081344,"data_stored":810781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.73299999999999998,"15min":0.78900000000000003},"min":{"1min":0.42699999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79200000000000004,"5min":4.3070000000000004,"15min":4.3070000000000004},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.83199999999999996,"15min":0.93999999999999995},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.67500000000000004,"5min":8.1609999999999996,"15min":8.1609999999999996},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.77700000000000002,"15min":0.83899999999999997},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.755,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.81299999999999994,"15min":0.89200000000000002},"min":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91300000000000003,"5min":6.3079999999999998,"15min":6.3079999999999998},"last":0.64000000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.76100000000000001,"15min":0.79400000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96999999999999997,"5min":4.4619999999999997,"15min":4.4619999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.92800000000000005,"15min":1.054},"min":{"1min":0.55900000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.73999999999999999,"5min":8.2840000000000007,"15min":8.2840000000000007},"last":0.70199999999999996}]},{"osd":3,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.76300000000000001,"15min":0.81499999999999995},"min":{"1min":0.48399999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80200000000000005,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.73799999999999999,"15min":0.76600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.81899999999999995,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.68600000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.876,"15min":0.97399999999999998},"min":{"1min":0.48499999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84799999999999998,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.82799999999999996,"15min":0.86299999999999999},"min":{"1min":0.64800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89000000000000001,"5min":3.3980000000000001,"15min":3.3980000000000001},"last":0.78800000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.86299999999999999,"15min":0.94099999999999995},"min":{"1min":0.499,"5min":0.439,"15min":0.439},"max":{"1min":1.0049999999999999,"5min":6.8200000000000003,"15min":6.8200000000000003},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.95699999999999996,"15min":1.0629999999999999},"min":{"1min":0.53800000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.88200000000000001,"5min":8.3439999999999994,"15min":8.3439999999999994},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.90800000000000003,"15min":0.98799999999999999},"min":{"1min":0.60399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80300000000000005,"5min":6.2839999999999998,"15min":6.2839999999999998},"last":0.752},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.83499999999999996,"15min":0.88500000000000001},"min":{"1min":0.53300000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94199999999999995,"5min":4.1420000000000003,"15min":4.1420000000000003},"last":0.82199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297780,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074060,"statfs":{"total":96636764160,"available":96331837440,"internally_reserved":0,"allocated":503808,"data_stored":226894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.44,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82899999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.78900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.627}]},{"osd":1,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.51400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.79900000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.53000000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.85599999999999998,"5min":1,"15min":1},"last":0.77700000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81799999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63600000000000001,"15min":0.63200000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.70699999999999996,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67500000000000004,"15min":0.68000000000000005},"min":{"1min":0.504,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82899999999999996,"5min":1.018,"15min":1.018},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.53400000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.76700000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.439,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.747,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89600000000000002,"5min":1.052,"15min":1.052},"last":0.73899999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.42799999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.874,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.72299999999999998},"min":{"1min":0.58399999999999996,"5min":0.439,"15min":0.439},"max":{"1min":0.85999999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":4.2709999999999999,"15min":5.8330000000000002},"min":{"1min":0.59599999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.93999999999999995,"5min":165.47,"15min":165.47},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":4.266,"15min":5.8230000000000004},"min":{"1min":0.52400000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92500000000000004,"5min":165.51300000000001,"15min":165.51300000000001},"last":0.81399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1093632,"data_stored":816688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.436,"15min":0.44400000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56399999999999995,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.48099999999999998,"15min":0.46800000000000003},"min":{"1min":0.30499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.52900000000000003,"5min":3.282,"15min":3.282},"last":0.45500000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.54200000000000004,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.54000000000000004,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.442,"5min":0.503,"15min":0.48899999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65900000000000003,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":0.442}]},{"osd":3,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.55900000000000005,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.54700000000000004,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.54900000000000004,"15min":0.54000000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60599999999999998,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.496}]},{"osd":4,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.55900000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.85999999999999999,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.79800000000000004,"15min":0.79700000000000004},"min":{"1min":0.52800000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95499999999999996,"5min":3.847,"15min":3.847},"last":0.60699999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.81499999999999995,"15min":0.81299999999999994},"min":{"1min":0.57099999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91800000000000004,"5min":3.9809999999999999,"15min":3.9809999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.81100000000000005,"15min":0.81000000000000005},"min":{"1min":0.60499999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.878,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.81000000000000005,"15min":0.81799999999999995},"min":{"1min":0.59699999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.90400000000000003,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.85699999999999998,"15min":0.86899999999999999},"min":{"1min":0.59499999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.98499999999999999,"5min":4.0270000000000001,"15min":4.0270000000000001},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.82299999999999995,"15min":0.81799999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93200000000000005,"5min":3.4769999999999999,"15min":3.4769999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.94499999999999995,"5min":3.5720000000000001,"15min":3.5720000000000001},"last":0.626}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301860,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069980,"statfs":{"total":96636764160,"available":96327659520,"internally_reserved":0,"allocated":487424,"data_stored":220357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45300000000000001,"15min":0.46500000000000002},"min":{"1min":0.29899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58799999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.505},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45700000000000002,"15min":0.46300000000000002},"min":{"1min":0.32600000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.36699999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.54900000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.625},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.54800000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.48399999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.45900000000000002,"15min":0.45800000000000002},"min":{"1min":0.38,"5min":0.309,"15min":0.309},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54000000000000004,"15min":0.55400000000000005},"min":{"1min":0.436,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.59599999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.68200000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.75},"min":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.94699999999999995,"5min":1.077,"15min":1.077},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75600000000000001,"15min":0.77000000000000002},"min":{"1min":0.58499999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.99399999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.61299999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97499999999999998,"5min":1.147,"15min":1.147},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.58499999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90700000000000003,"5min":1.167,"15min":1.167},"last":0.90100000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77900000000000003,"15min":0.78400000000000003},"min":{"1min":0.64900000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.93700000000000006,"5min":1.137,"15min":1.137},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.59099999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.95799999999999996,"5min":1.071,"15min":1.071},"last":0.83099999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.77200000000000002,"15min":0.78400000000000003},"min":{"1min":0.61199999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91800000000000004,"5min":1.048,"15min":1.048},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.60699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93899999999999995,"5min":1.103,"15min":1.103},"last":0.91100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302616,"kb_used_data":1232,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069224,"statfs":{"total":96636764160,"available":96326885376,"internally_reserved":0,"allocated":1261568,"data_stored":984059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42099999999999999,"15min":0.42699999999999999},"min":{"1min":0.30499999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.56999999999999995,"5min":0.877,"15min":0.877},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.46700000000000003,"15min":0.48299999999999998},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.51600000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.42099999999999999}]},{"osd":1,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45400000000000001,"15min":0.47199999999999998},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.56100000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.51500000000000001,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.54400000000000004,"5min":1.524,"15min":1.524},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.54900000000000004,"15min":0.56699999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.622,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.54400000000000004,"15min":0.56499999999999995},"min":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.61399999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.76100000000000001}]},{"osd":4,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75,"15min":0.745},"min":{"1min":0.60199999999999998,"5min":0.504,"15min":0.504},"max":{"1min":0.92100000000000004,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.879},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78100000000000003,"15min":0.78900000000000003},"min":{"1min":0.52800000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93200000000000005,"5min":1.393,"15min":1.393},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.55500000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0369999999999999,"5min":1.381,"15min":1.381},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77500000000000002,"15min":0.78000000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96999999999999997,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.92100000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.79900000000000004,"15min":0.80500000000000005},"min":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98099999999999998,"5min":1.351,"15min":1.351},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.80500000000000005,"15min":0.82099999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.996,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.59199999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.98599999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.623},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.82199999999999995,"15min":0.83399999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.97299999999999998,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.68700000000000006}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301868,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069972,"statfs":{"total":96636764160,"available":96327651328,"internally_reserved":0,"allocated":495616,"data_stored":220933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44400000000000001,"15min":0.45200000000000001},"min":{"1min":0.29199999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70299999999999996,"5min":0.873,"15min":0.873},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.32400000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.46300000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46600000000000003,"15min":0.46800000000000003},"min":{"1min":0.34999999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.58099999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55300000000000005,"15min":0.56499999999999995},"min":{"1min":0.41299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.69499999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.625,"5min":1.248,"15min":1.248},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57099999999999995,"15min":0.59099999999999997},"min":{"1min":0.42799999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77600000000000002,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78400000000000003,"15min":0.82399999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.28,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.79200000000000004,"15min":0.83199999999999996},"min":{"1min":0.57199999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.83999999999999997,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.81799999999999995,"15min":0.86099999999999999},"min":{"1min":0.61799999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.89700000000000002,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.81299999999999994,"15min":0.85099999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3280000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.61599999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.83299999999999996,"15min":0.88100000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.94799999999999995,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.82799999999999996,"15min":0.86699999999999999},"min":{"1min":0.60099999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92400000000000004,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.83499999999999996,"15min":0.86899999999999999},"min":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3680000000000001,"5min":1.603,"15min":1.603},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.83199999999999996,"15min":0.876},"min":{"1min":0.624,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.997,"5min":1.534,"15min":1.534},"last":0.72999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298520,"kb_used_data":1232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073320,"statfs":{"total":96636764160,"available":96331079680,"internally_reserved":0,"allocated":1261568,"data_stored":985015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.44500000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.78300000000000003,"5min":1.177,"15min":1.177},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68799999999999994,"15min":0.70099999999999996},"min":{"1min":0.47599999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88700000000000001,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.625,"5min":0.434,"15min":0.434},"max":{"1min":0.81999999999999995,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.72199999999999998,"15min":0.746},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.72599999999999998,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.66700000000000004}]},{"osd":2,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68999999999999995,"15min":0.70399999999999996},"min":{"1min":0.49099999999999999,"5min":0.441,"15min":0.441},"max":{"1min":0.80500000000000005,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.874,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.76400000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.93899999999999995,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.71799999999999997,"15min":0.74199999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.745,"5min":1.948,"15min":1.948},"last":0.72199999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.746,"15min":0.75600000000000001},"min":{"1min":0.56200000000000006,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0049999999999999,"5min":1.893,"15min":1.893},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.51900000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.80100000000000005,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.71099999999999997,"15min":0.73299999999999998},"min":{"1min":0.46400000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85299999999999998,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.505,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97799999999999998,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":0.81200000000000006}]},{"osd":7,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.60099999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91800000000000004,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.59199999999999997,"5min":0.497,"15min":0.497},"max":{"1min":0.92800000000000005,"5min":1.99,"15min":1.99},"last":0.70499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":220393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.622,"15min":0.60099999999999998},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.62,"15min":0.622},"min":{"1min":0.46300000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.751,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.45600000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.83799999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.56499999999999995}]},{"osd":2,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67600000000000005,"15min":0.67400000000000004},"min":{"1min":0.51400000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98099999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.502},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91400000000000003,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.67300000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.47399999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.78700000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.61499999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89000000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.69399999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65400000000000003,"15min":0.63300000000000001},"min":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83899999999999997,"5min":1.004,"15min":1.004},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.41299999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.84899999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70399999999999996,"15min":0.68799999999999994},"min":{"1min":0.501,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85099999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.752},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.72099999999999997,"15min":0.70499999999999996},"min":{"1min":0.501,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92800000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.76800000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70399999999999996,"15min":0.70199999999999996},"min":{"1min":0.56200000000000006,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86099999999999999,"5min":1.083,"15min":1.083},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76100000000000001,"15min":0.745},"min":{"1min":0.54000000000000004,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92400000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.87}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:31:55.333 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:31:55.521 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.520+0000 7fd2effff700 1 Processor -- start 2023-10-06T04:31:55.522 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.520+0000 7fd2effff700 1 -- start start 2023-10-06T04:31:55.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.521+0000 7fd2effff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd2f0155d40 0x7fd2f0156110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:55.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.521+0000 7fd2effff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2f00c89a0 0x7fd2f006e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:55.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.521+0000 7fd2effff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f00af9c0 con 0x7fd2f006e680 2023-10-06T04:31:55.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.522+0000 7fd2effff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f006eab0 con 0x7fd2f0155d40 2023-10-06T04:31:55.523 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.522+0000 7fd2effff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f00aedb0 con 0x7fd2f00c89a0 2023-10-06T04:31:55.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.522+0000 7fd2eeffd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd2f0155d40 0x7fd2f0156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:55.524 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.522+0000 7fd2ee7fc700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2f00c89a0 0x7fd2f006e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:55.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.522+0000 7fd2ee7fc700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2f00c89a0 0x7fd2f006e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:57372/0 (socket says 172.21.15.60:57372) 2023-10-06T04:31:55.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.522+0000 7fd2ee7fc700 1 -- 172.21.15.60:0/970319039 learned_addr learned my addr 172.21.15.60:0/970319039 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:55.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.523+0000 7fd2ee7fc700 1 -- 172.21.15.60:0/970319039 >> v2:172.21.15.135:3300/0 conn(0x7fd2f0155d40 msgr2=0x7fd2f0156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:55.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.523+0000 7fd2ee7fc700 1 --2- 172.21.15.60:0/970319039 >> v2:172.21.15.135:3300/0 conn(0x7fd2f0155d40 0x7fd2f0156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.523+0000 7fd2ee7fc700 1 -- 172.21.15.60:0/970319039 >> v1:172.21.15.135:6789/0 conn(0x7fd2f006e680 legacy=0x7fd2f00adc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:55.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.523+0000 7fd2ee7fc700 1 -- 172.21.15.60:0/970319039 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f00af090 con 0x7fd2f00c89a0 2023-10-06T04:31:55.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.523+0000 7fd2eeffd700 1 --2- 172.21.15.60:0/970319039 >> v2:172.21.15.135:3300/0 conn(0x7fd2f0155d40 0x7fd2f0156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:31:55.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.523+0000 7fd2ee7fc700 1 --2- 172.21.15.60:0/970319039 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2f00c89a0 0x7fd2f006e140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40099b0 tx=0x7fd2e4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa5ba103a1e41172 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:55.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.523+0000 7fd2edffb700 1 -- 172.21.15.60:0/970319039 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4009ea0 con 0x7fd2f00c89a0 2023-10-06T04:31:55.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.523+0000 7fd2edffb700 1 -- 172.21.15.60:0/970319039 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e400b860 con 0x7fd2f00c89a0 2023-10-06T04:31:55.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.523+0000 7fd2edffb700 1 -- 172.21.15.60:0/970319039 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e400bc00 con 0x7fd2f00c89a0 2023-10-06T04:31:55.526 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.524+0000 7fd2effff700 1 -- 172.21.15.60:0/970319039 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2f00c89a0 msgr2=0x7fd2f006e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:55.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.524+0000 7fd2effff700 1 --2- 172.21.15.60:0/970319039 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2f00c89a0 0x7fd2f006e140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40099b0 tx=0x7fd2e4009250 comp rx=0 tx=0).stop 2023-10-06T04:31:55.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.524+0000 7fd2effff700 1 -- 172.21.15.60:0/970319039 shutdown_connections 2023-10-06T04:31:55.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.524+0000 7fd2effff700 1 --2- 172.21.15.60:0/970319039 >> v2:172.21.15.135:3300/0 conn(0x7fd2f0155d40 0x7fd2f0156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.524+0000 7fd2effff700 1 --2- 172.21.15.60:0/970319039 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2f00c89a0 0x7fd2f006e140 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.524+0000 7fd2effff700 1 -- 172.21.15.60:0/970319039 >> 172.21.15.60:0/970319039 conn(0x7fd2f00cbe50 msgr2=0x7fd2f00cc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:55.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.524+0000 7fd2effff700 1 -- 172.21.15.60:0/970319039 shutdown_connections 2023-10-06T04:31:55.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.524+0000 7fd2effff700 1 -- 172.21.15.60:0/970319039 wait complete. 2023-10-06T04:31:55.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.525+0000 7fd2effff700 1 Processor -- start 2023-10-06T04:31:55.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.525+0000 7fd2effff700 1 -- start start 2023-10-06T04:31:55.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.526+0000 7fd2effff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2f006e680 0x7fd2f016b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:55.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.526+0000 7fd2effff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f00c89a0 0x7fd2f014a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:55.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.526+0000 7fd2effff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2f0155d40 0x7fd2f0150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:55.529 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.526+0000 7fd2effff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f014ae10 con 0x7fd2f006e680 2023-10-06T04:31:55.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.526+0000 7fd2effff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f0157a70 con 0x7fd2f00c89a0 2023-10-06T04:31:55.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.526+0000 7fd2effff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f0157d10 con 0x7fd2f0155d40 2023-10-06T04:31:55.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.527+0000 7fd2eeffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2f006e680 0x7fd2f016b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:55.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.527+0000 7fd2eeffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2f006e680 0x7fd2f016b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42578/0 (socket says 172.21.15.60:42578) 2023-10-06T04:31:55.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.527+0000 7fd2eeffd700 1 -- 172.21.15.60:0/3306087142 learned_addr learned my addr 172.21.15.60:0/3306087142 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:55.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.527+0000 7fd2ee7fc700 1 --2- 172.21.15.60:0/3306087142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f00c89a0 0x7fd2f014a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:55.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.527+0000 7fd2ef7fe700 1 --2- 172.21.15.60:0/3306087142 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2f0155d40 0x7fd2f0150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:55.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.527+0000 7fd2eeffd700 1 -- 172.21.15.60:0/3306087142 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2f0155d40 msgr2=0x7fd2f0150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:55.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.527+0000 7fd2eeffd700 1 --2- 172.21.15.60:0/3306087142 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2f0155d40 0x7fd2f0150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.530 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.527+0000 7fd2eeffd700 1 -- 172.21.15.60:0/3306087142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f00c89a0 msgr2=0x7fd2f014a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:55.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.527+0000 7fd2eeffd700 1 --2- 172.21.15.60:0/3306087142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f00c89a0 0x7fd2f014a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.527+0000 7fd2eeffd700 1 -- 172.21.15.60:0/3306087142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e00093c0 con 0x7fd2f006e680 2023-10-06T04:31:55.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.527+0000 7fd2eeffd700 1 --2- 172.21.15.60:0/3306087142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2f006e680 0x7fd2f016b8d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000ec80 tx=0x7fd2e0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:55.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.528+0000 7fd2d6ffd700 1 -- 172.21.15.60:0/3306087142 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0005a00 con 0x7fd2f006e680 2023-10-06T04:31:55.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.528+0000 7fd2d6ffd700 1 -- 172.21.15.60:0/3306087142 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e0005b60 con 0x7fd2f006e680 2023-10-06T04:31:55.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.528+0000 7fd2effff700 1 -- 172.21.15.60:0/3306087142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e40094f0 con 0x7fd2f006e680 2023-10-06T04:31:55.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.528+0000 7fd2d6ffd700 1 -- 172.21.15.60:0/3306087142 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e000c850 con 0x7fd2f006e680 2023-10-06T04:31:55.531 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.528+0000 7fd2effff700 1 -- 172.21.15.60:0/3306087142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f01580a0 con 0x7fd2f006e680 2023-10-06T04:31:55.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.529+0000 7fd2effff700 1 -- 172.21.15.60:0/3306087142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f0158920 con 0x7fd2f006e680 2023-10-06T04:31:55.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.530+0000 7fd2d6ffd700 1 -- 172.21.15.60:0/3306087142 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd2e000cbc0 con 0x7fd2f006e680 2023-10-06T04:31:55.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.531+0000 7fd2d6ffd700 1 --2- 172.21.15.60:0/3306087142 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd2dc066f30 0x7fd2dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:55.532 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.531+0000 7fd2d6ffd700 1 -- 172.21.15.60:0/3306087142 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fd2e00848a0 con 0x7fd2f006e680 2023-10-06T04:31:55.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.531+0000 7fd2ee7fc700 1 --2- 172.21.15.60:0/3306087142 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd2dc066f30 0x7fd2dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:55.533 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.532+0000 7fd2ee7fc700 1 --2- 172.21.15.60:0/3306087142 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd2dc066f30 0x7fd2dc0693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40099b0 tx=0x7fd2e4017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:55.536 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.535+0000 7fd2d6ffd700 1 -- 172.21.15.60:0/3306087142 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2e0051b70 con 0x7fd2f006e680 2023-10-06T04:31:55.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.732+0000 7fd2effff700 1 -- 172.21.15.60:0/3306087142 --> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2f0157ed0 con 0x7fd2dc066f30 2023-10-06T04:31:55.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.735+0000 7fd2d6ffd700 1 -- 172.21.15.60:0/3306087142 <== mgr.4098 v2:172.21.15.60:6832/85285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73253 (secure 0 0 0) 0x7fd2e400b9d0 con 0x7fd2dc066f30 2023-10-06T04:31:55.738 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:31:55.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.737+0000 7fd2effff700 1 -- 172.21.15.60:0/3306087142 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd2dc066f30 msgr2=0x7fd2dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:55.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.737+0000 7fd2effff700 1 --2- 172.21.15.60:0/3306087142 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd2dc066f30 0x7fd2dc0693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40099b0 tx=0x7fd2e4017000 comp rx=0 tx=0).stop 2023-10-06T04:31:55.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.738+0000 7fd2effff700 1 -- 172.21.15.60:0/3306087142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2f006e680 msgr2=0x7fd2f016b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:55.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.738+0000 7fd2effff700 1 --2- 172.21.15.60:0/3306087142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2f006e680 0x7fd2f016b8d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000ec80 tx=0x7fd2e0009120 comp rx=0 tx=0).stop 2023-10-06T04:31:55.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.738+0000 7fd2effff700 1 -- 172.21.15.60:0/3306087142 shutdown_connections 2023-10-06T04:31:55.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.738+0000 7fd2effff700 1 --2- 172.21.15.60:0/3306087142 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd2dc066f30 0x7fd2dc0693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.738+0000 7fd2effff700 1 --2- 172.21.15.60:0/3306087142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2f006e680 0x7fd2f016b8d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.738+0000 7fd2effff700 1 --2- 172.21.15.60:0/3306087142 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2f0155d40 0x7fd2f0150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.738+0000 7fd2effff700 1 --2- 172.21.15.60:0/3306087142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2f00c89a0 0x7fd2f014a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.738+0000 7fd2effff700 1 -- 172.21.15.60:0/3306087142 >> 172.21.15.60:0/3306087142 conn(0x7fd2f00cbe50 msgr2=0x7fd2f00ad250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:55.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.738+0000 7fd2effff700 1 -- 172.21.15.60:0/3306087142 shutdown_connections 2023-10-06T04:31:55.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.738+0000 7fd2effff700 1 -- 172.21.15.60:0/3306087142 wait complete. 2023-10-06T04:31:55.740 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-06T04:31:55.757 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2023-10-06T04:31:55.356390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404000,"kb_used_data":5216,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752570720,"statfs":{"total":773094113280,"available":770632417280,"internally_reserved":0,"allocated":5341184,"data_stored":3071507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-769433,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-5,"num_write":-146,"num_write_kb":-804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.324329"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:31:51.398156+0000","last_change":"2023-10-06T04:28:00.325832+0000","last_active":"2023-10-06T04:31:51.398156+0000","last_peered":"2023-10-06T04:31:51.398156+0000","last_clean":"2023-10-06T04:31:51.398156+0000","last_became_active":"2023-10-06T04:28:00.325466+0000","last_became_peered":"2023-10-06T04:28:00.325466+0000","last_unstale":"2023-10-06T04:31:51.398156+0000","last_undegraded":"2023-10-06T04:31:51.398156+0000","last_fullsized":"2023-10-06T04:31:51.398156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:31:49.232810+0000","last_change":"2023-10-06T04:28:00.175241+0000","last_active":"2023-10-06T04:31:49.232810+0000","last_peered":"2023-10-06T04:31:49.232810+0000","last_clean":"2023-10-06T04:31:49.232810+0000","last_became_active":"2023-10-06T04:28:00.174814+0000","last_became_peered":"2023-10-06T04:28:00.174814+0000","last_unstale":"2023-10-06T04:31:49.232810+0000","last_undegraded":"2023-10-06T04:31:49.232810+0000","last_fullsized":"2023-10-06T04:31:49.232810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":33,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:31:49.231779+0000","last_change":"2023-10-06T04:28:00.175086+0000","last_active":"2023-10-06T04:31:49.231779+0000","last_peered":"2023-10-06T04:31:49.231779+0000","last_clean":"2023-10-06T04:31:49.231779+0000","last_became_active":"2023-10-06T04:28:00.174735+0000","last_became_peered":"2023-10-06T04:28:00.174735+0000","last_unstale":"2023-10-06T04:31:49.231779+0000","last_undegraded":"2023-10-06T04:31:49.231779+0000","last_fullsized":"2023-10-06T04:31:49.231779+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":184,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:31:49.231489+0000","last_change":"2023-10-06T04:28:01.176177+0000","last_active":"2023-10-06T04:31:49.231489+0000","last_peered":"2023-10-06T04:31:49.231489+0000","last_clean":"2023-10-06T04:31:49.231489+0000","last_became_active":"2023-10-06T04:28:01.175255+0000","last_became_peered":"2023-10-06T04:28:01.175255+0000","last_unstale":"2023-10-06T04:31:49.231489+0000","last_undegraded":"2023-10-06T04:31:49.231489+0000","last_fullsized":"2023-10-06T04:31:49.231489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:00.161020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:00.161020+0000","last_clean_scrub_stamp":"2023-10-06T04:28:00.161020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:29.208067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:31:49.231716+0000","last_change":"2023-10-06T04:28:00.344573+0000","last_active":"2023-10-06T04:31:49.231716+0000","last_peered":"2023-10-06T04:31:49.231716+0000","last_clean":"2023-10-06T04:31:49.231716+0000","last_became_active":"2023-10-06T04:28:00.344324+0000","last_became_peered":"2023-10-06T04:28:00.344324+0000","last_unstale":"2023-10-06T04:31:49.231716+0000","last_undegraded":"2023-10-06T04:31:49.231716+0000","last_fullsized":"2023-10-06T04:31:49.231716+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:24.184826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:31:49.231398+0000","last_change":"2023-10-06T04:28:00.343571+0000","last_active":"2023-10-06T04:31:49.231398+0000","last_peered":"2023-10-06T04:31:49.231398+0000","last_clean":"2023-10-06T04:31:49.231398+0000","last_became_active":"2023-10-06T04:28:00.343268+0000","last_became_peered":"2023-10-06T04:28:00.343268+0000","last_unstale":"2023-10-06T04:31:49.231398+0000","last_undegraded":"2023-10-06T04:31:49.231398+0000","last_fullsized":"2023-10-06T04:31:49.231398+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:00.931419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":34,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:31:49.231072+0000","last_change":"2023-10-06T04:28:00.344460+0000","last_active":"2023-10-06T04:31:49.231072+0000","last_peered":"2023-10-06T04:31:49.231072+0000","last_clean":"2023-10-06T04:31:49.231072+0000","last_became_active":"2023-10-06T04:28:00.343280+0000","last_became_peered":"2023-10-06T04:28:00.343280+0000","last_unstale":"2023-10-06T04:31:49.231072+0000","last_undegraded":"2023-10-06T04:31:49.231072+0000","last_fullsized":"2023-10-06T04:31:49.231072+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:31:51.399053+0000","last_change":"2023-10-06T04:28:00.343592+0000","last_active":"2023-10-06T04:31:51.399053+0000","last_peered":"2023-10-06T04:31:51.399053+0000","last_clean":"2023-10-06T04:31:51.399053+0000","last_became_active":"2023-10-06T04:28:00.343313+0000","last_became_peered":"2023-10-06T04:28:00.343313+0000","last_unstale":"2023-10-06T04:31:51.399053+0000","last_undegraded":"2023-10-06T04:31:51.399053+0000","last_fullsized":"2023-10-06T04:31:51.399053+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:24.184826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:31:51.399553+0000","last_change":"2023-10-06T04:28:00.174563+0000","last_active":"2023-10-06T04:31:51.399553+0000","last_peered":"2023-10-06T04:31:51.399553+0000","last_clean":"2023-10-06T04:31:51.399553+0000","last_became_active":"2023-10-06T04:28:00.174265+0000","last_became_peered":"2023-10-06T04:28:00.174265+0000","last_unstale":"2023-10-06T04:31:51.399553+0000","last_undegraded":"2023-10-06T04:31:51.399553+0000","last_fullsized":"2023-10-06T04:31:51.399553+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:00.931419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302464,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069376,"statfs":{"total":96636764160,"available":96327041024,"internally_reserved":0,"allocated":1105920,"data_stored":824213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.73299999999999998,"15min":0.78900000000000003},"min":{"1min":0.42699999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79200000000000004,"5min":4.3070000000000004,"15min":4.3070000000000004},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.83199999999999996,"15min":0.93999999999999995},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.67500000000000004,"5min":8.1609999999999996,"15min":8.1609999999999996},"last":0.64200000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.77700000000000002,"15min":0.83899999999999997},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.755,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.81299999999999994,"15min":0.89200000000000002},"min":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91300000000000003,"5min":6.3079999999999998,"15min":6.3079999999999998},"last":0.749}]},{"osd":2,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.76100000000000001,"15min":0.79400000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96999999999999997,"5min":4.4619999999999997,"15min":4.4619999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.92800000000000005,"15min":1.054},"min":{"1min":0.55900000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.73999999999999999,"5min":8.2840000000000007,"15min":8.2840000000000007},"last":0.72499999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.76300000000000001,"15min":0.81499999999999995},"min":{"1min":0.48399999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80200000000000005,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.73799999999999999,"15min":0.76600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.81899999999999995,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.58999999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.876,"15min":0.97399999999999998},"min":{"1min":0.48499999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84799999999999998,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.82799999999999996,"15min":0.86299999999999999},"min":{"1min":0.64800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89000000000000001,"5min":3.3980000000000001,"15min":3.3980000000000001},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.86299999999999999,"15min":0.94099999999999995},"min":{"1min":0.499,"5min":0.439,"15min":0.439},"max":{"1min":1.0049999999999999,"5min":6.8200000000000003,"15min":6.8200000000000003},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.95699999999999996,"15min":1.0629999999999999},"min":{"1min":0.53800000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.88200000000000001,"5min":8.3439999999999994,"15min":8.3439999999999994},"last":0.77500000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.90800000000000003,"15min":0.98799999999999999},"min":{"1min":0.60399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80300000000000005,"5min":6.2839999999999998,"15min":6.2839999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.83499999999999996,"15min":0.88500000000000001},"min":{"1min":0.53300000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94199999999999995,"5min":4.1420000000000003,"15min":4.1420000000000003},"last":0.66800000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297808,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074032,"statfs":{"total":96636764160,"available":96331808768,"internally_reserved":0,"allocated":532480,"data_stored":241083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.44,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82899999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.78900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.623}]},{"osd":1,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.51400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.79900000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.53000000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.85599999999999998,"5min":1,"15min":1},"last":0.746}]},{"osd":2,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81799999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63600000000000001,"15min":0.63200000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.70699999999999996,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.71899999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67500000000000004,"15min":0.68000000000000005},"min":{"1min":0.504,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82899999999999996,"5min":1.018,"15min":1.018},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.53400000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.64800000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.439,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.747,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.871},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89600000000000002,"5min":1.052,"15min":1.052},"last":0.83799999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.42799999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.874,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.72299999999999998},"min":{"1min":0.58399999999999996,"5min":0.439,"15min":0.439},"max":{"1min":0.85999999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.90600000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":4.2709999999999999,"15min":5.8330000000000002},"min":{"1min":0.59599999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.93999999999999995,"5min":165.47,"15min":165.47},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":4.266,"15min":5.8230000000000004},"min":{"1min":0.52400000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92500000000000004,"5min":165.51300000000001,"15min":165.51300000000001},"last":0.79200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302464,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069376,"statfs":{"total":96636764160,"available":96327041024,"internally_reserved":0,"allocated":1105920,"data_stored":823488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.436,"15min":0.44400000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56399999999999995,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.48099999999999998,"15min":0.46800000000000003},"min":{"1min":0.30499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.52900000000000003,"5min":3.282,"15min":3.282},"last":0.443}]},{"osd":2,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.54200000000000004,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.54000000000000004,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.503,"15min":0.48899999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65900000000000003,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":0.56299999999999994}]},{"osd":3,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.55900000000000005,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.54700000000000004,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.54900000000000004,"15min":0.54000000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60599999999999998,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.49399999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.55900000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.85999999999999999,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":0.87},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.79800000000000004,"15min":0.79700000000000004},"min":{"1min":0.52800000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95499999999999996,"5min":3.847,"15min":3.847},"last":0.89100000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.81499999999999995,"15min":0.81299999999999994},"min":{"1min":0.57099999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91800000000000004,"5min":3.9809999999999999,"15min":3.9809999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.81100000000000005,"15min":0.81000000000000005},"min":{"1min":0.60499999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.878,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.85099999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.81000000000000005,"15min":0.81799999999999995},"min":{"1min":0.59699999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.90400000000000003,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.85699999999999998,"15min":0.86899999999999999},"min":{"1min":0.59499999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.98499999999999999,"5min":4.0270000000000001,"15min":4.0270000000000001},"last":0.83899999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.82299999999999995,"15min":0.81799999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93200000000000005,"5min":3.4769999999999999,"15min":3.4769999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.94499999999999995,"5min":3.5720000000000001,"15min":3.5720000000000001},"last":0.91900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":512000,"data_stored":233845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45300000000000001,"15min":0.46500000000000002},"min":{"1min":0.29899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58799999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45700000000000002,"15min":0.46300000000000002},"min":{"1min":0.32600000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.496}]},{"osd":2,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.36699999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.54900000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.54800000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.45900000000000002,"15min":0.45800000000000002},"min":{"1min":0.38,"5min":0.309,"15min":0.309},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54000000000000004,"15min":0.55400000000000005},"min":{"1min":0.436,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.59599999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.75},"min":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.94699999999999995,"5min":1.077,"15min":1.077},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75600000000000001,"15min":0.77000000000000002},"min":{"1min":0.58499999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.99399999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.70599999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.61299999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97499999999999998,"5min":1.147,"15min":1.147},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.58499999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90700000000000003,"5min":1.167,"15min":1.167},"last":0.74099999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77900000000000003,"15min":0.78400000000000003},"min":{"1min":0.64900000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.93700000000000006,"5min":1.137,"15min":1.137},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.59099999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.95799999999999996,"5min":1.071,"15min":1.071},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.77200000000000002,"15min":0.78400000000000003},"min":{"1min":0.61199999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91800000000000004,"5min":1.048,"15min":1.048},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.60699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93899999999999995,"5min":1.103,"15min":1.103},"last":0.875}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":528384,"data_stored":240105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42099999999999999,"15min":0.42699999999999999},"min":{"1min":0.30499999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.56999999999999995,"5min":0.877,"15min":0.877},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.46700000000000003,"15min":0.48299999999999998},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.51600000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.54800000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45400000000000001,"15min":0.47199999999999998},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.56100000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.51500000000000001,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.54400000000000004,"5min":1.524,"15min":1.524},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.54900000000000004,"15min":0.56699999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.622,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.54400000000000004,"15min":0.56499999999999995},"min":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.61399999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60999999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75,"15min":0.745},"min":{"1min":0.60199999999999998,"5min":0.504,"15min":0.504},"max":{"1min":0.92100000000000004,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78100000000000003,"15min":0.78900000000000003},"min":{"1min":0.52800000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93200000000000005,"5min":1.393,"15min":1.393},"last":0.80200000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.55500000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0369999999999999,"5min":1.381,"15min":1.381},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77500000000000002,"15min":0.78000000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96999999999999997,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.79000000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.79900000000000004,"15min":0.80500000000000005},"min":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98099999999999998,"5min":1.351,"15min":1.351},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.80500000000000005,"15min":0.82099999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.996,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.62}]},{"osd":7,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.98599999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.82199999999999995,"15min":0.83399999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.97299999999999998,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.91700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":512000,"data_stored":233845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44400000000000001,"15min":0.45200000000000001},"min":{"1min":0.29199999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70299999999999996,"5min":0.873,"15min":0.873},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.32400000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46600000000000003,"15min":0.46800000000000003},"min":{"1min":0.34999999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.58099999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55300000000000005,"15min":0.56499999999999995},"min":{"1min":0.41299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.69499999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.625,"5min":1.248,"15min":1.248},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57099999999999995,"15min":0.59099999999999997},"min":{"1min":0.42799999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77600000000000002,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.65100000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78400000000000003,"15min":0.82399999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.28,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.79200000000000004,"15min":0.83199999999999996},"min":{"1min":0.57199999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.83999999999999997,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.93200000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.81799999999999995,"15min":0.86099999999999999},"min":{"1min":0.61799999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.89700000000000002,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.81299999999999994,"15min":0.85099999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3280000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.871}]},{"osd":6,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.83299999999999996,"15min":0.88100000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.94799999999999995,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.82799999999999996,"15min":0.86699999999999999},"min":{"1min":0.60099999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92400000000000004,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.96699999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.83499999999999996,"15min":0.86899999999999999},"min":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3680000000000001,"5min":1.603,"15min":1.603},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.83199999999999996,"15min":0.876},"min":{"1min":0.624,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.997,"5min":1.534,"15min":1.534},"last":0.82099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297808,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074032,"statfs":{"total":96636764160,"available":96331808768,"internally_reserved":0,"allocated":532480,"data_stored":241083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.44500000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.78300000000000003,"5min":1.177,"15min":1.177},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68799999999999994,"15min":0.70099999999999996},"min":{"1min":0.47599999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88700000000000001,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.72699999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.625,"5min":0.434,"15min":0.434},"max":{"1min":0.81999999999999995,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.749},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.72199999999999998,"15min":0.746},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.72599999999999998,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.67800000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68999999999999995,"15min":0.70399999999999996},"min":{"1min":0.49099999999999999,"5min":0.441,"15min":0.441},"max":{"1min":0.80500000000000005,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.874,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.63100000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.93899999999999995,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.71799999999999997,"15min":0.74199999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.745,"5min":1.948,"15min":1.948},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.746,"15min":0.75600000000000001},"min":{"1min":0.56200000000000006,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0049999999999999,"5min":1.893,"15min":1.893},"last":0.439},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.51900000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.80100000000000005,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.71099999999999997,"15min":0.73299999999999998},"min":{"1min":0.46400000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85299999999999998,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.505,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97799999999999998,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":0.57099999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.60099999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91800000000000004,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.59199999999999997,"5min":0.497,"15min":0.497},"max":{"1min":0.92800000000000005,"5min":1.99,"15min":1.99},"last":0.66800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297788,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074052,"statfs":{"total":96636764160,"available":96331829248,"internally_reserved":0,"allocated":512000,"data_stored":233845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.622,"15min":0.60099999999999998},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.748},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.62,"15min":0.622},"min":{"1min":0.46300000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.751,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.82499999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.83799999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.67600000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67600000000000005,"15min":0.67400000000000004},"min":{"1min":0.51400000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98099999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91400000000000003,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.78700000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.47399999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.78700000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.61499999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89000000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.80500000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65400000000000003,"15min":0.63300000000000001},"min":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83899999999999997,"5min":1.004,"15min":1.004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.41299999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.84899999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.69099999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70399999999999996,"15min":0.68799999999999994},"min":{"1min":0.501,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85099999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.72099999999999997,"15min":0.70499999999999996},"min":{"1min":0.501,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92800000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48299999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70399999999999996,"15min":0.70199999999999996},"min":{"1min":0.56200000000000006,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86099999999999999,"5min":1.083,"15min":1.083},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76100000000000001,"15min":0.745},"min":{"1min":0.54000000000000004,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92400000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:31:55.760 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T04:31:55.760 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:31:55.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.945+0000 7f0b0179d700 1 Processor -- start 2023-10-06T04:31:55.946 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.945+0000 7f0b0179d700 1 -- start start 2023-10-06T04:31:55.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.946+0000 7f0b0179d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0afc0acc50 0x7f0afc0698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:55.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.946+0000 7f0b0179d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0afc0cece0 0x7f0afc069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:55.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.946+0000 7f0b0179d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0afc068760 con 0x7f0afc159350 2023-10-06T04:31:55.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.946+0000 7f0b0179d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0afc159e30 con 0x7f0afc0acc50 2023-10-06T04:31:55.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.946+0000 7f0b0179d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0afc068a40 con 0x7f0afc0cece0 2023-10-06T04:31:55.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.947+0000 7f0afb7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0afc0acc50 0x7f0afc0698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:55.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.947+0000 7f0afb7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0afc0acc50 0x7f0afc0698a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42580/0 (socket says 172.21.15.60:42580) 2023-10-06T04:31:55.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.947+0000 7f0afbfff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0afc159350 0x7f0afc159720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34926/0 (socket says 172.21.15.60:34926) 2023-10-06T04:31:55.948 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.947+0000 7f0afb7fe700 1 -- 172.21.15.60:0/2945921309 learned_addr learned my addr 172.21.15.60:0/2945921309 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:55.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.947+0000 7f0b00f9c700 1 --2- 172.21.15.60:0/2945921309 >> v2:172.21.15.135:3300/0 conn(0x7f0afc0cece0 0x7f0afc069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:55.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.947+0000 7f0afb7fe700 1 -- 172.21.15.60:0/2945921309 >> v2:172.21.15.135:3300/0 conn(0x7f0afc0cece0 msgr2=0x7f0afc069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:55.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.947+0000 7f0afb7fe700 1 --2- 172.21.15.60:0/2945921309 >> v2:172.21.15.135:3300/0 conn(0x7f0afc0cece0 0x7f0afc069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.947+0000 7f0afb7fe700 1 -- 172.21.15.60:0/2945921309 >> v1:172.21.15.60:6789/0 conn(0x7f0afc159350 legacy=0x7f0afc159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:55.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.947+0000 7f0afb7fe700 1 -- 172.21.15.60:0/2945921309 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc068d20 con 0x7f0afc0acc50 2023-10-06T04:31:55.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.947+0000 7f0afaffd700 1 -- 172.21.15.60:0/2945921309 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659054292 0 0) 0x7f0afc068760 con 0x7f0afc159350 2023-10-06T04:31:55.950 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.948+0000 7f0afb7fe700 1 --2- 172.21.15.60:0/2945921309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0afc0acc50 0x7f0afc0698a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0afc06a860 tx=0x7f0af0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc4b8f5bb8627ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:55.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.948+0000 7f0afaffd700 1 -- 172.21.15.60:0/2945921309 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0009e70 con 0x7f0afc0acc50 2023-10-06T04:31:55.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.948+0000 7f0afaffd700 1 -- 172.21.15.60:0/2945921309 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af000b860 con 0x7f0afc0acc50 2023-10-06T04:31:55.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.948+0000 7f0afaffd700 1 -- 172.21.15.60:0/2945921309 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af000bc00 con 0x7f0afc0acc50 2023-10-06T04:31:55.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.948+0000 7f0b0179d700 1 -- 172.21.15.60:0/2945921309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0afc0acc50 msgr2=0x7f0afc0698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:55.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.948+0000 7f0b0179d700 1 --2- 172.21.15.60:0/2945921309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0afc0acc50 0x7f0afc0698a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0afc06a860 tx=0x7f0af0009250 comp rx=0 tx=0).stop 2023-10-06T04:31:55.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.948+0000 7f0b0179d700 1 -- 172.21.15.60:0/2945921309 shutdown_connections 2023-10-06T04:31:55.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.948+0000 7f0b0179d700 1 --2- 172.21.15.60:0/2945921309 >> v2:172.21.15.135:3300/0 conn(0x7f0afc0cece0 0x7f0afc069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.948+0000 7f0b0179d700 1 --2- 172.21.15.60:0/2945921309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0afc0acc50 0x7f0afc0698a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.948+0000 7f0b0179d700 1 -- 172.21.15.60:0/2945921309 >> 172.21.15.60:0/2945921309 conn(0x7f0afc067d90 msgr2=0x7f0afc0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:55.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.949+0000 7f0b0179d700 1 -- 172.21.15.60:0/2945921309 shutdown_connections 2023-10-06T04:31:55.951 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.949+0000 7f0b0179d700 1 -- 172.21.15.60:0/2945921309 wait complete. 2023-10-06T04:31:55.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.950+0000 7f0b0179d700 1 Processor -- start 2023-10-06T04:31:55.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.950+0000 7f0b0179d700 1 -- start start 2023-10-06T04:31:55.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.951+0000 7f0b0179d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0afc0acc50 0x7f0afc169190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:55.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.951+0000 7f0b0179d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0afc0cece0 0x7f0afc151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:55.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.951+0000 7f0b0179d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0afc159350 0x7f0afc0b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:55.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.951+0000 7f0b0179d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc0b3300 con 0x7f0afc159350 2023-10-06T04:31:55.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.951+0000 7f0b0179d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc1519a0 con 0x7f0afc0cece0 2023-10-06T04:31:55.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.951+0000 7f0b0179d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc09a7e0 con 0x7f0afc0acc50 2023-10-06T04:31:55.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.951+0000 7f0b00f9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0afc159350 0x7f0afc0b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:55.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.951+0000 7f0b00f9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0afc159350 0x7f0afc0b1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42592/0 (socket says 172.21.15.60:42592) 2023-10-06T04:31:55.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.951+0000 7f0b00f9c700 1 -- 172.21.15.60:0/218826332 learned_addr learned my addr 172.21.15.60:0/218826332 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:55.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.952+0000 7f0afb7fe700 1 --2- 172.21.15.60:0/218826332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0afc0cece0 0x7f0afc151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:55.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.952+0000 7f0afbfff700 1 --2- 172.21.15.60:0/218826332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0afc0acc50 0x7f0afc169190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:55.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.952+0000 7f0b00f9c700 1 -- 172.21.15.60:0/218826332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0afc0acc50 msgr2=0x7f0afc169190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:55.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.952+0000 7f0b00f9c700 1 --2- 172.21.15.60:0/218826332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0afc0acc50 0x7f0afc169190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.952+0000 7f0b00f9c700 1 -- 172.21.15.60:0/218826332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0afc0cece0 msgr2=0x7f0afc151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:55.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.952+0000 7f0b00f9c700 1 --2- 172.21.15.60:0/218826332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0afc0cece0 0x7f0afc151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:55.954 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.952+0000 7f0b00f9c700 1 -- 172.21.15.60:0/218826332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af00094f0 con 0x7f0afc159350 2023-10-06T04:31:55.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.952+0000 7f0afbfff700 1 --2- 172.21.15.60:0/218826332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0afc0acc50 0x7f0afc169190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:31:55.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.952+0000 7f0b00f9c700 1 --2- 172.21.15.60:0/218826332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0afc159350 0x7f0afc0b1fa0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009e90 tx=0x7f0af400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:55.955 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.952+0000 7f0ae3fff700 1 -- 172.21.15.60:0/218826332 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af400cc20 con 0x7f0afc159350 2023-10-06T04:31:55.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.952+0000 7f0ae3fff700 1 -- 172.21.15.60:0/218826332 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af400f040 con 0x7f0afc159350 2023-10-06T04:31:55.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.952+0000 7f0ae3fff700 1 -- 172.21.15.60:0/218826332 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4014480 con 0x7f0afc159350 2023-10-06T04:31:55.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.952+0000 7f0b0179d700 1 -- 172.21.15.60:0/218826332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0afc0b2a60 con 0x7f0afc159350 2023-10-06T04:31:55.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.952+0000 7f0b0179d700 1 -- 172.21.15.60:0/218826332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0afc0b3020 con 0x7f0afc159350 2023-10-06T04:31:55.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.953+0000 7f0b0179d700 1 -- 172.21.15.60:0/218826332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0afc05f230 con 0x7f0afc159350 2023-10-06T04:31:55.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.954+0000 7f0ae3fff700 1 -- 172.21.15.60:0/218826332 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0af4014830 con 0x7f0afc159350 2023-10-06T04:31:55.956 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.955+0000 7f0ae3fff700 1 --2- 172.21.15.60:0/218826332 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0ae8066f30 0x7f0ae80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:55.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.955+0000 7f0ae3fff700 1 -- 172.21.15.60:0/218826332 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f0af4084fe0 con 0x7f0afc159350 2023-10-06T04:31:55.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.955+0000 7f0afbfff700 1 --2- 172.21.15.60:0/218826332 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0ae8066f30 0x7f0ae80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:55.957 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.956+0000 7f0afbfff700 1 --2- 172.21.15.60:0/218826332 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0ae8066f30 0x7f0ae80693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0aec001790 tx=0x7f0aec009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:55.960 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:55.959+0000 7f0ae3fff700 1 -- 172.21.15.60:0/218826332 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0af4055cc0 con 0x7f0afc159350 2023-10-06T04:31:56.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.156+0000 7f0b0179d700 1 -- 172.21.15.60:0/218826332 --> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0afc069000 con 0x7f0ae8066f30 2023-10-06T04:31:56.161 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.160+0000 7f0ae3fff700 1 -- 172.21.15.60:0/218826332 <== mgr.4098 v2:172.21.15.60:6832/85285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73253 (secure 0 0 0) 0x7f0afc069000 con 0x7f0ae8066f30 2023-10-06T04:31:56.162 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:31:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.162+0000 7f0b0179d700 1 -- 172.21.15.60:0/218826332 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0ae8066f30 msgr2=0x7f0ae80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.162+0000 7f0b0179d700 1 --2- 172.21.15.60:0/218826332 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0ae8066f30 0x7f0ae80693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0aec001790 tx=0x7f0aec009040 comp rx=0 tx=0).stop 2023-10-06T04:31:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.162+0000 7f0b0179d700 1 -- 172.21.15.60:0/218826332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0afc159350 msgr2=0x7f0afc0b1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.162+0000 7f0b0179d700 1 --2- 172.21.15.60:0/218826332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0afc159350 0x7f0afc0b1fa0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009e90 tx=0x7f0af400b040 comp rx=0 tx=0).stop 2023-10-06T04:31:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.162+0000 7f0b0179d700 1 -- 172.21.15.60:0/218826332 shutdown_connections 2023-10-06T04:31:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.162+0000 7f0b0179d700 1 --2- 172.21.15.60:0/218826332 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f0ae8066f30 0x7f0ae80693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.162+0000 7f0b0179d700 1 --2- 172.21.15.60:0/218826332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0afc159350 0x7f0afc0b1fa0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.162+0000 7f0b0179d700 1 --2- 172.21.15.60:0/218826332 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0afc0acc50 0x7f0afc169190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.162+0000 7f0b0179d700 1 --2- 172.21.15.60:0/218826332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0afc0cece0 0x7f0afc151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:56.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.162+0000 7f0b0179d700 1 -- 172.21.15.60:0/218826332 >> 172.21.15.60:0/218826332 conn(0x7f0afc067d90 msgr2=0x7f0afc152bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:56.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.162+0000 7f0b0179d700 1 -- 172.21.15.60:0/218826332 shutdown_connections 2023-10-06T04:31:56.165 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.162+0000 7f0b0179d700 1 -- 172.21.15.60:0/218826332 wait complete. 2023-10-06T04:31:56.165 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-06T04:31:56.181 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2023-10-06T04:31:55.356390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404000,"kb_used_data":5216,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752570720,"statfs":{"total":773094113280,"available":770632417280,"internally_reserved":0,"allocated":5341184,"data_stored":3071507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-769433,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-5,"num_write":-146,"num_write_kb":-804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.324329"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:31:51.398156+0000","last_change":"2023-10-06T04:28:00.325832+0000","last_active":"2023-10-06T04:31:51.398156+0000","last_peered":"2023-10-06T04:31:51.398156+0000","last_clean":"2023-10-06T04:31:51.398156+0000","last_became_active":"2023-10-06T04:28:00.325466+0000","last_became_peered":"2023-10-06T04:28:00.325466+0000","last_unstale":"2023-10-06T04:31:51.398156+0000","last_undegraded":"2023-10-06T04:31:51.398156+0000","last_fullsized":"2023-10-06T04:31:51.398156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:31:49.232810+0000","last_change":"2023-10-06T04:28:00.175241+0000","last_active":"2023-10-06T04:31:49.232810+0000","last_peered":"2023-10-06T04:31:49.232810+0000","last_clean":"2023-10-06T04:31:49.232810+0000","last_became_active":"2023-10-06T04:28:00.174814+0000","last_became_peered":"2023-10-06T04:28:00.174814+0000","last_unstale":"2023-10-06T04:31:49.232810+0000","last_undegraded":"2023-10-06T04:31:49.232810+0000","last_fullsized":"2023-10-06T04:31:49.232810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":33,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:31:49.231779+0000","last_change":"2023-10-06T04:28:00.175086+0000","last_active":"2023-10-06T04:31:49.231779+0000","last_peered":"2023-10-06T04:31:49.231779+0000","last_clean":"2023-10-06T04:31:49.231779+0000","last_became_active":"2023-10-06T04:28:00.174735+0000","last_became_peered":"2023-10-06T04:28:00.174735+0000","last_unstale":"2023-10-06T04:31:49.231779+0000","last_undegraded":"2023-10-06T04:31:49.231779+0000","last_fullsized":"2023-10-06T04:31:49.231779+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":184,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:31:49.231489+0000","last_change":"2023-10-06T04:28:01.176177+0000","last_active":"2023-10-06T04:31:49.231489+0000","last_peered":"2023-10-06T04:31:49.231489+0000","last_clean":"2023-10-06T04:31:49.231489+0000","last_became_active":"2023-10-06T04:28:01.175255+0000","last_became_peered":"2023-10-06T04:28:01.175255+0000","last_unstale":"2023-10-06T04:31:49.231489+0000","last_undegraded":"2023-10-06T04:31:49.231489+0000","last_fullsized":"2023-10-06T04:31:49.231489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:00.161020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:00.161020+0000","last_clean_scrub_stamp":"2023-10-06T04:28:00.161020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:29.208067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:31:49.231716+0000","last_change":"2023-10-06T04:28:00.344573+0000","last_active":"2023-10-06T04:31:49.231716+0000","last_peered":"2023-10-06T04:31:49.231716+0000","last_clean":"2023-10-06T04:31:49.231716+0000","last_became_active":"2023-10-06T04:28:00.344324+0000","last_became_peered":"2023-10-06T04:28:00.344324+0000","last_unstale":"2023-10-06T04:31:49.231716+0000","last_undegraded":"2023-10-06T04:31:49.231716+0000","last_fullsized":"2023-10-06T04:31:49.231716+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:24.184826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:31:49.231398+0000","last_change":"2023-10-06T04:28:00.343571+0000","last_active":"2023-10-06T04:31:49.231398+0000","last_peered":"2023-10-06T04:31:49.231398+0000","last_clean":"2023-10-06T04:31:49.231398+0000","last_became_active":"2023-10-06T04:28:00.343268+0000","last_became_peered":"2023-10-06T04:28:00.343268+0000","last_unstale":"2023-10-06T04:31:49.231398+0000","last_undegraded":"2023-10-06T04:31:49.231398+0000","last_fullsized":"2023-10-06T04:31:49.231398+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:00.931419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":34,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T04:31:49.231072+0000","last_change":"2023-10-06T04:28:00.344460+0000","last_active":"2023-10-06T04:31:49.231072+0000","last_peered":"2023-10-06T04:31:49.231072+0000","last_clean":"2023-10-06T04:31:49.231072+0000","last_became_active":"2023-10-06T04:28:00.343280+0000","last_became_peered":"2023-10-06T04:28:00.343280+0000","last_unstale":"2023-10-06T04:31:49.231072+0000","last_undegraded":"2023-10-06T04:31:49.231072+0000","last_fullsized":"2023-10-06T04:31:49.231072+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:31:51.399053+0000","last_change":"2023-10-06T04:28:00.343592+0000","last_active":"2023-10-06T04:31:51.399053+0000","last_peered":"2023-10-06T04:31:51.399053+0000","last_clean":"2023-10-06T04:31:51.399053+0000","last_became_active":"2023-10-06T04:28:00.343313+0000","last_became_peered":"2023-10-06T04:28:00.343313+0000","last_unstale":"2023-10-06T04:31:51.399053+0000","last_undegraded":"2023-10-06T04:31:51.399053+0000","last_fullsized":"2023-10-06T04:31:51.399053+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:24.184826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:31:51.399553+0000","last_change":"2023-10-06T04:28:00.174563+0000","last_active":"2023-10-06T04:31:51.399553+0000","last_peered":"2023-10-06T04:31:51.399553+0000","last_clean":"2023-10-06T04:31:51.399553+0000","last_became_active":"2023-10-06T04:28:00.174265+0000","last_became_peered":"2023-10-06T04:28:00.174265+0000","last_unstale":"2023-10-06T04:31:51.399553+0000","last_undegraded":"2023-10-06T04:31:51.399553+0000","last_fullsized":"2023-10-06T04:31:51.399553+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:00.931419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302464,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069376,"statfs":{"total":96636764160,"available":96327041024,"internally_reserved":0,"allocated":1105920,"data_stored":824213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.73299999999999998,"15min":0.78900000000000003},"min":{"1min":0.42699999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79200000000000004,"5min":4.3070000000000004,"15min":4.3070000000000004},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.83199999999999996,"15min":0.93999999999999995},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.67500000000000004,"5min":8.1609999999999996,"15min":8.1609999999999996},"last":0.64200000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.77700000000000002,"15min":0.83899999999999997},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.755,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.81299999999999994,"15min":0.89200000000000002},"min":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91300000000000003,"5min":6.3079999999999998,"15min":6.3079999999999998},"last":0.749}]},{"osd":2,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.76100000000000001,"15min":0.79400000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96999999999999997,"5min":4.4619999999999997,"15min":4.4619999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.92800000000000005,"15min":1.054},"min":{"1min":0.55900000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.73999999999999999,"5min":8.2840000000000007,"15min":8.2840000000000007},"last":0.72499999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.76300000000000001,"15min":0.81499999999999995},"min":{"1min":0.48399999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80200000000000005,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.73799999999999999,"15min":0.76600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.81899999999999995,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.58999999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.876,"15min":0.97399999999999998},"min":{"1min":0.48499999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84799999999999998,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.82799999999999996,"15min":0.86299999999999999},"min":{"1min":0.64800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89000000000000001,"5min":3.3980000000000001,"15min":3.3980000000000001},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.86299999999999999,"15min":0.94099999999999995},"min":{"1min":0.499,"5min":0.439,"15min":0.439},"max":{"1min":1.0049999999999999,"5min":6.8200000000000003,"15min":6.8200000000000003},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.95699999999999996,"15min":1.0629999999999999},"min":{"1min":0.53800000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.88200000000000001,"5min":8.3439999999999994,"15min":8.3439999999999994},"last":0.77500000000000002}]},{"osd":6,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.90800000000000003,"15min":0.98799999999999999},"min":{"1min":0.60399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80300000000000005,"5min":6.2839999999999998,"15min":6.2839999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.83499999999999996,"15min":0.88500000000000001},"min":{"1min":0.53300000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94199999999999995,"5min":4.1420000000000003,"15min":4.1420000000000003},"last":0.66800000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297808,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074032,"statfs":{"total":96636764160,"available":96331808768,"internally_reserved":0,"allocated":532480,"data_stored":241083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.44,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82899999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.78900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.623}]},{"osd":1,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.51400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.79900000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.53000000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.85599999999999998,"5min":1,"15min":1},"last":0.746}]},{"osd":2,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81799999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63600000000000001,"15min":0.63200000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.70699999999999996,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.71899999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67500000000000004,"15min":0.68000000000000005},"min":{"1min":0.504,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82899999999999996,"5min":1.018,"15min":1.018},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.53400000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.64800000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.439,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.747,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.871},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89600000000000002,"5min":1.052,"15min":1.052},"last":0.83799999999999997}]},{"osd":5,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.42799999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.874,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.72299999999999998},"min":{"1min":0.58399999999999996,"5min":0.439,"15min":0.439},"max":{"1min":0.85999999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.90600000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":4.2709999999999999,"15min":5.8330000000000002},"min":{"1min":0.59599999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.93999999999999995,"5min":165.47,"15min":165.47},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":4.266,"15min":5.8230000000000004},"min":{"1min":0.52400000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92500000000000004,"5min":165.51300000000001,"15min":165.51300000000001},"last":0.79200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302464,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069376,"statfs":{"total":96636764160,"available":96327041024,"internally_reserved":0,"allocated":1105920,"data_stored":823488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.436,"15min":0.44400000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56399999999999995,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.48099999999999998,"15min":0.46800000000000003},"min":{"1min":0.30499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.52900000000000003,"5min":3.282,"15min":3.282},"last":0.443}]},{"osd":2,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.54200000000000004,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.54000000000000004,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.503,"15min":0.48899999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65900000000000003,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":0.56299999999999994}]},{"osd":3,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.55900000000000005,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.54700000000000004,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.54900000000000004,"15min":0.54000000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60599999999999998,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.49399999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.55900000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.85999999999999999,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":0.87},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.79800000000000004,"15min":0.79700000000000004},"min":{"1min":0.52800000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95499999999999996,"5min":3.847,"15min":3.847},"last":0.89100000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.81499999999999995,"15min":0.81299999999999994},"min":{"1min":0.57099999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91800000000000004,"5min":3.9809999999999999,"15min":3.9809999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.81100000000000005,"15min":0.81000000000000005},"min":{"1min":0.60499999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.878,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.85099999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.81000000000000005,"15min":0.81799999999999995},"min":{"1min":0.59699999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.90400000000000003,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.85699999999999998,"15min":0.86899999999999999},"min":{"1min":0.59499999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.98499999999999999,"5min":4.0270000000000001,"15min":4.0270000000000001},"last":0.83899999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.82299999999999995,"15min":0.81799999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93200000000000005,"5min":3.4769999999999999,"15min":3.4769999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.94499999999999995,"5min":3.5720000000000001,"15min":3.5720000000000001},"last":0.91900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":512000,"data_stored":233845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45300000000000001,"15min":0.46500000000000002},"min":{"1min":0.29899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58799999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45700000000000002,"15min":0.46300000000000002},"min":{"1min":0.32600000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.496}]},{"osd":2,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.36699999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.54900000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.54800000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.45900000000000002,"15min":0.45800000000000002},"min":{"1min":0.38,"5min":0.309,"15min":0.309},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54000000000000004,"15min":0.55400000000000005},"min":{"1min":0.436,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.59599999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.75},"min":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.94699999999999995,"5min":1.077,"15min":1.077},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75600000000000001,"15min":0.77000000000000002},"min":{"1min":0.58499999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.99399999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.70599999999999996}]},{"osd":5,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.61299999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97499999999999998,"5min":1.147,"15min":1.147},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.58499999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90700000000000003,"5min":1.167,"15min":1.167},"last":0.74099999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77900000000000003,"15min":0.78400000000000003},"min":{"1min":0.64900000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.93700000000000006,"5min":1.137,"15min":1.137},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.59099999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.95799999999999996,"5min":1.071,"15min":1.071},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.77200000000000002,"15min":0.78400000000000003},"min":{"1min":0.61199999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91800000000000004,"5min":1.048,"15min":1.048},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.60699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93899999999999995,"5min":1.103,"15min":1.103},"last":0.875}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":528384,"data_stored":240105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42099999999999999,"15min":0.42699999999999999},"min":{"1min":0.30499999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.56999999999999995,"5min":0.877,"15min":0.877},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.46700000000000003,"15min":0.48299999999999998},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.51600000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.54800000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45400000000000001,"15min":0.47199999999999998},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.56100000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.51500000000000001,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.54400000000000004,"5min":1.524,"15min":1.524},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.54900000000000004,"15min":0.56699999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.622,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.54400000000000004,"15min":0.56499999999999995},"min":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.61399999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60999999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75,"15min":0.745},"min":{"1min":0.60199999999999998,"5min":0.504,"15min":0.504},"max":{"1min":0.92100000000000004,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78100000000000003,"15min":0.78900000000000003},"min":{"1min":0.52800000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93200000000000005,"5min":1.393,"15min":1.393},"last":0.80200000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.55500000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0369999999999999,"5min":1.381,"15min":1.381},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77500000000000002,"15min":0.78000000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96999999999999997,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.79000000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.79900000000000004,"15min":0.80500000000000005},"min":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98099999999999998,"5min":1.351,"15min":1.351},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.80500000000000005,"15min":0.82099999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.996,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.62}]},{"osd":7,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.98599999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.82199999999999995,"15min":0.83399999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.97299999999999998,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.91700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":512000,"data_stored":233845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44400000000000001,"15min":0.45200000000000001},"min":{"1min":0.29199999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70299999999999996,"5min":0.873,"15min":0.873},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.32400000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46600000000000003,"15min":0.46800000000000003},"min":{"1min":0.34999999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.58099999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55300000000000005,"15min":0.56499999999999995},"min":{"1min":0.41299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.69499999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.625,"5min":1.248,"15min":1.248},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57099999999999995,"15min":0.59099999999999997},"min":{"1min":0.42799999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77600000000000002,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.65100000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78400000000000003,"15min":0.82399999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.28,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.79200000000000004,"15min":0.83199999999999996},"min":{"1min":0.57199999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.83999999999999997,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.93200000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.81799999999999995,"15min":0.86099999999999999},"min":{"1min":0.61799999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.89700000000000002,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.81299999999999994,"15min":0.85099999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3280000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.871}]},{"osd":6,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.83299999999999996,"15min":0.88100000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.94799999999999995,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.82799999999999996,"15min":0.86699999999999999},"min":{"1min":0.60099999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92400000000000004,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.96699999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.83499999999999996,"15min":0.86899999999999999},"min":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3680000000000001,"5min":1.603,"15min":1.603},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.83199999999999996,"15min":0.876},"min":{"1min":0.624,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.997,"5min":1.534,"15min":1.534},"last":0.82099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297808,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074032,"statfs":{"total":96636764160,"available":96331808768,"internally_reserved":0,"allocated":532480,"data_stored":241083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.44500000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.78300000000000003,"5min":1.177,"15min":1.177},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68799999999999994,"15min":0.70099999999999996},"min":{"1min":0.47599999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88700000000000001,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.72699999999999998}]},{"osd":1,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.625,"5min":0.434,"15min":0.434},"max":{"1min":0.81999999999999995,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.749},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.72199999999999998,"15min":0.746},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.72599999999999998,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.67800000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68999999999999995,"15min":0.70399999999999996},"min":{"1min":0.49099999999999999,"5min":0.441,"15min":0.441},"max":{"1min":0.80500000000000005,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.874,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.63100000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.93899999999999995,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.71799999999999997,"15min":0.74199999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.745,"5min":1.948,"15min":1.948},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.746,"15min":0.75600000000000001},"min":{"1min":0.56200000000000006,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0049999999999999,"5min":1.893,"15min":1.893},"last":0.439},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.51900000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.80100000000000005,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.71099999999999997,"15min":0.73299999999999998},"min":{"1min":0.46400000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85299999999999998,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.505,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97799999999999998,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":0.57099999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.60099999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91800000000000004,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.59199999999999997,"5min":0.497,"15min":0.497},"max":{"1min":0.92800000000000005,"5min":1.99,"15min":1.99},"last":0.66800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297788,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074052,"statfs":{"total":96636764160,"available":96331829248,"internally_reserved":0,"allocated":512000,"data_stored":233845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.622,"15min":0.60099999999999998},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.748},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.62,"15min":0.622},"min":{"1min":0.46300000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.751,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.82499999999999996}]},{"osd":1,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.83799999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.67600000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67600000000000005,"15min":0.67400000000000004},"min":{"1min":0.51400000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98099999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91400000000000003,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.78700000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.47399999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.78700000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.61499999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89000000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.80500000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65400000000000003,"15min":0.63300000000000001},"min":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83899999999999997,"5min":1.004,"15min":1.004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.41299999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.84899999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.69099999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70399999999999996,"15min":0.68799999999999994},"min":{"1min":0.501,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85099999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.72099999999999997,"15min":0.70499999999999996},"min":{"1min":0.501,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92800000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48299999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70399999999999996,"15min":0.70199999999999996},"min":{"1min":0.56200000000000006,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86099999999999999,"5min":1.083,"15min":1.083},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76100000000000001,"15min":0.745},"min":{"1min":0.54000000000000004,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92400000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:31:56.184 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T04:31:56.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.370+0000 7f29c47ff700 1 Processor -- start 2023-10-06T04:31:56.372 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.371+0000 7f29c47ff700 1 -- start start 2023-10-06T04:31:56.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.372+0000 7f29c47ff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f29bc0ac000 0x7f29bc069520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:56.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.372+0000 7f29c47ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29bc069a60 0x7f29bc0c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:56.373 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.372+0000 7f29c47ff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29bc0c7330 con 0x7f29bc0adf20 2023-10-06T04:31:56.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.372+0000 7f29c47ff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29bc156110 con 0x7f29bc0ac000 2023-10-06T04:31:56.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.372+0000 7f29c47ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc069ee0 con 0x7f29bc069a60 2023-10-06T04:31:56.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.372+0000 7f29c1d9a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f29bc0ac000 0x7f29bc069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:56.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.372+0000 7f29c1d9a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f29bc0ac000 0x7f29bc069520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42600/0 (socket says 172.21.15.60:42600) 2023-10-06T04:31:56.374 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.372+0000 7f29c1d9a700 1 -- 172.21.15.60:0/4219650777 learned_addr learned my addr 172.21.15.60:0/4219650777 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:56.375 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.373+0000 7f29c2d9c700 1 --2- 172.21.15.60:0/4219650777 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29bc069a60 0x7f29bc0c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:56.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.373+0000 7f29c1d9a700 1 -- 172.21.15.60:0/4219650777 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29bc069a60 msgr2=0x7f29bc0c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:56.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.373+0000 7f29c1d9a700 1 --2- 172.21.15.60:0/4219650777 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29bc069a60 0x7f29bc0c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:56.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.373+0000 7f29c1d9a700 1 -- 172.21.15.60:0/4219650777 >> v1:172.21.15.60:6789/0 conn(0x7f29bc0adf20 legacy=0x7f29bc06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:56.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.373+0000 7f29c1599700 1 -- 172.21.15.60:0/4219650777 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3196902437 0 0) 0x7f29bc0c7330 con 0x7f29bc0adf20 2023-10-06T04:31:56.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.373+0000 7f29c1d9a700 1 -- 172.21.15.60:0/4219650777 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc0c6720 con 0x7f29bc0ac000 2023-10-06T04:31:56.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.373+0000 7f29c2d9c700 1 --2- 172.21.15.60:0/4219650777 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29bc069a60 0x7f29bc0c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:31:56.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.373+0000 7f29c1d9a700 1 --2- 172.21.15.60:0/4219650777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29bc0ac000 0x7f29bc069520 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0099e0 tx=0x7f29ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2a426a3a3578de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:56.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.373+0000 7f29c1599700 1 -- 172.21.15.60:0/4219650777 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00b820 con 0x7f29bc0ac000 2023-10-06T04:31:56.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.373+0000 7f29c1599700 1 -- 172.21.15.60:0/4219650777 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac00b980 con 0x7f29bc0ac000 2023-10-06T04:31:56.376 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.373+0000 7f29c1599700 1 -- 172.21.15.60:0/4219650777 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00bd20 con 0x7f29bc0ac000 2023-10-06T04:31:56.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.374+0000 7f29c47ff700 1 -- 172.21.15.60:0/4219650777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29bc0ac000 msgr2=0x7f29bc069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:56.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.374+0000 7f29c47ff700 1 --2- 172.21.15.60:0/4219650777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29bc0ac000 0x7f29bc069520 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0099e0 tx=0x7f29ac009250 comp rx=0 tx=0).stop 2023-10-06T04:31:56.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.374+0000 7f29c47ff700 1 -- 172.21.15.60:0/4219650777 shutdown_connections 2023-10-06T04:31:56.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.374+0000 7f29c47ff700 1 --2- 172.21.15.60:0/4219650777 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29bc069a60 0x7f29bc0c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:56.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.374+0000 7f29c47ff700 1 --2- 172.21.15.60:0/4219650777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29bc0ac000 0x7f29bc069520 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:56.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.374+0000 7f29c47ff700 1 -- 172.21.15.60:0/4219650777 >> 172.21.15.60:0/4219650777 conn(0x7f29bc068080 msgr2=0x7f29bc0cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:56.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.374+0000 7f29c47ff700 1 -- 172.21.15.60:0/4219650777 shutdown_connections 2023-10-06T04:31:56.377 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.374+0000 7f29c47ff700 1 -- 172.21.15.60:0/4219650777 wait complete. 2023-10-06T04:31:56.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.375+0000 7f29c47ff700 1 Processor -- start 2023-10-06T04:31:56.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.375+0000 7f29c47ff700 1 -- start start 2023-10-06T04:31:56.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.376+0000 7f29c47ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29bc069a60 0x7f29bc0a5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:56.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.376+0000 7f29c47ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29bc0ac000 0x7f29bc0c03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:56.379 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.376+0000 7f29c47ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29bc0adf20 0x7f29bc1555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:56.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.376+0000 7f29c47ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0ab9a0 con 0x7f29bc069a60 2023-10-06T04:31:56.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.376+0000 7f29c47ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0c0900 con 0x7f29bc0ac000 2023-10-06T04:31:56.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.376+0000 7f29c47ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0c1640 con 0x7f29bc0adf20 2023-10-06T04:31:56.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.377+0000 7f29c259b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29bc069a60 0x7f29bc0a5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:56.380 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.377+0000 7f29c259b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29bc069a60 0x7f29bc0a5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42606/0 (socket says 172.21.15.60:42606) 2023-10-06T04:31:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.377+0000 7f29c259b700 1 -- 172.21.15.60:0/3422978904 learned_addr learned my addr 172.21.15.60:0/3422978904 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.377+0000 7f29c2d9c700 1 --2- 172.21.15.60:0/3422978904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29bc0adf20 0x7f29bc1555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.377+0000 7f29c1d9a700 1 --2- 172.21.15.60:0/3422978904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29bc0ac000 0x7f29bc0c03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.377+0000 7f29c259b700 1 -- 172.21.15.60:0/3422978904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29bc0adf20 msgr2=0x7f29bc1555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.377+0000 7f29c259b700 1 --2- 172.21.15.60:0/3422978904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29bc0adf20 0x7f29bc1555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.377+0000 7f29c259b700 1 -- 172.21.15.60:0/3422978904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29bc0ac000 msgr2=0x7f29bc0c03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.377+0000 7f29c259b700 1 --2- 172.21.15.60:0/3422978904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29bc0ac000 0x7f29bc0c03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.377+0000 7f29c259b700 1 -- 172.21.15.60:0/3422978904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac0094f0 con 0x7f29bc069a60 2023-10-06T04:31:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.377+0000 7f29c1d9a700 1 --2- 172.21.15.60:0/3422978904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29bc0ac000 0x7f29bc0c03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:31:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.377+0000 7f29c2d9c700 1 --2- 172.21.15.60:0/3422978904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29bc0adf20 0x7f29bc1555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:31:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.377+0000 7f29c259b700 1 --2- 172.21.15.60:0/3422978904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29bc069a60 0x7f29bc0a5f90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f29b800c560 tx=0x7f29b800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:56.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.378+0000 7f29b27fc700 1 -- 172.21.15.60:0/3422978904 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b8011590 con 0x7f29bc069a60 2023-10-06T04:31:56.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.378+0000 7f29b27fc700 1 -- 172.21.15.60:0/3422978904 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b8011710 con 0x7f29bc069a60 2023-10-06T04:31:56.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.378+0000 7f29b27fc700 1 -- 172.21.15.60:0/3422978904 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b8011ad0 con 0x7f29bc069a60 2023-10-06T04:31:56.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.378+0000 7f29c47ff700 1 -- 172.21.15.60:0/3422978904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29bc0ab3e0 con 0x7f29bc069a60 2023-10-06T04:31:56.382 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.378+0000 7f29c47ff700 1 -- 172.21.15.60:0/3422978904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29bc0c12d0 con 0x7f29bc069a60 2023-10-06T04:31:56.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.379+0000 7f29c47ff700 1 -- 172.21.15.60:0/3422978904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29bc064a90 con 0x7f29bc069a60 2023-10-06T04:31:56.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.380+0000 7f29b27fc700 1 -- 172.21.15.60:0/3422978904 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f29b801b3b0 con 0x7f29bc069a60 2023-10-06T04:31:56.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.380+0000 7f29b27fc700 1 --2- 172.21.15.60:0/3422978904 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f29a0066f00 0x7f29a00693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:56.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.381+0000 7f29b27fc700 1 -- 172.21.15.60:0/3422978904 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f29b8083b40 con 0x7f29bc069a60 2023-10-06T04:31:56.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.381+0000 7f29c1d9a700 1 --2- 172.21.15.60:0/3422978904 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f29a0066f00 0x7f29a00693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:56.383 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.381+0000 7f29c1d9a700 1 --2- 172.21.15.60:0/3422978904 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f29a0066f00 0x7f29a00693b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0099e0 tx=0x7f29ac019000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:56.386 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.385+0000 7f29b27fc700 1 -- 172.21.15.60:0/3422978904 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29b8050d70 con 0x7f29bc069a60 2023-10-06T04:31:56.591 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.590+0000 7f29c47ff700 1 -- 172.21.15.60:0/3422978904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29bc0c6a00 con 0x7f29bc069a60 2023-10-06T04:31:56.624 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.591+0000 7f29b27fc700 1 -- 172.21.15.60:0/3422978904 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+13982 (secure 0 0 0) 0x7f29b8017070 con 0x7f29bc069a60 2023-10-06T04:31:56.625 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:31:56.625 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":45,"fsid":"caf6a2b8-149e-4228-9a04-404e2d811afd","created":"2023-10-06T04:27:46.329482+0000","modified":"2023-10-06T04:31:52.393891+0000","last_up_change":"2023-10-06T04:27:58.156069+0000","last_in_change":"2023-10-06T04:27:49.708805+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T04:27:58.899938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T04:27:59.373527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"980b2611-d623-4101-bba3-1f1a600ead7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":85568},{"type":"v1","addr":"172.21.15.60:6809","nonce":85568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":85568},{"type":"v1","addr":"172.21.15.60:6811","nonce":85568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":85568},{"type":"v1","addr":"172.21.15.60:6815","nonce":85568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":85568},{"type":"v1","addr":"172.21.15.60:6813","nonce":85568}]},"public_addr":"172.21.15.60:6809/85568","cluster_addr":"172.21.15.60:6811/85568","heartbeat_back_addr":"172.21.15.60:6815/85568","heartbeat_front_addr":"172.21.15.60:6813/85568","state":["exists","up"]},{"osd":1,"uuid":"9d917ccf-bddf-4b2b-b789-5c05f4d36df3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":85567},{"type":"v1","addr":"172.21.15.60:6801","nonce":85567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":85567},{"type":"v1","addr":"172.21.15.60:6803","nonce":85567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":85567},{"type":"v1","addr":"172.21.15.60:6807","nonce":85567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":85567},{"type":"v1","addr":"172.21.15.60:6805","nonce":85567}]},"public_addr":"172.21.15.60:6801/85567","cluster_addr":"172.21.15.60:6803/85567","heartbeat_back_addr":"172.21.15.60:6807/85567","heartbeat_front_addr":"172.21.15.60:6805/85567","state":["exists","up"]},{"osd":2,"uuid":"7dd03cbd-960c-49c2-8380-066f29f247b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":85570},{"type":"v1","addr":"172.21.15.60:6817","nonce":85570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":85570},{"type":"v1","addr":"172.21.15.60:6819","nonce":85570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6825","nonce":85570},{"type":"v1","addr":"172.21.15.60:6828","nonce":85570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":85570},{"type":"v1","addr":"172.21.15.60:6822","nonce":85570}]},"public_addr":"172.21.15.60:6817/85570","cluster_addr":"172.21.15.60:6819/85570","heartbeat_back_addr":"172.21.15.60:6828/85570","heartbeat_front_addr":"172.21.15.60:6822/85570","state":["exists","up"]},{"osd":3,"uuid":"60411bb4-9bdb-4306-94fe-012d9b336824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6821","nonce":85599},{"type":"v1","addr":"172.21.15.60:6823","nonce":85599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":85599},{"type":"v1","addr":"172.21.15.60:6826","nonce":85599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":85599},{"type":"v1","addr":"172.21.15.60:6831","nonce":85599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6827","nonce":85599},{"type":"v1","addr":"172.21.15.60:6829","nonce":85599}]},"public_addr":"172.21.15.60:6823/85599","cluster_addr":"172.21.15.60:6826/85599","heartbeat_back_addr":"172.21.15.60:6831/85599","heartbeat_front_addr":"172.21.15.60:6829/85599","state":["exists","up"]},{"osd":4,"uuid":"c93dac22-53ef-4fcd-91dc-2eea732f7c07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":85815},{"type":"v1","addr":"172.21.15.135:6817","nonce":85815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":85815},{"type":"v1","addr":"172.21.15.135:6819","nonce":85815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":85815},{"type":"v1","addr":"172.21.15.135:6823","nonce":85815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":85815},{"type":"v1","addr":"172.21.15.135:6821","nonce":85815}]},"public_addr":"172.21.15.135:6817/85815","cluster_addr":"172.21.15.135:6819/85815","heartbeat_back_addr":"172.21.15.135:6823/85815","heartbeat_front_addr":"172.21.15.135:6821/85815","state":["exists","up"]},{"osd":5,"uuid":"6ff97668-2f94-46a1-9682-8669f7d2a35d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":85791},{"type":"v1","addr":"172.21.15.135:6802","nonce":85791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":85791},{"type":"v1","addr":"172.21.15.135:6806","nonce":85791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":85791},{"type":"v1","addr":"172.21.15.135:6814","nonce":85791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":85791},{"type":"v1","addr":"172.21.15.135:6810","nonce":85791}]},"public_addr":"172.21.15.135:6802/85791","cluster_addr":"172.21.15.135:6806/85791","heartbeat_back_addr":"172.21.15.135:6814/85791","heartbeat_front_addr":"172.21.15.135:6810/85791","state":["exists","up"]},{"osd":6,"uuid":"9acb6ea5-5b3a-435f-8593-fa711459750c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6801","nonce":85790},{"type":"v1","addr":"172.21.15.135:6803","nonce":85790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6805","nonce":85790},{"type":"v1","addr":"172.21.15.135:6807","nonce":85790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":85790},{"type":"v1","addr":"172.21.15.135:6815","nonce":85790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6809","nonce":85790},{"type":"v1","addr":"172.21.15.135:6811","nonce":85790}]},"public_addr":"172.21.15.135:6803/85790","cluster_addr":"172.21.15.135:6807/85790","heartbeat_back_addr":"172.21.15.135:6815/85790","heartbeat_front_addr":"172.21.15.135:6811/85790","state":["exists","up"]},{"osd":7,"uuid":"ae599361-48c6-4731-b4fe-18a603c1ca1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":85822},{"type":"v1","addr":"172.21.15.135:6825","nonce":85822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":85822},{"type":"v1","addr":"172.21.15.135:6827","nonce":85822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":85822},{"type":"v1","addr":"172.21.15.135:6831","nonce":85822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":85822},{"type":"v1","addr":"172.21.15.135:6829","nonce":85822}]},"public_addr":"172.21.15.135:6825/85822","cluster_addr":"172.21.15.135:6827/85822","heartbeat_back_addr":"172.21.15.135:6831/85822","heartbeat_front_addr":"172.21.15.135:6829/85822","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.287021+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.213578+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.334744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.012383+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.997314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.791941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:54.771933+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T04:27:55.053520+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:6837/749877170":"2023-10-07T04:31:49.028847+0000","172.21.15.60:6835/749877170":"2023-10-07T04:31:49.028847+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T04:31:56.626 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.593+0000 7f29c47ff700 1 -- 172.21.15.60:0/3422978904 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f29a0066f00 msgr2=0x7f29a00693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:56.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.593+0000 7f29c47ff700 1 --2- 172.21.15.60:0/3422978904 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f29a0066f00 0x7f29a00693b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0099e0 tx=0x7f29ac019000 comp rx=0 tx=0).stop 2023-10-06T04:31:56.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.593+0000 7f29c47ff700 1 -- 172.21.15.60:0/3422978904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29bc069a60 msgr2=0x7f29bc0a5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:56.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.593+0000 7f29c47ff700 1 --2- 172.21.15.60:0/3422978904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29bc069a60 0x7f29bc0a5f90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f29b800c560 tx=0x7f29b800c920 comp rx=0 tx=0).stop 2023-10-06T04:31:56.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.593+0000 7f29c47ff700 1 -- 172.21.15.60:0/3422978904 shutdown_connections 2023-10-06T04:31:56.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.593+0000 7f29c47ff700 1 --2- 172.21.15.60:0/3422978904 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f29a0066f00 0x7f29a00693b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:56.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.593+0000 7f29c47ff700 1 --2- 172.21.15.60:0/3422978904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29bc069a60 0x7f29bc0a5f90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:56.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.593+0000 7f29c47ff700 1 --2- 172.21.15.60:0/3422978904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29bc0adf20 0x7f29bc1555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:56.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.593+0000 7f29c47ff700 1 --2- 172.21.15.60:0/3422978904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29bc0ac000 0x7f29bc0c03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:56.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.593+0000 7f29c47ff700 1 -- 172.21.15.60:0/3422978904 >> 172.21.15.60:0/3422978904 conn(0x7f29bc068080 msgr2=0x7f29bc06d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:56.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.593+0000 7f29c47ff700 1 -- 172.21.15.60:0/3422978904 shutdown_connections 2023-10-06T04:31:56.627 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:56.593+0000 7f29c47ff700 1 -- 172.21.15.60:0/3422978904 wait complete. 2023-10-06T04:31:57.628 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T04:31:57.629 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:31:57.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.830+0000 7f8891b9d700 1 Processor -- start 2023-10-06T04:31:57.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.830+0000 7f8891b9d700 1 -- start start 2023-10-06T04:31:57.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.831+0000 7f8891b9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f888c0a9d00 0x7f888c15a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:57.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.831+0000 7f8891b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f888c0aea20 0x7f888c15d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:57.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.831+0000 7f8891b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f888c068de0 con 0x7f888c0aa0d0 2023-10-06T04:31:57.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.831+0000 7f8891b9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f888c06f2d0 con 0x7f888c0a9d00 2023-10-06T04:31:57.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.831+0000 7f8891b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f888c15de50 con 0x7f888c0aea20 2023-10-06T04:31:57.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.832+0000 7f8890b9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f888c0a9d00 0x7f888c15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:57.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.832+0000 7f8890b9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f888c0a9d00 0x7f888c15a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42610/0 (socket says 172.21.15.60:42610) 2023-10-06T04:31:57.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.832+0000 7f8890b9b700 1 -- 172.21.15.60:0/18184622 learned_addr learned my addr 172.21.15.60:0/18184622 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:57.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.832+0000 7f888bfff700 1 --2- 172.21.15.60:0/18184622 >> v2:172.21.15.135:3300/0 conn(0x7f888c0aea20 0x7f888c15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:57.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.832+0000 7f8890b9b700 1 -- 172.21.15.60:0/18184622 >> v2:172.21.15.135:3300/0 conn(0x7f888c0aea20 msgr2=0x7f888c15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:57.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.832+0000 7f8890b9b700 1 --2- 172.21.15.60:0/18184622 >> v2:172.21.15.135:3300/0 conn(0x7f888c0aea20 0x7f888c15d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:57.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.832+0000 7f8890b9b700 1 -- 172.21.15.60:0/18184622 >> v1:172.21.15.135:6789/0 conn(0x7f888c0aa0d0 legacy=0x7f888c156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:57.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.832+0000 7f8890b9b700 1 -- 172.21.15.60:0/18184622 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c0af200 con 0x7f888c0a9d00 2023-10-06T04:31:57.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.832+0000 7f8890b9b700 1 --2- 172.21.15.60:0/18184622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c0a9d00 0x7f888c15a520 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f888c071030 tx=0x7f8880009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59be387e47e672b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:57.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.833+0000 7f888b7fe700 1 -- 172.21.15.60:0/18184622 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8880009e70 con 0x7f888c0a9d00 2023-10-06T04:31:57.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.833+0000 7f888b7fe700 1 -- 172.21.15.60:0/18184622 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888000b860 con 0x7f888c0a9d00 2023-10-06T04:31:57.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.833+0000 7f888b7fe700 1 -- 172.21.15.60:0/18184622 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888000bc00 con 0x7f888c0a9d00 2023-10-06T04:31:57.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.833+0000 7f8891b9d700 1 -- 172.21.15.60:0/18184622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c0a9d00 msgr2=0x7f888c15a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:57.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.833+0000 7f8891b9d700 1 --2- 172.21.15.60:0/18184622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c0a9d00 0x7f888c15a520 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f888c071030 tx=0x7f8880009250 comp rx=0 tx=0).stop 2023-10-06T04:31:57.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.833+0000 7f8891b9d700 1 -- 172.21.15.60:0/18184622 shutdown_connections 2023-10-06T04:31:57.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.833+0000 7f8891b9d700 1 --2- 172.21.15.60:0/18184622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c0a9d00 0x7f888c15a520 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:57.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.833+0000 7f8891b9d700 1 --2- 172.21.15.60:0/18184622 >> v2:172.21.15.135:3300/0 conn(0x7f888c0aea20 0x7f888c15d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:57.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.833+0000 7f8891b9d700 1 -- 172.21.15.60:0/18184622 >> 172.21.15.60:0/18184622 conn(0x7f888c06a520 msgr2=0x7f888c0ae310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:57.837 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.833+0000 7f8891b9d700 1 -- 172.21.15.60:0/18184622 shutdown_connections 2023-10-06T04:31:57.838 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.833+0000 7f8891b9d700 1 -- 172.21.15.60:0/18184622 wait complete. 2023-10-06T04:31:57.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.835+0000 7f8891b9d700 1 Processor -- start 2023-10-06T04:31:57.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.835+0000 7f8891b9d700 1 -- start start 2023-10-06T04:31:57.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.836+0000 7f8891b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f888c0a9d00 0x7f888c148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:57.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.836+0000 7f8891b9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c0aa0d0 0x7f888c0c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:57.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.836+0000 7f8891b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f888c0aea20 0x7f888c0c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:57.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.836+0000 7f8891b9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c0adb80 con 0x7f888c0aa0d0 2023-10-06T04:31:57.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.836+0000 7f8891b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c0ade60 con 0x7f888c0aea20 2023-10-06T04:31:57.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.836+0000 7f8891b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888c0ae140 con 0x7f888c0a9d00 2023-10-06T04:31:57.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.836+0000 7f888bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c0aa0d0 0x7f888c0c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:57.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.836+0000 7f888bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c0aa0d0 0x7f888c0c4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42614/0 (socket says 172.21.15.60:42614) 2023-10-06T04:31:57.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.836+0000 7f888bfff700 1 -- 172.21.15.60:0/198748198 learned_addr learned my addr 172.21.15.60:0/198748198 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.836+0000 7f889139c700 1 --2- 172.21.15.60:0/198748198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f888c0aea20 0x7f888c0c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.836+0000 7f8890b9b700 1 --2- 172.21.15.60:0/198748198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f888c0a9d00 0x7f888c148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.836+0000 7f888bfff700 1 -- 172.21.15.60:0/198748198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f888c0a9d00 msgr2=0x7f888c148170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.836+0000 7f888bfff700 1 --2- 172.21.15.60:0/198748198 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f888c0a9d00 0x7f888c148170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.836+0000 7f888bfff700 1 -- 172.21.15.60:0/198748198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f888c0aea20 msgr2=0x7f888c0c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.836+0000 7f888bfff700 1 --2- 172.21.15.60:0/198748198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f888c0aea20 0x7f888c0c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.836+0000 7f888bfff700 1 -- 172.21.15.60:0/198748198 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88800094f0 con 0x7f888c0aa0d0 2023-10-06T04:31:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.836+0000 7f889139c700 1 --2- 172.21.15.60:0/198748198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f888c0aea20 0x7f888c0c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:31:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.837+0000 7f888bfff700 1 --2- 172.21.15.60:0/198748198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c0aa0d0 0x7f888c0c4f20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f887800ec50 tx=0x7f88780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.837+0000 7f8888ff9700 1 -- 172.21.15.60:0/198748198 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887800c9d0 con 0x7f888c0aa0d0 2023-10-06T04:31:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.837+0000 7f8888ff9700 1 -- 172.21.15.60:0/198748198 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887800cb30 con 0x7f888c0aa0d0 2023-10-06T04:31:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.837+0000 7f8888ff9700 1 -- 172.21.15.60:0/198748198 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8878013470 con 0x7f888c0aa0d0 2023-10-06T04:31:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.837+0000 7f8891b9d700 1 -- 172.21.15.60:0/198748198 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f888c0ae420 con 0x7f888c0aa0d0 2023-10-06T04:31:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.837+0000 7f8891b9d700 1 -- 172.21.15.60:0/198748198 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f888c1486b0 con 0x7f888c0aa0d0 2023-10-06T04:31:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.838+0000 7f8891b9d700 1 -- 172.21.15.60:0/198748198 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f888c05f230 con 0x7f888c0aa0d0 2023-10-06T04:31:57.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.839+0000 7f8888ff9700 1 -- 172.21.15.60:0/198748198 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8878013860 con 0x7f888c0aa0d0 2023-10-06T04:31:57.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.840+0000 7f8888ff9700 1 --2- 172.21.15.60:0/198748198 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8870066f30 0x7f88700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:57.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.840+0000 7f8888ff9700 1 -- 172.21.15.60:0/198748198 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f88780848c0 con 0x7f888c0aa0d0 2023-10-06T04:31:57.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.840+0000 7f8890b9b700 1 --2- 172.21.15.60:0/198748198 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8870066f30 0x7f88700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:57.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.840+0000 7f8888ff9700 1 --2- 172.21.15.60:0/198748198 >> [v2:172.21.15.60:6808/85568,v1:172.21.15.60:6809/85568] conn(0x7f887006d850 0x7f887006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:57.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.840+0000 7f8888ff9700 1 -- 172.21.15.60:0/198748198 --> [v2:172.21.15.60:6808/85568,v1:172.21.15.60:6809/85568] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8870070370 con 0x7f887006d850 2023-10-06T04:31:57.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.840+0000 7f8888ff9700 1 -- 172.21.15.60:0/198748198 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8878089220 con 0x7f888c0aa0d0 2023-10-06T04:31:57.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.840+0000 7f889139c700 1 --2- 172.21.15.60:0/198748198 >> [v2:172.21.15.60:6808/85568,v1:172.21.15.60:6809/85568] conn(0x7f887006d850 0x7f887006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:57.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.841+0000 7f8890b9b700 1 --2- 172.21.15.60:0/198748198 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8870066f30 0x7f88700693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f888c071030 tx=0x7f8880017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:57.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.841+0000 7f889139c700 1 --2- 172.21.15.60:0/198748198 >> [v2:172.21.15.60:6808/85568,v1:172.21.15.60:6809/85568] conn(0x7f887006d850 0x7f887006fca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:57.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.841+0000 7f8888ff9700 1 -- 172.21.15.60:0/198748198 <== osd.0 v2:172.21.15.60:6808/85568 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8870070370 con 0x7f887006d850 2023-10-06T04:31:57.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.856+0000 7f8891b9d700 1 -- 172.21.15.60:0/198748198 --> [v2:172.21.15.60:6808/85568,v1:172.21.15.60:6809/85568] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f888c0aef20 con 0x7f887006d850 2023-10-06T04:31:57.858 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.856+0000 7f8888ff9700 1 -- 172.21.15.60:0/198748198 <== osd.0 v2:172.21.15.60:6808/85568 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f888c0aef20 con 0x7f887006d850 2023-10-06T04:31:57.858 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-06T04:31:57.858 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:31:57.858 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-06T04:31:57.859 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.857+0000 7f8891b9d700 1 -- 172.21.15.60:0/198748198 >> [v2:172.21.15.60:6808/85568,v1:172.21.15.60:6809/85568] conn(0x7f887006d850 msgr2=0x7f887006fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.857+0000 7f8891b9d700 1 --2- 172.21.15.60:0/198748198 >> [v2:172.21.15.60:6808/85568,v1:172.21.15.60:6809/85568] conn(0x7f887006d850 0x7f887006fca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.857+0000 7f8891b9d700 1 -- 172.21.15.60:0/198748198 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8870066f30 msgr2=0x7f88700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.857+0000 7f8891b9d700 1 --2- 172.21.15.60:0/198748198 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8870066f30 0x7f88700693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f888c071030 tx=0x7f8880017000 comp rx=0 tx=0).stop 2023-10-06T04:31:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.857+0000 7f8891b9d700 1 -- 172.21.15.60:0/198748198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c0aa0d0 msgr2=0x7f888c0c4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.857+0000 7f8891b9d700 1 --2- 172.21.15.60:0/198748198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c0aa0d0 0x7f888c0c4f20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f887800ec50 tx=0x7f88780091a0 comp rx=0 tx=0).stop 2023-10-06T04:31:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.857+0000 7f889139c700 1 -- 172.21.15.60:0/198748198 reap_dead start 2023-10-06T04:31:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.857+0000 7f8891b9d700 1 -- 172.21.15.60:0/198748198 shutdown_connections 2023-10-06T04:31:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.857+0000 7f8891b9d700 1 -- 172.21.15.60:0/198748198 >> 172.21.15.60:0/198748198 conn(0x7f888c06a520 msgr2=0x7f888c15c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.857+0000 7f8891b9d700 1 -- 172.21.15.60:0/198748198 shutdown_connections 2023-10-06T04:31:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:57.857+0000 7f8891b9d700 1 -- 172.21.15.60:0/198748198 wait complete. 2023-10-06T04:31:57.875 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T04:31:58.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.061+0000 7ff83979d700 1 Processor -- start 2023-10-06T04:31:58.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.062+0000 7ff83979d700 1 -- start start 2023-10-06T04:31:58.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.063+0000 7ff83979d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff834159350 0x7ff834159720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.063+0000 7ff83979d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff8340cece0 0x7ff8340698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.063+0000 7ff83979d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83406a220 con 0x7ff834069de0 2023-10-06T04:31:58.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.063+0000 7ff83979d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff834068760 con 0x7ff834159350 2023-10-06T04:31:58.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.063+0000 7ff83979d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff834068a40 con 0x7ff8340cece0 2023-10-06T04:31:58.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.063+0000 7ff838f9c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff834069de0 0x7ff8340abc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34942/0 (socket says 172.21.15.60:34942) 2023-10-06T04:31:58.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.063+0000 7ff838f9c700 1 -- 172.21.15.60:0/1587701866 learned_addr learned my addr 172.21.15.60:0/1587701866 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:31:58.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.063+0000 7ff833fff700 1 --2- 172.21.15.60:0/1587701866 >> v2:172.21.15.60:3300/0 conn(0x7ff834159350 0x7ff834159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.063+0000 7ff8337fe700 1 --2- 172.21.15.60:0/1587701866 >> v2:172.21.15.135:3300/0 conn(0x7ff8340cece0 0x7ff8340698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.064+0000 7ff833fff700 1 -- 172.21.15.60:0/1587701866 >> v2:172.21.15.135:3300/0 conn(0x7ff8340cece0 msgr2=0x7ff8340698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:58.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.064+0000 7ff832ffd700 1 -- 172.21.15.60:0/1587701866 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163339096 0 0) 0x7ff83406a220 con 0x7ff834069de0 2023-10-06T04:31:58.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.064+0000 7ff833fff700 1 --2- 172.21.15.60:0/1587701866 >> v2:172.21.15.135:3300/0 conn(0x7ff8340cece0 0x7ff8340698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.064+0000 7ff833fff700 1 -- 172.21.15.60:0/1587701866 >> v1:172.21.15.60:6789/0 conn(0x7ff834069de0 legacy=0x7ff8340abc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:58.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.064+0000 7ff833fff700 1 -- 172.21.15.60:0/1587701866 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff834068d20 con 0x7ff834159350 2023-10-06T04:31:58.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.064+0000 7ff833fff700 1 --2- 172.21.15.60:0/1587701866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff834159350 0x7ff834159720 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff834088360 tx=0x7ff8240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bcd9a115f462dca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:58.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.064+0000 7ff832ffd700 1 -- 172.21.15.60:0/1587701866 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff824011630 con 0x7ff834159350 2023-10-06T04:31:58.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.064+0000 7ff832ffd700 1 -- 172.21.15.60:0/1587701866 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff824011790 con 0x7ff834159350 2023-10-06T04:31:58.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.064+0000 7ff832ffd700 1 -- 172.21.15.60:0/1587701866 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff824011b30 con 0x7ff834159350 2023-10-06T04:31:58.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.065+0000 7ff83979d700 1 -- 172.21.15.60:0/1587701866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff834159350 msgr2=0x7ff834159720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:58.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.065+0000 7ff83979d700 1 --2- 172.21.15.60:0/1587701866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff834159350 0x7ff834159720 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff834088360 tx=0x7ff8240091a0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.068 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.065+0000 7ff83979d700 1 -- 172.21.15.60:0/1587701866 shutdown_connections 2023-10-06T04:31:58.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.065+0000 7ff83979d700 1 --2- 172.21.15.60:0/1587701866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff834159350 0x7ff834159720 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.065+0000 7ff83979d700 1 --2- 172.21.15.60:0/1587701866 >> v2:172.21.15.135:3300/0 conn(0x7ff8340cece0 0x7ff8340698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.065+0000 7ff83979d700 1 -- 172.21.15.60:0/1587701866 >> 172.21.15.60:0/1587701866 conn(0x7ff834067d90 msgr2=0x7ff8340ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:58.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.065+0000 7ff83979d700 1 -- 172.21.15.60:0/1587701866 shutdown_connections 2023-10-06T04:31:58.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.065+0000 7ff83979d700 1 -- 172.21.15.60:0/1587701866 wait complete. 2023-10-06T04:31:58.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.066+0000 7ff83979d700 1 Processor -- start 2023-10-06T04:31:58.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.066+0000 7ff83979d700 1 -- start start 2023-10-06T04:31:58.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.067+0000 7ff83979d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff834069de0 0x7ff8341693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.067+0000 7ff83979d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8340cece0 0x7ff83409a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.067+0000 7ff83979d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff834159350 0x7ff83409a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.067+0000 7ff83979d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83416c7d0 con 0x7ff8340cece0 2023-10-06T04:31:58.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.067+0000 7ff83979d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff834156140 con 0x7ff834159350 2023-10-06T04:31:58.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.067+0000 7ff83979d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff834156fa0 con 0x7ff834069de0 2023-10-06T04:31:58.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.067+0000 7ff8337fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8340cece0 0x7ff83409a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.068+0000 7ff8337fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8340cece0 0x7ff83409a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42634/0 (socket says 172.21.15.60:42634) 2023-10-06T04:31:58.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.068+0000 7ff8337fe700 1 -- 172.21.15.60:0/3167438616 learned_addr learned my addr 172.21.15.60:0/3167438616 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:58.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.068+0000 7ff833fff700 1 --2- 172.21.15.60:0/3167438616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff834069de0 0x7ff8341693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.068+0000 7ff838f9c700 1 --2- 172.21.15.60:0/3167438616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff834159350 0x7ff83409a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.068+0000 7ff8337fe700 1 -- 172.21.15.60:0/3167438616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff834069de0 msgr2=0x7ff8341693b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:58.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.068+0000 7ff8337fe700 1 --2- 172.21.15.60:0/3167438616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff834069de0 0x7ff8341693b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.068+0000 7ff8337fe700 1 -- 172.21.15.60:0/3167438616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff834159350 msgr2=0x7ff83409a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:58.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.068+0000 7ff8337fe700 1 --2- 172.21.15.60:0/3167438616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff834159350 0x7ff83409a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.068+0000 7ff8337fe700 1 -- 172.21.15.60:0/3167438616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff824009420 con 0x7ff8340cece0 2023-10-06T04:31:58.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.068+0000 7ff8337fe700 1 --2- 172.21.15.60:0/3167438616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8340cece0 0x7ff83409a3a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff82800ecb0 tx=0x7ff8280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:58.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.068+0000 7ff81bfff700 1 -- 172.21.15.60:0/3167438616 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82800c9d0 con 0x7ff8340cece0 2023-10-06T04:31:58.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.068+0000 7ff81bfff700 1 -- 172.21.15.60:0/3167438616 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82800cb30 con 0x7ff8340cece0 2023-10-06T04:31:58.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.068+0000 7ff83979d700 1 -- 172.21.15.60:0/3167438616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff834156390 con 0x7ff8340cece0 2023-10-06T04:31:58.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.068+0000 7ff81bfff700 1 -- 172.21.15.60:0/3167438616 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82800ced0 con 0x7ff8340cece0 2023-10-06T04:31:58.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.069+0000 7ff83979d700 1 -- 172.21.15.60:0/3167438616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff834156950 con 0x7ff8340cece0 2023-10-06T04:31:58.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.070+0000 7ff83979d700 1 -- 172.21.15.60:0/3167438616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83405f230 con 0x7ff8340cece0 2023-10-06T04:31:58.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.071+0000 7ff81bfff700 1 -- 172.21.15.60:0/3167438616 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff828013680 con 0x7ff8340cece0 2023-10-06T04:31:58.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.072+0000 7ff81bfff700 1 --2- 172.21.15.60:0/3167438616 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff820066f30 0x7ff8200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.072+0000 7ff81bfff700 1 -- 172.21.15.60:0/3167438616 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7ff828084980 con 0x7ff8340cece0 2023-10-06T04:31:58.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.072+0000 7ff833fff700 1 --2- 172.21.15.60:0/3167438616 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff820066f30 0x7ff8200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.076 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.073+0000 7ff833fff700 1 --2- 172.21.15.60:0/3167438616 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff820066f30 0x7ff8200693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff8240093f0 tx=0x7ff824017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:58.077 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.076+0000 7ff81bfff700 1 -- 172.21.15.60:0/3167438616 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff828051bb0 con 0x7ff8340cece0 2023-10-06T04:31:58.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.282+0000 7ff83979d700 1 -- 172.21.15.60:0/3167438616 --> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8341570e0 con 0x7ff820066f30 2023-10-06T04:31:58.283 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.282+0000 7ff81bfff700 1 -- 172.21.15.60:0/3167438616 <== mgr.4098 v2:172.21.15.60:6832/85285 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff8341570e0 con 0x7ff820066f30 2023-10-06T04:31:58.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.284+0000 7ff83979d700 1 -- 172.21.15.60:0/3167438616 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff820066f30 msgr2=0x7ff8200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:58.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.284+0000 7ff83979d700 1 --2- 172.21.15.60:0/3167438616 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff820066f30 0x7ff8200693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff8240093f0 tx=0x7ff824017000 comp rx=0 tx=0).stop 2023-10-06T04:31:58.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.284+0000 7ff83979d700 1 -- 172.21.15.60:0/3167438616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8340cece0 msgr2=0x7ff83409a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:58.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.284+0000 7ff83979d700 1 --2- 172.21.15.60:0/3167438616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8340cece0 0x7ff83409a3a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff82800ecb0 tx=0x7ff8280091a0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.284+0000 7ff83979d700 1 -- 172.21.15.60:0/3167438616 shutdown_connections 2023-10-06T04:31:58.286 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.284+0000 7ff83979d700 1 --2- 172.21.15.60:0/3167438616 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff820066f30 0x7ff8200693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.284+0000 7ff83979d700 1 --2- 172.21.15.60:0/3167438616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff834159350 0x7ff83409a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.284+0000 7ff83979d700 1 --2- 172.21.15.60:0/3167438616 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff834069de0 0x7ff8341693b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.284+0000 7ff83979d700 1 --2- 172.21.15.60:0/3167438616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8340cece0 0x7ff83409a3a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.284+0000 7ff83979d700 1 -- 172.21.15.60:0/3167438616 >> 172.21.15.60:0/3167438616 conn(0x7ff834067d90 msgr2=0x7ff8340ac360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:58.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.285+0000 7ff83979d700 1 -- 172.21.15.60:0/3167438616 shutdown_connections 2023-10-06T04:31:58.287 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.285+0000 7ff83979d700 1 -- 172.21.15.60:0/3167438616 wait complete. 2023-10-06T04:31:58.287 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T04:31:58.304 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T04:31:58.304 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:31:58.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.497+0000 7f8a93fff700 1 Processor -- start 2023-10-06T04:31:58.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.497+0000 7f8a93fff700 1 -- start start 2023-10-06T04:31:58.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.498+0000 7f8a93fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8a941592f0 0x7f8a940b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.498+0000 7f8a93fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a940b5e10 0x7f8a940b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.498+0000 7f8a93fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a940cff80 con 0x7f8a940b4160 2023-10-06T04:31:58.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.498+0000 7f8a93fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a940afb70 con 0x7f8a941592f0 2023-10-06T04:31:58.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.498+0000 7f8a93fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a940b45a0 con 0x7f8a940b5e10 2023-10-06T04:31:58.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.498+0000 7f8a937fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8a940b4160 0x7f8a940b0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34950/0 (socket says 172.21.15.60:34950) 2023-10-06T04:31:58.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.498+0000 7f8a937fe700 1 -- 172.21.15.60:0/185290247 learned_addr learned my addr 172.21.15.60:0/185290247 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:31:58.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.498+0000 7f8a927fc700 1 --2- 172.21.15.60:0/185290247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a940b5e10 0x7f8a940b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.498+0000 7f8a92ffd700 1 --2- 172.21.15.60:0/185290247 >> v2:172.21.15.135:3300/0 conn(0x7f8a941592f0 0x7f8a940b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.498+0000 7f8a91ffb700 1 -- 172.21.15.60:0/185290247 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098805360 0 0) 0x7f8a940cff80 con 0x7f8a940b4160 2023-10-06T04:31:58.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.499+0000 7f8a91ffb700 1 -- 172.21.15.60:0/185290247 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a7c003570 con 0x7f8a940b4160 2023-10-06T04:31:58.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.499+0000 7f8a91ffb700 1 -- 172.21.15.60:0/185290247 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 933376492 0 0) 0x7f8a7c003570 con 0x7f8a940b4160 2023-10-06T04:31:58.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.499+0000 7f8a91ffb700 1 -- 172.21.15.60:0/185290247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a940b5e10 msgr2=0x7f8a940b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:58.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.499+0000 7f8a91ffb700 1 --2- 172.21.15.60:0/185290247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a940b5e10 0x7f8a940b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.499+0000 7f8a91ffb700 1 -- 172.21.15.60:0/185290247 >> v2:172.21.15.135:3300/0 conn(0x7f8a941592f0 msgr2=0x7f8a940b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:58.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.499+0000 7f8a91ffb700 1 --2- 172.21.15.60:0/185290247 >> v2:172.21.15.135:3300/0 conn(0x7f8a941592f0 0x7f8a940b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.499+0000 7f8a91ffb700 1 -- 172.21.15.60:0/185290247 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a940b2ae0 con 0x7f8a940b4160 2023-10-06T04:31:58.503 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.499+0000 7f8a91ffb700 1 -- 172.21.15.60:0/185290247 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7f8a8c0017f0 con 0x7f8a940b4160 2023-10-06T04:31:58.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.499+0000 7f8a927fc700 1 --2- 172.21.15.60:0/185290247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a940b5e10 0x7f8a940b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:31:58.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.499+0000 7f8a91ffb700 1 -- 172.21.15.60:0/185290247 >> v1:172.21.15.60:6789/0 conn(0x7f8a940b4160 legacy=0x7f8a940b0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:58.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.499+0000 7f8a91ffb700 1 --2- 172.21.15.60:0/185290247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a7c003ae0 0x7f8a7c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.499+0000 7f8a91ffb700 1 --2- 172.21.15.60:0/185290247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a940b5e10 0x7f8a7c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.499+0000 7f8a91ffb700 1 --2- 172.21.15.60:0/185290247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a7c004d50 0x7f8a7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.499+0000 7f8a91ffb700 1 -- 172.21.15.60:0/185290247 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a940afb70 con 0x7f8a7c004d50 2023-10-06T04:31:58.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.499+0000 7f8a91ffb700 1 -- 172.21.15.60:0/185290247 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a940b45a0 con 0x7f8a7c003ae0 2023-10-06T04:31:58.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.499+0000 7f8a91ffb700 1 -- 172.21.15.60:0/185290247 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c00bab0 con 0x7f8a940b5e10 2023-10-06T04:31:58.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.499+0000 7f8a92ffd700 1 --2- 172.21.15.60:0/185290247 >> v2:172.21.15.135:3300/0 conn(0x7f8a941592f0 0x7f8a940b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:31:58.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.499+0000 7f8a937fe700 1 --2- 172.21.15.60:0/185290247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a7c004d50 0x7f8a7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.504 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.500+0000 7f8a927fc700 1 --2- 172.21.15.60:0/185290247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a940b5e10 0x7f8a7c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.500+0000 7f8a92ffd700 1 --2- 172.21.15.60:0/185290247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a7c003ae0 0x7f8a7c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.500+0000 7f8a937fe700 1 -- 172.21.15.60:0/185290247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a940b5e10 msgr2=0x7f8a7c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:58.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.500+0000 7f8a937fe700 1 --2- 172.21.15.60:0/185290247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a940b5e10 0x7f8a7c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.500+0000 7f8a937fe700 1 -- 172.21.15.60:0/185290247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a7c003ae0 msgr2=0x7f8a7c003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:58.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.500+0000 7f8a937fe700 1 --2- 172.21.15.60:0/185290247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a7c003ae0 0x7f8a7c003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.500+0000 7f8a937fe700 1 -- 172.21.15.60:0/185290247 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a88009420 con 0x7f8a7c004d50 2023-10-06T04:31:58.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.500+0000 7f8a92ffd700 1 --2- 172.21.15.60:0/185290247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a7c003ae0 0x7f8a7c003ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:31:58.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.500+0000 7f8a927fc700 1 --2- 172.21.15.60:0/185290247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a940b5e10 0x7f8a7c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:31:58.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.500+0000 7f8a937fe700 1 --2- 172.21.15.60:0/185290247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a7c004d50 0x7f8a7c0051c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00a890 tx=0x7f8a940647b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a309cf0925d1d98 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:58.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.500+0000 7f8a91ffb700 1 -- 172.21.15.60:0/185290247 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c0070f0 con 0x7f8a7c004d50 2023-10-06T04:31:58.505 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.500+0000 7f8a91ffb700 1 -- 172.21.15.60:0/185290247 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8c007250 con 0x7f8a7c004d50 2023-10-06T04:31:58.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.500+0000 7f8a91ffb700 1 -- 172.21.15.60:0/185290247 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c007610 con 0x7f8a7c004d50 2023-10-06T04:31:58.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.501+0000 7f8a93fff700 1 -- 172.21.15.60:0/185290247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a7c004d50 msgr2=0x7f8a7c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:58.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.501+0000 7f8a93fff700 1 --2- 172.21.15.60:0/185290247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a7c004d50 0x7f8a7c0051c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00a890 tx=0x7f8a940647b0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.501+0000 7f8a937fe700 1 -- 172.21.15.60:0/185290247 reap_dead start 2023-10-06T04:31:58.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.501+0000 7f8a93fff700 1 -- 172.21.15.60:0/185290247 shutdown_connections 2023-10-06T04:31:58.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.501+0000 7f8a93fff700 1 -- 172.21.15.60:0/185290247 >> 172.21.15.60:0/185290247 conn(0x7f8a940994e0 msgr2=0x7f8a9406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:58.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.501+0000 7f8a93fff700 1 -- 172.21.15.60:0/185290247 shutdown_connections 2023-10-06T04:31:58.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.501+0000 7f8a93fff700 1 -- 172.21.15.60:0/185290247 wait complete. 2023-10-06T04:31:58.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.502+0000 7f8a93fff700 1 Processor -- start 2023-10-06T04:31:58.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.502+0000 7f8a93fff700 1 -- start start 2023-10-06T04:31:58.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.503+0000 7f8a93fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a7c004d50 0x7f8a940c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.503+0000 7f8a93fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a940c9730 0x7f8a9414d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.503+0000 7f8a93fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a940690e0 0x7f8a94069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.503+0000 7f8a93fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a940c8480 con 0x7f8a940c9730 2023-10-06T04:31:58.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.503+0000 7f8a93fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a94069a70 con 0x7f8a940690e0 2023-10-06T04:31:58.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.503+0000 7f8a93fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a940c7800 con 0x7f8a7c004d50 2023-10-06T04:31:58.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.504+0000 7f8a927fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a940c9730 0x7f8a9414d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.504+0000 7f8a927fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a940c9730 0x7f8a9414d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42642/0 (socket says 172.21.15.60:42642) 2023-10-06T04:31:58.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.504+0000 7f8a927fc700 1 -- 172.21.15.60:0/585880030 learned_addr learned my addr 172.21.15.60:0/585880030 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:58.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.504+0000 7f8a92ffd700 1 --2- 172.21.15.60:0/585880030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a7c004d50 0x7f8a940c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.504+0000 7f8a937fe700 1 --2- 172.21.15.60:0/585880030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a940690e0 0x7f8a94069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.504+0000 7f8a927fc700 1 -- 172.21.15.60:0/585880030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a7c004d50 msgr2=0x7f8a940c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:58.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.504+0000 7f8a927fc700 1 --2- 172.21.15.60:0/585880030 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a7c004d50 0x7f8a940c6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.504+0000 7f8a927fc700 1 -- 172.21.15.60:0/585880030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a940690e0 msgr2=0x7f8a94069530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:58.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.504+0000 7f8a927fc700 1 --2- 172.21.15.60:0/585880030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a940690e0 0x7f8a94069530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.504+0000 7f8a927fc700 1 -- 172.21.15.60:0/585880030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a940c7ae0 con 0x7f8a940c9730 2023-10-06T04:31:58.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.504+0000 7f8a927fc700 1 --2- 172.21.15.60:0/585880030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a940c9730 0x7f8a9414d560 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8a88011a00 tx=0x7f8a88008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:58.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.504+0000 7f8a7affd700 1 -- 172.21.15.60:0/585880030 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8800f860 con 0x7f8a940c9730 2023-10-06T04:31:58.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.504+0000 7f8a7affd700 1 -- 172.21.15.60:0/585880030 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8800f9c0 con 0x7f8a940c9730 2023-10-06T04:31:58.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.504+0000 7f8a93fff700 1 -- 172.21.15.60:0/585880030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a940c7dc0 con 0x7f8a940c9730 2023-10-06T04:31:58.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.505+0000 7f8a7affd700 1 -- 172.21.15.60:0/585880030 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8800fda0 con 0x7f8a940c9730 2023-10-06T04:31:58.510 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.505+0000 7f8a93fff700 1 -- 172.21.15.60:0/585880030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a940c7510 con 0x7f8a940c9730 2023-10-06T04:31:58.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.505+0000 7f8a93fff700 1 -- 172.21.15.60:0/585880030 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8a9405f230 con 0x7f8a940c9730 2023-10-06T04:31:58.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.506+0000 7f8a7affd700 1 -- 172.21.15.60:0/585880030 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a88015670 con 0x7f8a940c9730 2023-10-06T04:31:58.511 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.507+0000 7f8a7affd700 1 --2- 172.21.15.60:0/585880030 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8a80066f30 0x7f8a800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.507+0000 7f8a7affd700 1 -- 172.21.15.60:0/585880030 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f8a88084e20 con 0x7f8a940c9730 2023-10-06T04:31:58.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.508+0000 7f8a92ffd700 1 --2- 172.21.15.60:0/585880030 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8a80066f30 0x7f8a800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.508+0000 7f8a7affd700 1 --2- 172.21.15.60:0/585880030 >> [v2:172.21.15.60:6800/85567,v1:172.21.15.60:6801/85567] conn(0x7f8a8006d850 0x7f8a8006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.508+0000 7f8a7affd700 1 -- 172.21.15.60:0/585880030 --> [v2:172.21.15.60:6800/85567,v1:172.21.15.60:6801/85567] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a80070370 con 0x7f8a8006d850 2023-10-06T04:31:58.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.508+0000 7f8a7affd700 1 -- 172.21.15.60:0/585880030 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a88087320 con 0x7f8a940c9730 2023-10-06T04:31:58.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.508+0000 7f8a937fe700 1 --2- 172.21.15.60:0/585880030 >> [v2:172.21.15.60:6800/85567,v1:172.21.15.60:6801/85567] conn(0x7f8a8006d850 0x7f8a8006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.508+0000 7f8a92ffd700 1 --2- 172.21.15.60:0/585880030 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8a80066f30 0x7f8a800693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8a840093f0 tx=0x7f8a84008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:58.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.508+0000 7f8a937fe700 1 --2- 172.21.15.60:0/585880030 >> [v2:172.21.15.60:6800/85567,v1:172.21.15.60:6801/85567] conn(0x7f8a8006d850 0x7f8a8006fca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:58.512 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.509+0000 7f8a7affd700 1 -- 172.21.15.60:0/585880030 <== osd.1 v2:172.21.15.60:6800/85567 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8a80070370 con 0x7f8a8006d850 2023-10-06T04:31:58.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.524+0000 7f8a93fff700 1 -- 172.21.15.60:0/585880030 --> [v2:172.21.15.60:6800/85567,v1:172.21.15.60:6801/85567] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8a9414daa0 con 0x7f8a8006d850 2023-10-06T04:31:58.525 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.524+0000 7f8a7affd700 1 -- 172.21.15.60:0/585880030 <== osd.1 v2:172.21.15.60:6800/85567 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8a9414daa0 con 0x7f8a8006d850 2023-10-06T04:31:58.526 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-06T04:31:58.526 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:31:58.526 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-06T04:31:58.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.524+0000 7f8a93fff700 1 -- 172.21.15.60:0/585880030 >> [v2:172.21.15.60:6800/85567,v1:172.21.15.60:6801/85567] conn(0x7f8a8006d850 msgr2=0x7f8a8006fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:58.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.524+0000 7f8a93fff700 1 --2- 172.21.15.60:0/585880030 >> [v2:172.21.15.60:6800/85567,v1:172.21.15.60:6801/85567] conn(0x7f8a8006d850 0x7f8a8006fca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.525+0000 7f8a93fff700 1 -- 172.21.15.60:0/585880030 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8a80066f30 msgr2=0x7f8a800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:58.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.525+0000 7f8a93fff700 1 --2- 172.21.15.60:0/585880030 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8a80066f30 0x7f8a800693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8a840093f0 tx=0x7f8a84008040 comp rx=0 tx=0).stop 2023-10-06T04:31:58.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.525+0000 7f8a93fff700 1 -- 172.21.15.60:0/585880030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a940c9730 msgr2=0x7f8a9414d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:58.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.525+0000 7f8a93fff700 1 --2- 172.21.15.60:0/585880030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a940c9730 0x7f8a9414d560 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8a88011a00 tx=0x7f8a88008040 comp rx=0 tx=0).stop 2023-10-06T04:31:58.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.525+0000 7f8a937fe700 1 -- 172.21.15.60:0/585880030 reap_dead start 2023-10-06T04:31:58.527 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.525+0000 7f8a93fff700 1 -- 172.21.15.60:0/585880030 shutdown_connections 2023-10-06T04:31:58.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.525+0000 7f8a93fff700 1 -- 172.21.15.60:0/585880030 >> 172.21.15.60:0/585880030 conn(0x7f8a940994e0 msgr2=0x7f8a940d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:58.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.525+0000 7f8a93fff700 1 -- 172.21.15.60:0/585880030 shutdown_connections 2023-10-06T04:31:58.528 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.525+0000 7f8a93fff700 1 -- 172.21.15.60:0/585880030 wait complete. 2023-10-06T04:31:58.543 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T04:31:58.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.730+0000 7f023df9d700 1 Processor -- start 2023-10-06T04:31:58.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.730+0000 7f023df9d700 1 -- start start 2023-10-06T04:31:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.731+0000 7f023df9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0238159290 0x7f02380ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.731+0000 7f023df9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0238159660 0x7f02380ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.731+0000 7f023df9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f02380cfbb0 0x7f02380aee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.731+0000 7f023df9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023815cff0 con 0x7f02380cfbb0 2023-10-06T04:31:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.731+0000 7f023df9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02380cb2d0 con 0x7f0238159660 2023-10-06T04:31:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.731+0000 7f023df9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02380cb570 con 0x7f0238159290 2023-10-06T04:31:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.731+0000 7f023d79c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f02380cfbb0 0x7f02380aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.732+0000 7f023d79c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f02380cfbb0 0x7f02380aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42656/0 (socket says 172.21.15.60:42656) 2023-10-06T04:31:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.732+0000 7f023d79c700 1 -- 172.21.15.60:0/2591329248 learned_addr learned my addr 172.21.15.60:0/2591329248 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.732+0000 7f023cf9b700 1 --2- 172.21.15.60:0/2591329248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0238159290 0x7f02380ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.732+0000 7f0237fff700 1 --2- 172.21.15.60:0/2591329248 >> v2:172.21.15.135:3300/0 conn(0x7f0238159660 0x7f02380ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.732+0000 7f023d79c700 1 -- 172.21.15.60:0/2591329248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0238159290 msgr2=0x7f02380ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.732+0000 7f023d79c700 1 --2- 172.21.15.60:0/2591329248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0238159290 0x7f02380ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.732+0000 7f023d79c700 1 -- 172.21.15.60:0/2591329248 >> v2:172.21.15.135:3300/0 conn(0x7f0238159660 msgr2=0x7f02380ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.732+0000 7f023d79c700 1 --2- 172.21.15.60:0/2591329248 >> v2:172.21.15.135:3300/0 conn(0x7f0238159660 0x7f02380ce2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.732+0000 7f023d79c700 1 -- 172.21.15.60:0/2591329248 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02380cb850 con 0x7f02380cfbb0 2023-10-06T04:31:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.732+0000 7f0237fff700 1 --2- 172.21.15.60:0/2591329248 >> v2:172.21.15.135:3300/0 conn(0x7f0238159660 0x7f02380ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:31:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.732+0000 7f023d79c700 1 --2- 172.21.15.60:0/2591329248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02380cfbb0 0x7f02380aee50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f02380cde30 tx=0x7f0230009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8ab11fd6bd64ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.733+0000 7f02377fe700 1 -- 172.21.15.60:0/2591329248 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023000e070 con 0x7f02380cfbb0 2023-10-06T04:31:58.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.733+0000 7f02377fe700 1 -- 172.21.15.60:0/2591329248 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023000ba50 con 0x7f02380cfbb0 2023-10-06T04:31:58.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.733+0000 7f02377fe700 1 -- 172.21.15.60:0/2591329248 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02300092e0 con 0x7f02380cfbb0 2023-10-06T04:31:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.733+0000 7f023df9d700 1 -- 172.21.15.60:0/2591329248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02380cfbb0 msgr2=0x7f02380aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.733+0000 7f023df9d700 1 --2- 172.21.15.60:0/2591329248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02380cfbb0 0x7f02380aee50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f02380cde30 tx=0x7f0230009840 comp rx=0 tx=0).stop 2023-10-06T04:31:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.733+0000 7f023df9d700 1 -- 172.21.15.60:0/2591329248 shutdown_connections 2023-10-06T04:31:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.733+0000 7f023df9d700 1 --2- 172.21.15.60:0/2591329248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02380cfbb0 0x7f02380aee50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.733+0000 7f023df9d700 1 --2- 172.21.15.60:0/2591329248 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0238159290 0x7f02380ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.733+0000 7f023df9d700 1 --2- 172.21.15.60:0/2591329248 >> v2:172.21.15.135:3300/0 conn(0x7f0238159660 0x7f02380ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.733+0000 7f023df9d700 1 -- 172.21.15.60:0/2591329248 >> 172.21.15.60:0/2591329248 conn(0x7f02380680f0 msgr2=0x7f02380684f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.733+0000 7f023df9d700 1 -- 172.21.15.60:0/2591329248 shutdown_connections 2023-10-06T04:31:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.733+0000 7f023df9d700 1 -- 172.21.15.60:0/2591329248 wait complete. 2023-10-06T04:31:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.735+0000 7f023df9d700 1 Processor -- start 2023-10-06T04:31:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.735+0000 7f023df9d700 1 -- start start 2023-10-06T04:31:58.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.736+0000 7f023df9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02380cfbb0 0x7f02380a6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.736+0000 7f023df9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0238159290 0x7f02380af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.736+0000 7f023df9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238159660 0x7f02380c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.736+0000 7f023df9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02380c8c10 con 0x7f0238159660 2023-10-06T04:31:58.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.736+0000 7f023df9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02380af5a0 con 0x7f02380cfbb0 2023-10-06T04:31:58.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.736+0000 7f023df9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02380c8000 con 0x7f0238159290 2023-10-06T04:31:58.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.736+0000 7f023d79c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238159660 0x7f02380c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.736+0000 7f023d79c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238159660 0x7f02380c7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42666/0 (socket says 172.21.15.60:42666) 2023-10-06T04:31:58.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.736+0000 7f023d79c700 1 -- 172.21.15.60:0/175314544 learned_addr learned my addr 172.21.15.60:0/175314544 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:58.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.736+0000 7f023cf9b700 1 --2- 172.21.15.60:0/175314544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02380cfbb0 0x7f02380a6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.736+0000 7f0237fff700 1 --2- 172.21.15.60:0/175314544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0238159290 0x7f02380af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.736+0000 7f023d79c700 1 -- 172.21.15.60:0/175314544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0238159290 msgr2=0x7f02380af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:58.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.736+0000 7f023d79c700 1 --2- 172.21.15.60:0/175314544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0238159290 0x7f02380af060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.736+0000 7f023d79c700 1 -- 172.21.15.60:0/175314544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02380cfbb0 msgr2=0x7f02380a6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:58.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.736+0000 7f023d79c700 1 --2- 172.21.15.60:0/175314544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02380cfbb0 0x7f02380a6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.736+0000 7f023d79c700 1 -- 172.21.15.60:0/175314544 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0230009ae0 con 0x7f0238159660 2023-10-06T04:31:58.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.736+0000 7f023cf9b700 1 --2- 172.21.15.60:0/175314544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02380cfbb0 0x7f02380a6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:31:58.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.736+0000 7f0237fff700 1 --2- 172.21.15.60:0/175314544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0238159290 0x7f02380af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:31:58.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.737+0000 7f023d79c700 1 --2- 172.21.15.60:0/175314544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238159660 0x7f02380c7670 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0238089080 tx=0x7f0230018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:58.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.737+0000 7f0234ff9700 1 -- 172.21.15.60:0/175314544 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0230008e80 con 0x7f0238159660 2023-10-06T04:31:58.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.737+0000 7f0234ff9700 1 -- 172.21.15.60:0/175314544 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02300092e0 con 0x7f0238159660 2023-10-06T04:31:58.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.737+0000 7f0234ff9700 1 -- 172.21.15.60:0/175314544 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0230026690 con 0x7f0238159660 2023-10-06T04:31:58.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.737+0000 7f023df9d700 1 -- 172.21.15.60:0/175314544 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02380c82e0 con 0x7f0238159660 2023-10-06T04:31:58.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.737+0000 7f023df9d700 1 -- 172.21.15.60:0/175314544 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02380c88a0 con 0x7f0238159660 2023-10-06T04:31:58.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.738+0000 7f023df9d700 1 -- 172.21.15.60:0/175314544 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02380c8dc0 con 0x7f0238159660 2023-10-06T04:31:58.742 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.739+0000 7f0234ff9700 1 -- 172.21.15.60:0/175314544 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0230003040 con 0x7f0238159660 2023-10-06T04:31:58.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.740+0000 7f0234ff9700 1 --2- 172.21.15.60:0/175314544 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f021c066f30 0x7f021c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:58.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.740+0000 7f0234ff9700 1 -- 172.21.15.60:0/175314544 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f0230086530 con 0x7f0238159660 2023-10-06T04:31:58.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.741+0000 7f023cf9b700 1 --2- 172.21.15.60:0/175314544 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f021c066f30 0x7f021c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:58.743 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.741+0000 7f023cf9b700 1 --2- 172.21.15.60:0/175314544 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f021c066f30 0x7f021c0693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f022c006fd0 tx=0x7f022c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:58.746 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.745+0000 7f0234ff9700 1 -- 172.21.15.60:0/175314544 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02380c8dc0 con 0x7f0238159660 2023-10-06T04:31:58.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.948+0000 7f023df9d700 1 -- 172.21.15.60:0/175314544 --> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f02380b2c10 con 0x7f021c066f30 2023-10-06T04:31:58.949 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.948+0000 7f0234ff9700 1 -- 172.21.15.60:0/175314544 <== mgr.4098 v2:172.21.15.60:6832/85285 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f02380b2c10 con 0x7f021c066f30 2023-10-06T04:31:58.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.950+0000 7f023df9d700 1 -- 172.21.15.60:0/175314544 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f021c066f30 msgr2=0x7f021c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:58.952 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.950+0000 7f023df9d700 1 --2- 172.21.15.60:0/175314544 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f021c066f30 0x7f021c0693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f022c006fd0 tx=0x7f022c008040 comp rx=0 tx=0).stop 2023-10-06T04:31:58.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.950+0000 7f023df9d700 1 -- 172.21.15.60:0/175314544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238159660 msgr2=0x7f02380c7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:58.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.950+0000 7f023df9d700 1 --2- 172.21.15.60:0/175314544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238159660 0x7f02380c7670 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0238089080 tx=0x7f0230018000 comp rx=0 tx=0).stop 2023-10-06T04:31:58.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.951+0000 7f023df9d700 1 -- 172.21.15.60:0/175314544 shutdown_connections 2023-10-06T04:31:58.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.951+0000 7f023df9d700 1 --2- 172.21.15.60:0/175314544 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f021c066f30 0x7f021c0693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.951+0000 7f023df9d700 1 --2- 172.21.15.60:0/175314544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238159660 0x7f02380c7670 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.951+0000 7f023df9d700 1 --2- 172.21.15.60:0/175314544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02380cfbb0 0x7f02380a6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.951+0000 7f023df9d700 1 --2- 172.21.15.60:0/175314544 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0238159290 0x7f02380af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:58.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.951+0000 7f023df9d700 1 -- 172.21.15.60:0/175314544 >> 172.21.15.60:0/175314544 conn(0x7f02380680f0 msgr2=0x7f02380affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:58.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.951+0000 7f023df9d700 1 -- 172.21.15.60:0/175314544 shutdown_connections 2023-10-06T04:31:58.953 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:58.951+0000 7f023df9d700 1 -- 172.21.15.60:0/175314544 wait complete. 2023-10-06T04:31:58.954 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T04:31:58.970 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T04:31:58.970 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:31:59.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.163+0000 7f2287fff700 1 Processor -- start 2023-10-06T04:31:59.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.163+0000 7f2287fff700 1 -- start start 2023-10-06T04:31:59.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.164+0000 7f2287fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f22881592f0 0x7f22880b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.164+0000 7f2287fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f22880b5e10 0x7f22880b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.164+0000 7f2287fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22880cff80 con 0x7f22880b4160 2023-10-06T04:31:59.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.164+0000 7f2287fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22880afb70 con 0x7f22881592f0 2023-10-06T04:31:59.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.164+0000 7f2287fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22880b2ae0 con 0x7f22880b5e10 2023-10-06T04:31:59.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.164+0000 7f2286ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f22881592f0 0x7f22880b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.164+0000 7f2286ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f22881592f0 0x7f22880b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42670/0 (socket says 172.21.15.60:42670) 2023-10-06T04:31:59.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.164+0000 7f2286ffd700 1 -- 172.21.15.60:0/3220858874 learned_addr learned my addr 172.21.15.60:0/3220858874 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:59.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.164+0000 7f22867fc700 1 --2- 172.21.15.60:0/3220858874 >> v2:172.21.15.135:3300/0 conn(0x7f22880b5e10 0x7f22880b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.165+0000 7f2286ffd700 1 -- 172.21.15.60:0/3220858874 >> v2:172.21.15.135:3300/0 conn(0x7f22880b5e10 msgr2=0x7f22880b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:59.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.165+0000 7f2286ffd700 1 --2- 172.21.15.60:0/3220858874 >> v2:172.21.15.135:3300/0 conn(0x7f22880b5e10 0x7f22880b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.167 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.165+0000 7f2286ffd700 1 -- 172.21.15.60:0/3220858874 >> v1:172.21.15.135:6789/0 conn(0x7f22880b4160 legacy=0x7f22880b0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:59.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.165+0000 7f2286ffd700 1 -- 172.21.15.60:0/3220858874 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22880b4550 con 0x7f22881592f0 2023-10-06T04:31:59.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.165+0000 7f22867fc700 1 --2- 172.21.15.60:0/3220858874 >> v2:172.21.15.135:3300/0 conn(0x7f22880b5e10 0x7f22880b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:31:59.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.165+0000 7f2286ffd700 1 --2- 172.21.15.60:0/3220858874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22881592f0 0x7f22880b25a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f22880b5d70 tx=0x7f2278009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc166f9b19d36b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:59.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.165+0000 7f2285ffb700 1 -- 172.21.15.60:0/3220858874 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227800b820 con 0x7f22881592f0 2023-10-06T04:31:59.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.165+0000 7f2285ffb700 1 -- 172.21.15.60:0/3220858874 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227800b980 con 0x7f22881592f0 2023-10-06T04:31:59.168 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.165+0000 7f2285ffb700 1 -- 172.21.15.60:0/3220858874 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227800bd20 con 0x7f22881592f0 2023-10-06T04:31:59.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.166+0000 7f2287fff700 1 -- 172.21.15.60:0/3220858874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22881592f0 msgr2=0x7f22880b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:59.171 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.166+0000 7f2287fff700 1 --2- 172.21.15.60:0/3220858874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22881592f0 0x7f22880b25a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f22880b5d70 tx=0x7f2278009250 comp rx=0 tx=0).stop 2023-10-06T04:31:59.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.166+0000 7f2287fff700 1 -- 172.21.15.60:0/3220858874 shutdown_connections 2023-10-06T04:31:59.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.166+0000 7f2287fff700 1 --2- 172.21.15.60:0/3220858874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22881592f0 0x7f22880b25a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.166+0000 7f2287fff700 1 --2- 172.21.15.60:0/3220858874 >> v2:172.21.15.135:3300/0 conn(0x7f22880b5e10 0x7f22880b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.166+0000 7f2287fff700 1 -- 172.21.15.60:0/3220858874 >> 172.21.15.60:0/3220858874 conn(0x7f22880994e0 msgr2=0x7f228806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:59.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.166+0000 7f2287fff700 1 -- 172.21.15.60:0/3220858874 shutdown_connections 2023-10-06T04:31:59.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.166+0000 7f2287fff700 1 -- 172.21.15.60:0/3220858874 wait complete. 2023-10-06T04:31:59.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.167+0000 7f2287fff700 1 Processor -- start 2023-10-06T04:31:59.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.168+0000 7f2287fff700 1 -- start start 2023-10-06T04:31:59.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.168+0000 7f2287fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22880b4160 0x7f2288152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.168+0000 7f2287fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22880b5e10 0x7f228809c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.172 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.168+0000 7f2287fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22881592f0 0x7f228809a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.168+0000 7f2287fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228809cbf0 con 0x7f22881592f0 2023-10-06T04:31:59.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.168+0000 7f2287fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228809ced0 con 0x7f22880b5e10 2023-10-06T04:31:59.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.168+0000 7f2287fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228809d1b0 con 0x7f22880b4160 2023-10-06T04:31:59.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.169+0000 7f22877fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22881592f0 0x7f228809a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.169+0000 7f22877fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22881592f0 0x7f228809a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42686/0 (socket says 172.21.15.60:42686) 2023-10-06T04:31:59.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.169+0000 7f22877fe700 1 -- 172.21.15.60:0/4175276595 learned_addr learned my addr 172.21.15.60:0/4175276595 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:59.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.169+0000 7f2286ffd700 1 --2- 172.21.15.60:0/4175276595 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22880b4160 0x7f2288152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.169+0000 7f22867fc700 1 --2- 172.21.15.60:0/4175276595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22880b5e10 0x7f228809c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.169+0000 7f22877fe700 1 -- 172.21.15.60:0/4175276595 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22880b4160 msgr2=0x7f2288152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:59.173 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.169+0000 7f22877fe700 1 --2- 172.21.15.60:0/4175276595 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22880b4160 0x7f2288152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.169+0000 7f22877fe700 1 -- 172.21.15.60:0/4175276595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22880b5e10 msgr2=0x7f228809c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:59.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.169+0000 7f22877fe700 1 --2- 172.21.15.60:0/4175276595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22880b5e10 0x7f228809c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.169+0000 7f22877fe700 1 -- 172.21.15.60:0/4175276595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22780094f0 con 0x7f22881592f0 2023-10-06T04:31:59.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.169+0000 7f2286ffd700 1 --2- 172.21.15.60:0/4175276595 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22880b4160 0x7f2288152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:31:59.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.169+0000 7f22867fc700 1 --2- 172.21.15.60:0/4175276595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22880b5e10 0x7f228809c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:31:59.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.169+0000 7f22877fe700 1 --2- 172.21.15.60:0/4175276595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22881592f0 0x7f228809a250 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f228000c930 tx=0x7f22800026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:59.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.170+0000 7f226effd700 1 -- 172.21.15.60:0/4175276595 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228000ce70 con 0x7f22881592f0 2023-10-06T04:31:59.174 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.170+0000 7f226effd700 1 -- 172.21.15.60:0/4175276595 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228000a7e0 con 0x7f22881592f0 2023-10-06T04:31:59.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.170+0000 7f226effd700 1 -- 172.21.15.60:0/4175276595 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228000aba0 con 0x7f22881592f0 2023-10-06T04:31:59.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.170+0000 7f2287fff700 1 -- 172.21.15.60:0/4175276595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228809d490 con 0x7f22881592f0 2023-10-06T04:31:59.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.170+0000 7f2287fff700 1 -- 172.21.15.60:0/4175276595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228809c800 con 0x7f22881592f0 2023-10-06T04:31:59.175 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.170+0000 7f2287fff700 1 -- 172.21.15.60:0/4175276595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22881539d0 con 0x7f22881592f0 2023-10-06T04:31:59.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.172+0000 7f226effd700 1 -- 172.21.15.60:0/4175276595 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2280012420 con 0x7f22881592f0 2023-10-06T04:31:59.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.173+0000 7f226effd700 1 --2- 172.21.15.60:0/4175276595 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2274066f30 0x7f22740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.173+0000 7f226effd700 1 -- 172.21.15.60:0/4175276595 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f22800849b0 con 0x7f22881592f0 2023-10-06T04:31:59.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.173+0000 7f2286ffd700 1 --2- 172.21.15.60:0/4175276595 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2274066f30 0x7f22740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.173+0000 7f226effd700 1 --2- 172.21.15.60:0/4175276595 >> [v2:172.21.15.60:6816/85570,v1:172.21.15.60:6817/85570] conn(0x7f227406d850 0x7f227406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.176 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.173+0000 7f226effd700 1 -- 172.21.15.60:0/4175276595 --> [v2:172.21.15.60:6816/85570,v1:172.21.15.60:6817/85570] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2274070370 con 0x7f227406d850 2023-10-06T04:31:59.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.173+0000 7f226effd700 1 -- 172.21.15.60:0/4175276595 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2280089220 con 0x7f22881592f0 2023-10-06T04:31:59.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.173+0000 7f22867fc700 1 --2- 172.21.15.60:0/4175276595 >> [v2:172.21.15.60:6816/85570,v1:172.21.15.60:6817/85570] conn(0x7f227406d850 0x7f227406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.174+0000 7f2286ffd700 1 --2- 172.21.15.60:0/4175276595 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2274066f30 0x7f22740693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f22880b5d70 tx=0x7f2278016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:59.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.174+0000 7f22867fc700 1 --2- 172.21.15.60:0/4175276595 >> [v2:172.21.15.60:6816/85570,v1:172.21.15.60:6817/85570] conn(0x7f227406d850 0x7f227406fca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:59.177 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.175+0000 7f226effd700 1 -- 172.21.15.60:0/4175276595 <== osd.2 v2:172.21.15.60:6816/85570 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2274070370 con 0x7f227406d850 2023-10-06T04:31:59.190 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.189+0000 7f2287fff700 1 -- 172.21.15.60:0/4175276595 --> [v2:172.21.15.60:6816/85570,v1:172.21.15.60:6817/85570] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f22880646a0 con 0x7f227406d850 2023-10-06T04:31:59.191 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.189+0000 7f226effd700 1 -- 172.21.15.60:0/4175276595 <== osd.2 v2:172.21.15.60:6816/85570 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f227c009c50 con 0x7f227406d850 2023-10-06T04:31:59.191 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-06T04:31:59.191 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:31:59.191 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-06T04:31:59.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.190+0000 7f2287fff700 1 -- 172.21.15.60:0/4175276595 >> [v2:172.21.15.60:6816/85570,v1:172.21.15.60:6817/85570] conn(0x7f227406d850 msgr2=0x7f227406fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:59.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.190+0000 7f2287fff700 1 --2- 172.21.15.60:0/4175276595 >> [v2:172.21.15.60:6816/85570,v1:172.21.15.60:6817/85570] conn(0x7f227406d850 0x7f227406fca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.190+0000 7f2287fff700 1 -- 172.21.15.60:0/4175276595 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2274066f30 msgr2=0x7f22740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:59.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.190+0000 7f2287fff700 1 --2- 172.21.15.60:0/4175276595 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f2274066f30 0x7f22740693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f22880b5d70 tx=0x7f2278016000 comp rx=0 tx=0).stop 2023-10-06T04:31:59.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.190+0000 7f2287fff700 1 -- 172.21.15.60:0/4175276595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22881592f0 msgr2=0x7f228809a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:59.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.190+0000 7f2287fff700 1 --2- 172.21.15.60:0/4175276595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22881592f0 0x7f228809a250 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f228000c930 tx=0x7f22800026e0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.190+0000 7f22877fe700 1 -- 172.21.15.60:0/4175276595 reap_dead start 2023-10-06T04:31:59.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.190+0000 7f2287fff700 1 -- 172.21.15.60:0/4175276595 shutdown_connections 2023-10-06T04:31:59.193 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.190+0000 7f2287fff700 1 -- 172.21.15.60:0/4175276595 >> 172.21.15.60:0/4175276595 conn(0x7f22880994e0 msgr2=0x7f228815cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:59.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.190+0000 7f2287fff700 1 -- 172.21.15.60:0/4175276595 shutdown_connections 2023-10-06T04:31:59.194 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.190+0000 7f2287fff700 1 -- 172.21.15.60:0/4175276595 wait complete. 2023-10-06T04:31:59.208 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T04:31:59.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.396+0000 7f497f39d700 1 Processor -- start 2023-10-06T04:31:59.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.397+0000 7f497f39d700 1 -- start start 2023-10-06T04:31:59.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.398+0000 7f497f39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f497813f9f0 0x7f49780c0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.398+0000 7f497f39d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f49780ca490 0x7f4978159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.402 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.398+0000 7f497f39d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f497813fdc0 0x7f497815a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.398+0000 7f497f39d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49780cb4d0 con 0x7f497813fdc0 2023-10-06T04:31:59.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.398+0000 7f497f39d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49780c1240 con 0x7f49780ca490 2023-10-06T04:31:59.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.398+0000 7f497f39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497806f480 con 0x7f497813f9f0 2023-10-06T04:31:59.403 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.398+0000 7f497eb9c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f497813fdc0 0x7f497815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.404 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.398+0000 7f497eb9c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f497813fdc0 0x7f497815a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42696/0 (socket says 172.21.15.60:42696) 2023-10-06T04:31:59.405 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.398+0000 7f497eb9c700 1 -- 172.21.15.60:0/369999327 learned_addr learned my addr 172.21.15.60:0/369999327 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:59.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.398+0000 7f497e39b700 1 --2- 172.21.15.60:0/369999327 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f497813f9f0 0x7f49780c0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.398+0000 7f497db9a700 1 --2- 172.21.15.60:0/369999327 >> v2:172.21.15.135:3300/0 conn(0x7f49780ca490 0x7f4978159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.399+0000 7f497eb9c700 1 -- 172.21.15.60:0/369999327 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f497813f9f0 msgr2=0x7f49780c0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:59.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.399+0000 7f497eb9c700 1 --2- 172.21.15.60:0/369999327 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f497813f9f0 0x7f49780c0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.399+0000 7f497eb9c700 1 -- 172.21.15.60:0/369999327 >> v2:172.21.15.135:3300/0 conn(0x7f49780ca490 msgr2=0x7f4978159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:59.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.399+0000 7f497eb9c700 1 --2- 172.21.15.60:0/369999327 >> v2:172.21.15.135:3300/0 conn(0x7f49780ca490 0x7f4978159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.399+0000 7f497eb9c700 1 -- 172.21.15.60:0/369999327 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49780ca950 con 0x7f497813fdc0 2023-10-06T04:31:59.406 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.399+0000 7f497eb9c700 1 --2- 172.21.15.60:0/369999327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f497813fdc0 0x7f497815a420 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f497806ceb0 tx=0x7f4970009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaffe8c9e21b64fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:59.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.399+0000 7f497d399700 1 -- 172.21.15.60:0/369999327 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497000e070 con 0x7f497813fdc0 2023-10-06T04:31:59.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.399+0000 7f497d399700 1 -- 172.21.15.60:0/369999327 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497000b970 con 0x7f497813fdc0 2023-10-06T04:31:59.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.399+0000 7f497d399700 1 -- 172.21.15.60:0/369999327 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49700092e0 con 0x7f497813fdc0 2023-10-06T04:31:59.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.400+0000 7f497f39d700 1 -- 172.21.15.60:0/369999327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f497813fdc0 msgr2=0x7f497815a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:59.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.400+0000 7f497f39d700 1 --2- 172.21.15.60:0/369999327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f497813fdc0 0x7f497815a420 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f497806ceb0 tx=0x7f4970009840 comp rx=0 tx=0).stop 2023-10-06T04:31:59.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.400+0000 7f497f39d700 1 -- 172.21.15.60:0/369999327 shutdown_connections 2023-10-06T04:31:59.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.400+0000 7f497f39d700 1 --2- 172.21.15.60:0/369999327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f497813fdc0 0x7f497815a420 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.400+0000 7f497f39d700 1 --2- 172.21.15.60:0/369999327 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f497813f9f0 0x7f49780c0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.400+0000 7f497f39d700 1 --2- 172.21.15.60:0/369999327 >> v2:172.21.15.135:3300/0 conn(0x7f49780ca490 0x7f4978159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.407 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.400+0000 7f497f39d700 1 -- 172.21.15.60:0/369999327 >> 172.21.15.60:0/369999327 conn(0x7f49780cbeb0 msgr2=0x7f49780cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:59.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.400+0000 7f497f39d700 1 -- 172.21.15.60:0/369999327 shutdown_connections 2023-10-06T04:31:59.408 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.400+0000 7f497f39d700 1 -- 172.21.15.60:0/369999327 wait complete. 2023-10-06T04:31:59.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.401+0000 7f497f39d700 1 Processor -- start 2023-10-06T04:31:59.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.401+0000 7f497f39d700 1 -- start start 2023-10-06T04:31:59.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.402+0000 7f497f39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49780ca490 0x7f49780c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.402+0000 7f497f39d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f497813f9f0 0x7f49780c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.402+0000 7f497f39d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f497813fdc0 0x7f49780b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.402+0000 7f497f39d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49780b0400 con 0x7f497813f9f0 2023-10-06T04:31:59.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.402+0000 7f497f39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4978153fd0 con 0x7f49780ca490 2023-10-06T04:31:59.411 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.402+0000 7f497f39d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49780b06a0 con 0x7f497813fdc0 2023-10-06T04:31:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.403+0000 7f497db9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f497813f9f0 0x7f49780c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.403+0000 7f497db9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f497813f9f0 0x7f49780c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42698/0 (socket says 172.21.15.60:42698) 2023-10-06T04:31:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.403+0000 7f497db9a700 1 -- 172.21.15.60:0/1957976476 learned_addr learned my addr 172.21.15.60:0/1957976476 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.403+0000 7f497e39b700 1 --2- 172.21.15.60:0/1957976476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49780ca490 0x7f49780c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.403+0000 7f497eb9c700 1 --2- 172.21.15.60:0/1957976476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f497813fdc0 0x7f49780b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.403+0000 7f497db9a700 1 -- 172.21.15.60:0/1957976476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f497813fdc0 msgr2=0x7f49780b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.403+0000 7f497db9a700 1 --2- 172.21.15.60:0/1957976476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f497813fdc0 0x7f49780b0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.403+0000 7f497db9a700 1 -- 172.21.15.60:0/1957976476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49780ca490 msgr2=0x7f49780c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.403+0000 7f497db9a700 1 --2- 172.21.15.60:0/1957976476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49780ca490 0x7f49780c2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.403+0000 7f497db9a700 1 -- 172.21.15.60:0/1957976476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4970009ae0 con 0x7f497813f9f0 2023-10-06T04:31:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.403+0000 7f497eb9c700 1 --2- 172.21.15.60:0/1957976476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f497813fdc0 0x7f49780b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:31:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.403+0000 7f497db9a700 1 --2- 172.21.15.60:0/1957976476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f497813f9f0 0x7f49780c6970 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f496800ec50 tx=0x7f49680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:59.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.403+0000 7f496e7fc700 1 -- 172.21.15.60:0/1957976476 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496800c850 con 0x7f497813f9f0 2023-10-06T04:31:59.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.403+0000 7f496e7fc700 1 -- 172.21.15.60:0/1957976476 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496800c9b0 con 0x7f497813f9f0 2023-10-06T04:31:59.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.403+0000 7f496e7fc700 1 -- 172.21.15.60:0/1957976476 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496800cd70 con 0x7f497813f9f0 2023-10-06T04:31:59.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.404+0000 7f497f39d700 1 -- 172.21.15.60:0/1957976476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49780b0980 con 0x7f497813f9f0 2023-10-06T04:31:59.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.404+0000 7f497f39d700 1 -- 172.21.15.60:0/1957976476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49780c34a0 con 0x7f497813f9f0 2023-10-06T04:31:59.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.405+0000 7f497f39d700 1 -- 172.21.15.60:0/1957976476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497805f230 con 0x7f497813f9f0 2023-10-06T04:31:59.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.406+0000 7f496e7fc700 1 -- 172.21.15.60:0/1957976476 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4968013680 con 0x7f497813f9f0 2023-10-06T04:31:59.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.407+0000 7f496e7fc700 1 --2- 172.21.15.60:0/1957976476 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f495c066f30 0x7f495c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.407+0000 7f496e7fc700 1 -- 172.21.15.60:0/1957976476 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f4968084840 con 0x7f497813f9f0 2023-10-06T04:31:59.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.407+0000 7f497e39b700 1 --2- 172.21.15.60:0/1957976476 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f495c066f30 0x7f495c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.413 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.408+0000 7f497e39b700 1 --2- 172.21.15.60:0/1957976476 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f495c066f30 0x7f495c0693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4974009db0 tx=0x7f49740091a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:59.414 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.411+0000 7f496e7fc700 1 -- 172.21.15.60:0/1957976476 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4968051a70 con 0x7f497813f9f0 2023-10-06T04:31:59.614 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.613+0000 7f497f39d700 1 -- 172.21.15.60:0/1957976476 --> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f49780cac30 con 0x7f495c066f30 2023-10-06T04:31:59.615 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.613+0000 7f496e7fc700 1 -- 172.21.15.60:0/1957976476 <== mgr.4098 v2:172.21.15.60:6832/85285 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f49780cac30 con 0x7f495c066f30 2023-10-06T04:31:59.617 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.616+0000 7f497f39d700 1 -- 172.21.15.60:0/1957976476 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f495c066f30 msgr2=0x7f495c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.616+0000 7f497f39d700 1 --2- 172.21.15.60:0/1957976476 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f495c066f30 0x7f495c0693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4974009db0 tx=0x7f49740091a0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.616+0000 7f497f39d700 1 -- 172.21.15.60:0/1957976476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f497813f9f0 msgr2=0x7f49780c6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.616+0000 7f497f39d700 1 --2- 172.21.15.60:0/1957976476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f497813f9f0 0x7f49780c6970 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f496800ec50 tx=0x7f49680091a0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.616+0000 7f497f39d700 1 -- 172.21.15.60:0/1957976476 shutdown_connections 2023-10-06T04:31:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.616+0000 7f497f39d700 1 --2- 172.21.15.60:0/1957976476 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f495c066f30 0x7f495c0693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.616+0000 7f497f39d700 1 --2- 172.21.15.60:0/1957976476 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f497813fdc0 0x7f49780b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.616+0000 7f497f39d700 1 --2- 172.21.15.60:0/1957976476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49780ca490 0x7f49780c2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.616+0000 7f497f39d700 1 --2- 172.21.15.60:0/1957976476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f497813f9f0 0x7f49780c6970 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.616+0000 7f497f39d700 1 -- 172.21.15.60:0/1957976476 >> 172.21.15.60:0/1957976476 conn(0x7f49780cbeb0 msgr2=0x7f49780694e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.616+0000 7f497f39d700 1 -- 172.21.15.60:0/1957976476 shutdown_connections 2023-10-06T04:31:59.619 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.616+0000 7f497f39d700 1 -- 172.21.15.60:0/1957976476 wait complete. 2023-10-06T04:31:59.619 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T04:31:59.635 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T04:31:59.635 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:31:59.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.826+0000 7f1bfc7ff700 1 Processor -- start 2023-10-06T04:31:59.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.826+0000 7f1bfc7ff700 1 -- start start 2023-10-06T04:31:59.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.827+0000 7f1bfc7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf4069e20 0x7f1bf40aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.827+0000 7f1bfc7ff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf40ae8c0 con 0x7f1bf406e930 2023-10-06T04:31:59.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.827+0000 7f1bfc7ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf406e590 con 0x7f1bf406f250 2023-10-06T04:31:59.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.827+0000 7f1bfc7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf40ae270 con 0x7f1bf4069e20 2023-10-06T04:31:59.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.827+0000 7f1bfad9c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1bf406e930 0x7f1bf406d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34956/0 (socket says 172.21.15.60:34956) 2023-10-06T04:31:59.829 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.827+0000 7f1bfad9c700 1 -- 172.21.15.60:0/676504889 learned_addr learned my addr 172.21.15.60:0/676504889 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:31:59.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.827+0000 7f1bfa59b700 1 --2- 172.21.15.60:0/676504889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf4069e20 0x7f1bf40aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.828+0000 7f1bf9599700 1 -- 172.21.15.60:0/676504889 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382751972 0 0) 0x7f1bf40ae8c0 con 0x7f1bf406e930 2023-10-06T04:31:59.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.828+0000 7f1bf9599700 1 -- 172.21.15.60:0/676504889 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1be0003570 con 0x7f1bf406e930 2023-10-06T04:31:59.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.828+0000 7f1bf9599700 1 -- 172.21.15.60:0/676504889 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773772232 0 0) 0x7f1bf406e590 con 0x7f1bf406f250 2023-10-06T04:31:59.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.828+0000 7f1bf9599700 1 -- 172.21.15.60:0/676504889 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bf40ae8c0 con 0x7f1bf406f250 2023-10-06T04:31:59.832 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.828+0000 7f1bf9599700 1 -- 172.21.15.60:0/676504889 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2730823608 0 0) 0x7f1be0003570 con 0x7f1bf406e930 2023-10-06T04:31:59.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.828+0000 7f1bf9599700 1 -- 172.21.15.60:0/676504889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf4069e20 msgr2=0x7f1bf40aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:59.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.828+0000 7f1bf9599700 1 --2- 172.21.15.60:0/676504889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf4069e20 0x7f1bf40aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.828+0000 7f1bf9599700 1 -- 172.21.15.60:0/676504889 >> v1:172.21.15.135:6789/0 conn(0x7f1bf406f250 legacy=0x7f1bf40abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:59.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.828+0000 7f1bf9599700 1 -- 172.21.15.60:0/676504889 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf40ae550 con 0x7f1bf406e930 2023-10-06T04:31:59.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.828+0000 7f1bf9599700 1 -- 172.21.15.60:0/676504889 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7f1bec0017f0 con 0x7f1bf406e930 2023-10-06T04:31:59.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.828+0000 7f1bfa59b700 1 --2- 172.21.15.60:0/676504889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf4069e20 0x7f1bf40aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:31:59.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.828+0000 7f1bf9599700 1 -- 172.21.15.60:0/676504889 >> v1:172.21.15.60:6789/0 conn(0x7f1bf406e930 legacy=0x7f1bf406d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:59.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.828+0000 7f1bf9599700 1 --2- 172.21.15.60:0/676504889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1be0003c20 0x7f1be0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.828+0000 7f1bf9599700 1 --2- 172.21.15.60:0/676504889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1be0004810 0x7f1be0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.833 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.828+0000 7f1bf9599700 1 --2- 172.21.15.60:0/676504889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf4069e20 0x7f1be00051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.828+0000 7f1bf9599700 1 -- 172.21.15.60:0/676504889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf40ae270 con 0x7f1be0004810 2023-10-06T04:31:59.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.828+0000 7f1bf9599700 1 -- 172.21.15.60:0/676504889 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be000ddc0 con 0x7f1be0003c20 2023-10-06T04:31:59.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.828+0000 7f1bf9599700 1 -- 172.21.15.60:0/676504889 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be000df80 con 0x7f1bf4069e20 2023-10-06T04:31:59.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.828+0000 7f1bf9d9a700 1 --2- 172.21.15.60:0/676504889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1be0004810 0x7f1be0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.829+0000 7f1bfa59b700 1 --2- 172.21.15.60:0/676504889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1be0003c20 0x7f1be0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.829+0000 7f1bfad9c700 1 --2- 172.21.15.60:0/676504889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf4069e20 0x7f1be00051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.829+0000 7f1bf9d9a700 1 -- 172.21.15.60:0/676504889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf4069e20 msgr2=0x7f1be00051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:59.834 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.829+0000 7f1bf9d9a700 1 --2- 172.21.15.60:0/676504889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf4069e20 0x7f1be00051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.829+0000 7f1bf9d9a700 1 -- 172.21.15.60:0/676504889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1be0003c20 msgr2=0x7f1be0004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:31:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.829+0000 7f1bf9d9a700 1 --2- 172.21.15.60:0/676504889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1be0003c20 0x7f1be0004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.829+0000 7f1bf9d9a700 1 -- 172.21.15.60:0/676504889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf0009420 con 0x7f1be0004810 2023-10-06T04:31:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.829+0000 7f1bfad9c700 1 --2- 172.21.15.60:0/676504889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf4069e20 0x7f1be00051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:31:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.829+0000 7f1bf9d9a700 1 --2- 172.21.15.60:0/676504889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1be0004810 0x7f1be0004c80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1be4001a10 tx=0x7f1be4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971df22f01987523 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.829+0000 7f1bf9599700 1 -- 172.21.15.60:0/676504889 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be400c5d0 con 0x7f1be0004810 2023-10-06T04:31:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.829+0000 7f1bf9599700 1 -- 172.21.15.60:0/676504889 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be400c730 con 0x7f1be0004810 2023-10-06T04:31:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.829+0000 7f1bf9599700 1 -- 172.21.15.60:0/676504889 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be400cad0 con 0x7f1be0004810 2023-10-06T04:31:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.830+0000 7f1bfc7ff700 1 -- 172.21.15.60:0/676504889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1be0004810 msgr2=0x7f1be0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:59.835 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.830+0000 7f1bfc7ff700 1 --2- 172.21.15.60:0/676504889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1be0004810 0x7f1be0004c80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1be4001a10 tx=0x7f1be4007d30 comp rx=0 tx=0).stop 2023-10-06T04:31:59.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.830+0000 7f1bfad9c700 1 -- 172.21.15.60:0/676504889 reap_dead start 2023-10-06T04:31:59.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.830+0000 7f1bfc7ff700 1 -- 172.21.15.60:0/676504889 shutdown_connections 2023-10-06T04:31:59.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.830+0000 7f1bfc7ff700 1 -- 172.21.15.60:0/676504889 >> 172.21.15.60:0/676504889 conn(0x7f1bf40cc0d0 msgr2=0x7f1bf40cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:59.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.830+0000 7f1bfc7ff700 1 -- 172.21.15.60:0/676504889 shutdown_connections 2023-10-06T04:31:59.836 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.830+0000 7f1bfc7ff700 1 -- 172.21.15.60:0/676504889 wait complete. 2023-10-06T04:31:59.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.831+0000 7f1bfc7ff700 1 Processor -- start 2023-10-06T04:31:59.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.832+0000 7f1bfc7ff700 1 -- start start 2023-10-06T04:31:59.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.832+0000 7f1bfc7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1be0004810 0x7f1bf415cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.833+0000 7f1bfc7ff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf4158260 0x7f1bf4157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.833+0000 7f1bfc7ff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf41694e0 0x7f1bf4098b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.833+0000 7f1bfc7ff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf415bea0 con 0x7f1bf41694e0 2023-10-06T04:31:59.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.833+0000 7f1bfc7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf415bbc0 con 0x7f1be0004810 2023-10-06T04:31:59.840 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.833+0000 7f1bfc7ff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf4168a00 con 0x7f1bf4158260 2023-10-06T04:31:59.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.833+0000 7f1bfad9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf41694e0 0x7f1bf4098b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.833+0000 7f1bfad9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf41694e0 0x7f1bf4098b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42712/0 (socket says 172.21.15.60:42712) 2023-10-06T04:31:59.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.833+0000 7f1bfad9c700 1 -- 172.21.15.60:0/1767774014 learned_addr learned my addr 172.21.15.60:0/1767774014 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:31:59.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.833+0000 7f1bfa59b700 1 --2- 172.21.15.60:0/1767774014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1be0004810 0x7f1bf415cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.833+0000 7f1bf9d9a700 1 --2- 172.21.15.60:0/1767774014 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf4158260 0x7f1bf4157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.833+0000 7f1bfad9c700 1 -- 172.21.15.60:0/1767774014 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf4158260 msgr2=0x7f1bf4157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:59.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.833+0000 7f1bfad9c700 1 --2- 172.21.15.60:0/1767774014 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf4158260 0x7f1bf4157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.833+0000 7f1bfad9c700 1 -- 172.21.15.60:0/1767774014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1be0004810 msgr2=0x7f1bf415cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:59.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.833+0000 7f1bfad9c700 1 --2- 172.21.15.60:0/1767774014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1be0004810 0x7f1bf415cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.833+0000 7f1bfad9c700 1 -- 172.21.15.60:0/1767774014 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf4168ce0 con 0x7f1bf41694e0 2023-10-06T04:31:59.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.833+0000 7f1bfad9c700 1 --2- 172.21.15.60:0/1767774014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf41694e0 0x7f1bf4098b80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1bf406c190 tx=0x7f1bec0017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:59.841 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.834+0000 7f1bea7fc700 1 -- 172.21.15.60:0/1767774014 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec007b60 con 0x7f1bf41694e0 2023-10-06T04:31:59.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.834+0000 7f1bea7fc700 1 -- 172.21.15.60:0/1767774014 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bec00eb10 con 0x7f1bf41694e0 2023-10-06T04:31:59.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.834+0000 7f1bea7fc700 1 -- 172.21.15.60:0/1767774014 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec00eeb0 con 0x7f1bf41694e0 2023-10-06T04:31:59.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.834+0000 7f1bfc7ff700 1 -- 172.21.15.60:0/1767774014 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf4168fc0 con 0x7f1bf41694e0 2023-10-06T04:31:59.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.834+0000 7f1bfc7ff700 1 -- 172.21.15.60:0/1767774014 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf415b7e0 con 0x7f1bf41694e0 2023-10-06T04:31:59.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.835+0000 7f1bfc7ff700 1 -- 172.21.15.60:0/1767774014 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1bf4168860 con 0x7f1bf41694e0 2023-10-06T04:31:59.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.836+0000 7f1bea7fc700 1 -- 172.21.15.60:0/1767774014 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1bec013630 con 0x7f1bf41694e0 2023-10-06T04:31:59.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.837+0000 7f1bea7fc700 1 --2- 172.21.15.60:0/1767774014 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1bd8066f30 0x7f1bd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.842 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.837+0000 7f1bea7fc700 1 -- 172.21.15.60:0/1767774014 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f1bec0849d0 con 0x7f1bf41694e0 2023-10-06T04:31:59.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.837+0000 7f1bfa59b700 1 --2- 172.21.15.60:0/1767774014 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1bd8066f30 0x7f1bd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.837+0000 7f1bea7fc700 1 --2- 172.21.15.60:0/1767774014 >> [v2:172.21.15.60:6821/85599,v1:172.21.15.60:6823/85599] conn(0x7f1bd806d850 0x7f1bd806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:31:59.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.837+0000 7f1bea7fc700 1 -- 172.21.15.60:0/1767774014 --> [v2:172.21.15.60:6821/85599,v1:172.21.15.60:6823/85599] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1bd8070370 con 0x7f1bd806d850 2023-10-06T04:31:59.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.837+0000 7f1bea7fc700 1 -- 172.21.15.60:0/1767774014 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bec089220 con 0x7f1bf41694e0 2023-10-06T04:31:59.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.837+0000 7f1bf9d9a700 1 --2- 172.21.15.60:0/1767774014 >> [v2:172.21.15.60:6821/85599,v1:172.21.15.60:6823/85599] conn(0x7f1bd806d850 0x7f1bd806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:31:59.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.837+0000 7f1bfa59b700 1 --2- 172.21.15.60:0/1767774014 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1bd8066f30 0x7f1bd80693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0006f00 tx=0x7f1bf00091a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:59.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.838+0000 7f1bf9d9a700 1 --2- 172.21.15.60:0/1767774014 >> [v2:172.21.15.60:6821/85599,v1:172.21.15.60:6823/85599] conn(0x7f1bd806d850 0x7f1bd806fca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:31:59.843 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.838+0000 7f1bea7fc700 1 -- 172.21.15.60:0/1767774014 <== osd.3 v2:172.21.15.60:6821/85599 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1bd8070370 con 0x7f1bd806d850 2023-10-06T04:31:59.854 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.853+0000 7f1bfc7ff700 1 -- 172.21.15.60:0/1767774014 --> [v2:172.21.15.60:6821/85599,v1:172.21.15.60:6823/85599] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1bf4064a90 con 0x7f1bd806d850 2023-10-06T04:31:59.855 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.853+0000 7f1bea7fc700 1 -- 172.21.15.60:0/1767774014 <== osd.3 v2:172.21.15.60:6821/85599 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1bf4064a90 con 0x7f1bd806d850 2023-10-06T04:31:59.855 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-06T04:31:59.855 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:31:59.855 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-06T04:31:59.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.854+0000 7f1bfc7ff700 1 -- 172.21.15.60:0/1767774014 >> [v2:172.21.15.60:6821/85599,v1:172.21.15.60:6823/85599] conn(0x7f1bd806d850 msgr2=0x7f1bd806fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:59.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.854+0000 7f1bfc7ff700 1 --2- 172.21.15.60:0/1767774014 >> [v2:172.21.15.60:6821/85599,v1:172.21.15.60:6823/85599] conn(0x7f1bd806d850 0x7f1bd806fca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.854+0000 7f1bfc7ff700 1 -- 172.21.15.60:0/1767774014 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1bd8066f30 msgr2=0x7f1bd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:59.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.854+0000 7f1bfc7ff700 1 --2- 172.21.15.60:0/1767774014 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f1bd8066f30 0x7f1bd80693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0006f00 tx=0x7f1bf00091a0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.856 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.854+0000 7f1bfc7ff700 1 -- 172.21.15.60:0/1767774014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf41694e0 msgr2=0x7f1bf4098b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:31:59.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.854+0000 7f1bfc7ff700 1 --2- 172.21.15.60:0/1767774014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf41694e0 0x7f1bf4098b80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1bf406c190 tx=0x7f1bec0017f0 comp rx=0 tx=0).stop 2023-10-06T04:31:59.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.854+0000 7f1bfad9c700 1 -- 172.21.15.60:0/1767774014 reap_dead start 2023-10-06T04:31:59.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.854+0000 7f1bfc7ff700 1 -- 172.21.15.60:0/1767774014 shutdown_connections 2023-10-06T04:31:59.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.854+0000 7f1bfc7ff700 1 -- 172.21.15.60:0/1767774014 >> 172.21.15.60:0/1767774014 conn(0x7f1bf40cc0d0 msgr2=0x7f1bf40ca690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:31:59.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.854+0000 7f1bfc7ff700 1 -- 172.21.15.60:0/1767774014 shutdown_connections 2023-10-06T04:31:59.857 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:31:59.854+0000 7f1bfc7ff700 1 -- 172.21.15.60:0/1767774014 wait complete. 2023-10-06T04:31:59.872 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T04:32:00.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.059+0000 7f4dcd79d700 1 Processor -- start 2023-10-06T04:32:00.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.059+0000 7f4dcd79d700 1 -- start start 2023-10-06T04:32:00.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.060+0000 7f4dcd79d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4dc80c72b0 0x7f4dc80c0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.060+0000 7f4dcd79d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4dc80c7700 0x7f4dc80c1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.060+0000 7f4dcd79d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc806e910 con 0x7f4dc806d710 2023-10-06T04:32:00.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.060+0000 7f4dcd79d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc806dae0 con 0x7f4dc80c7700 2023-10-06T04:32:00.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.060+0000 7f4dcd79d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc806dd00 con 0x7f4dc80c72b0 2023-10-06T04:32:00.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.061+0000 7f4dccf9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4dc80c7700 0x7f4dc80c1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:00.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.061+0000 7f4dbffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4dc80c72b0 0x7f4dc80c0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:00.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.061+0000 7f4dccf9c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4dc80c7700 0x7f4dc80c1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:39622/0 (socket says 172.21.15.60:39622) 2023-10-06T04:32:00.064 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.061+0000 7f4dccf9c700 1 -- 172.21.15.60:0/2642765280 learned_addr learned my addr 172.21.15.60:0/2642765280 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.061+0000 7f4dbffff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4dc80c72b0 0x7f4dc80c0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.60:57558/0 (socket says 172.21.15.60:57558) 2023-10-06T04:32:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.061+0000 7f4dccf9c700 1 -- 172.21.15.60:0/2642765280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4dc80c72b0 msgr2=0x7f4dc80c0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:32:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.061+0000 7f4dccf9c700 1 --2- 172.21.15.60:0/2642765280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4dc80c72b0 0x7f4dc80c0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.061+0000 7f4dccf9c700 1 -- 172.21.15.60:0/2642765280 >> v1:172.21.15.135:6789/0 conn(0x7f4dc806d710 legacy=0x7f4dc8158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.061+0000 7f4dccf9c700 1 -- 172.21.15.60:0/2642765280 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc806dfe0 con 0x7f4dc80c7700 2023-10-06T04:32:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.061+0000 7f4dc77fe700 1 -- 172.21.15.60:0/2642765280 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219106308 0 0) 0x7f4dc806e910 con 0x7f4dc806d710 2023-10-06T04:32:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.062+0000 7f4dccf9c700 1 --2- 172.21.15.60:0/2642765280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dc80c7700 0x7f4dc80c1240 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009f20 tx=0x7f4dc0009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fef0e44cf693a6b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.062+0000 7f4dc77fe700 1 -- 172.21.15.60:0/2642765280 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc000e070 con 0x7f4dc80c7700 2023-10-06T04:32:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.062+0000 7f4dc77fe700 1 -- 172.21.15.60:0/2642765280 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc000b9d0 con 0x7f4dc80c7700 2023-10-06T04:32:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.062+0000 7f4dc77fe700 1 -- 172.21.15.60:0/2642765280 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc00092e0 con 0x7f4dc80c7700 2023-10-06T04:32:00.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.063+0000 7f4dcd79d700 1 -- 172.21.15.60:0/2642765280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dc80c7700 msgr2=0x7f4dc80c1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:00.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.063+0000 7f4dcd79d700 1 --2- 172.21.15.60:0/2642765280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dc80c7700 0x7f4dc80c1240 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009f20 tx=0x7f4dc0009840 comp rx=0 tx=0).stop 2023-10-06T04:32:00.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.063+0000 7f4dcd79d700 1 -- 172.21.15.60:0/2642765280 shutdown_connections 2023-10-06T04:32:00.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.063+0000 7f4dcd79d700 1 --2- 172.21.15.60:0/2642765280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dc80c7700 0x7f4dc80c1240 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.063+0000 7f4dcd79d700 1 --2- 172.21.15.60:0/2642765280 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4dc80c72b0 0x7f4dc80c0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.066 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.063+0000 7f4dcd79d700 1 -- 172.21.15.60:0/2642765280 >> 172.21.15.60:0/2642765280 conn(0x7f4dc80cbeb0 msgr2=0x7f4dc80cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:00.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.063+0000 7f4dcd79d700 1 -- 172.21.15.60:0/2642765280 shutdown_connections 2023-10-06T04:32:00.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.063+0000 7f4dcd79d700 1 -- 172.21.15.60:0/2642765280 wait complete. 2023-10-06T04:32:00.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.064+0000 7f4dcd79d700 1 Processor -- start 2023-10-06T04:32:00.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.064+0000 7f4dcd79d700 1 -- start start 2023-10-06T04:32:00.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.065+0000 7f4dcd79d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dc806d710 0x7f4dc81504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.069 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.065+0000 7f4dcd79d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4dc80c72b0 0x7f4dc80aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.065+0000 7f4dcd79d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dc80c7700 0x7f4dc806a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.065+0000 7f4dcd79d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc81509f0 con 0x7f4dc806d710 2023-10-06T04:32:00.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.065+0000 7f4dcd79d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc80b0450 con 0x7f4dc80c7700 2023-10-06T04:32:00.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.065+0000 7f4dcd79d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc80af840 con 0x7f4dc80c72b0 2023-10-06T04:32:00.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.066+0000 7f4dc7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dc806d710 0x7f4dc81504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:00.070 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.066+0000 7f4dc7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dc806d710 0x7f4dc81504b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42716/0 (socket says 172.21.15.60:42716) 2023-10-06T04:32:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.066+0000 7f4dc7fff700 1 -- 172.21.15.60:0/2891834281 learned_addr learned my addr 172.21.15.60:0/2891834281 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.066+0000 7f4dccf9c700 1 --2- 172.21.15.60:0/2891834281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dc80c7700 0x7f4dc806a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.066+0000 7f4dbffff700 1 --2- 172.21.15.60:0/2891834281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4dc80c72b0 0x7f4dc80aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.066+0000 7f4dc7fff700 1 -- 172.21.15.60:0/2891834281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4dc80c72b0 msgr2=0x7f4dc80aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.066+0000 7f4dc7fff700 1 --2- 172.21.15.60:0/2891834281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4dc80c72b0 0x7f4dc80aed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.066+0000 7f4dc7fff700 1 -- 172.21.15.60:0/2891834281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dc80c7700 msgr2=0x7f4dc806a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.066+0000 7f4dc7fff700 1 --2- 172.21.15.60:0/2891834281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dc80c7700 0x7f4dc806a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.066+0000 7f4dc7fff700 1 -- 172.21.15.60:0/2891834281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc0009ae0 con 0x7f4dc806d710 2023-10-06T04:32:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.066+0000 7f4dc7fff700 1 --2- 172.21.15.60:0/2891834281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dc806d710 0x7f4dc81504b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4db800c7e0 tx=0x7f4db8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.067+0000 7f4dc4ff9700 1 -- 172.21.15.60:0/2891834281 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db8012700 con 0x7f4dc806d710 2023-10-06T04:32:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.067+0000 7f4dc4ff9700 1 -- 172.21.15.60:0/2891834281 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db8012880 con 0x7f4dc806d710 2023-10-06T04:32:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.067+0000 7f4dc4ff9700 1 -- 172.21.15.60:0/2891834281 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db8012c40 con 0x7f4dc806d710 2023-10-06T04:32:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.067+0000 7f4dcd79d700 1 -- 172.21.15.60:0/2891834281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc80afb20 con 0x7f4dc806d710 2023-10-06T04:32:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.067+0000 7f4dcd79d700 1 -- 172.21.15.60:0/2891834281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc80b00e0 con 0x7f4dc806d710 2023-10-06T04:32:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.068+0000 7f4dcd79d700 1 -- 172.21.15.60:0/2891834281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc80b07e0 con 0x7f4dc806d710 2023-10-06T04:32:00.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.069+0000 7f4dc4ff9700 1 -- 172.21.15.60:0/2891834281 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4db801b400 con 0x7f4dc806d710 2023-10-06T04:32:00.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.070+0000 7f4dc4ff9700 1 --2- 172.21.15.60:0/2891834281 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4da8066f30 0x7f4da80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.070+0000 7f4dc4ff9700 1 -- 172.21.15.60:0/2891834281 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f4db8084120 con 0x7f4dc806d710 2023-10-06T04:32:00.073 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.070+0000 7f4dbffff700 1 --2- 172.21.15.60:0/2891834281 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4da8066f30 0x7f4da80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:00.074 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.071+0000 7f4dbffff700 1 --2- 172.21.15.60:0/2891834281 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4da8066f30 0x7f4da80693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4dc80c5250 tx=0x7f4db0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:00.075 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.074+0000 7f4dc4ff9700 1 -- 172.21.15.60:0/2891834281 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4dc80b07e0 con 0x7f4dc806d710 2023-10-06T04:32:00.277 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.276+0000 7f4dcd79d700 1 -- 172.21.15.60:0/2891834281 --> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4dc80b07e0 con 0x7f4da8066f30 2023-10-06T04:32:00.278 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.276+0000 7f4dc4ff9700 1 -- 172.21.15.60:0/2891834281 <== mgr.4098 v2:172.21.15.60:6832/85285 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4dc80b07e0 con 0x7f4da8066f30 2023-10-06T04:32:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.278+0000 7f4dcd79d700 1 -- 172.21.15.60:0/2891834281 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4da8066f30 msgr2=0x7f4da80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.278+0000 7f4dcd79d700 1 --2- 172.21.15.60:0/2891834281 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4da8066f30 0x7f4da80693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4dc80c5250 tx=0x7f4db0008040 comp rx=0 tx=0).stop 2023-10-06T04:32:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.278+0000 7f4dcd79d700 1 -- 172.21.15.60:0/2891834281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dc806d710 msgr2=0x7f4dc81504b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.278+0000 7f4dcd79d700 1 --2- 172.21.15.60:0/2891834281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dc806d710 0x7f4dc81504b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4db800c7e0 tx=0x7f4db8007df0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.279+0000 7f4dcd79d700 1 -- 172.21.15.60:0/2891834281 shutdown_connections 2023-10-06T04:32:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.279+0000 7f4dcd79d700 1 --2- 172.21.15.60:0/2891834281 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f4da8066f30 0x7f4da80693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.279+0000 7f4dcd79d700 1 --2- 172.21.15.60:0/2891834281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dc806d710 0x7f4dc81504b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.279+0000 7f4dcd79d700 1 --2- 172.21.15.60:0/2891834281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dc80c7700 0x7f4dc806a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.279+0000 7f4dcd79d700 1 --2- 172.21.15.60:0/2891834281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4dc80c72b0 0x7f4dc80aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.279+0000 7f4dcd79d700 1 -- 172.21.15.60:0/2891834281 >> 172.21.15.60:0/2891834281 conn(0x7f4dc80cbeb0 msgr2=0x7f4dc80c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.279+0000 7f4dcd79d700 1 -- 172.21.15.60:0/2891834281 shutdown_connections 2023-10-06T04:32:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.279+0000 7f4dcd79d700 1 -- 172.21.15.60:0/2891834281 wait complete. 2023-10-06T04:32:00.282 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T04:32:00.298 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T04:32:00.298 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:32:00.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.489+0000 7fefe759e700 1 Processor -- start 2023-10-06T04:32:00.491 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.489+0000 7fefe759e700 1 -- start start 2023-10-06T04:32:00.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.490+0000 7fefe759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fefe8142a30 0x7fefe806b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.490+0000 7fefe759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefe8142e00 0x7fefe806b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.490+0000 7fefe759e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe80b1b80 con 0x7fefe80b0e70 2023-10-06T04:32:00.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.490+0000 7fefe759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe80696d0 con 0x7fefe8142a30 2023-10-06T04:32:00.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.490+0000 7fefe759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe80cea30 con 0x7fefe8142e00 2023-10-06T04:32:00.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.491+0000 7fefe659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fefe8142a30 0x7fefe806b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:00.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.491+0000 7fefe659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fefe8142a30 0x7fefe806b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42730/0 (socket says 172.21.15.60:42730) 2023-10-06T04:32:00.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.491+0000 7fefe659c700 1 -- 172.21.15.60:0/1895123349 learned_addr learned my addr 172.21.15.60:0/1895123349 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:00.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.491+0000 7fefe659c700 1 -- 172.21.15.60:0/1895123349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefe8142e00 msgr2=0x7fefe806b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:32:00.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.491+0000 7fefe659c700 1 --2- 172.21.15.60:0/1895123349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefe8142e00 0x7fefe806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.491+0000 7fefe659c700 1 -- 172.21.15.60:0/1895123349 >> v1:172.21.15.135:6789/0 conn(0x7fefe80b0e70 legacy=0x7fefe80b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:32:00.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.491+0000 7fefe659c700 1 -- 172.21.15.60:0/1895123349 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe80ce100 con 0x7fefe8142a30 2023-10-06T04:32:00.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.491+0000 7fefe659c700 1 --2- 172.21.15.60:0/1895123349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe8142a30 0x7fefe806b340 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fefd80099b0 tx=0x7fefd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f223af4ac107d731 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:00.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.491+0000 7fefe559a700 1 -- 172.21.15.60:0/1895123349 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd800b820 con 0x7fefe8142a30 2023-10-06T04:32:00.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.492+0000 7fefe559a700 1 -- 172.21.15.60:0/1895123349 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd800b980 con 0x7fefe8142a30 2023-10-06T04:32:00.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.492+0000 7fefe559a700 1 -- 172.21.15.60:0/1895123349 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd800bd40 con 0x7fefe8142a30 2023-10-06T04:32:00.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.492+0000 7fefe759e700 1 -- 172.21.15.60:0/1895123349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe8142a30 msgr2=0x7fefe806b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:00.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.492+0000 7fefe759e700 1 --2- 172.21.15.60:0/1895123349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe8142a30 0x7fefe806b340 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fefd80099b0 tx=0x7fefd8009250 comp rx=0 tx=0).stop 2023-10-06T04:32:00.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.492+0000 7fefe759e700 1 -- 172.21.15.60:0/1895123349 shutdown_connections 2023-10-06T04:32:00.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.492+0000 7fefe759e700 1 --2- 172.21.15.60:0/1895123349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe8142a30 0x7fefe806b340 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.492+0000 7fefe759e700 1 --2- 172.21.15.60:0/1895123349 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefe8142e00 0x7fefe806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.492+0000 7fefe759e700 1 -- 172.21.15.60:0/1895123349 >> 172.21.15.60:0/1895123349 conn(0x7fefe80675b0 msgr2=0x7fefe80679b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:00.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.492+0000 7fefe759e700 1 -- 172.21.15.60:0/1895123349 shutdown_connections 2023-10-06T04:32:00.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.492+0000 7fefe759e700 1 -- 172.21.15.60:0/1895123349 wait complete. 2023-10-06T04:32:00.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.494+0000 7fefe759e700 1 Processor -- start 2023-10-06T04:32:00.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.494+0000 7fefe759e700 1 -- start start 2023-10-06T04:32:00.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.495+0000 7fefe759e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefe80b0e70 0x7fefe8158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.497 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.495+0000 7fefe759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe8142a30 0x7fefe813e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.495+0000 7fefe759e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefe8142e00 0x7fefe8067980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.495+0000 7fefe759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe813cab0 con 0x7fefe8142a30 2023-10-06T04:32:00.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.495+0000 7fefe759e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe8158fa0 con 0x7fefe8142e00 2023-10-06T04:32:00.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.495+0000 7fefe759e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe816a800 con 0x7fefe80b0e70 2023-10-06T04:32:00.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.495+0000 7fefe5d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe8142a30 0x7fefe813e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:00.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.495+0000 7fefe5d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe8142a30 0x7fefe813e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42734/0 (socket says 172.21.15.60:42734) 2023-10-06T04:32:00.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.495+0000 7fefe5d9b700 1 -- 172.21.15.60:0/2452428250 learned_addr learned my addr 172.21.15.60:0/2452428250 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:00.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.495+0000 7fefe659c700 1 --2- 172.21.15.60:0/2452428250 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefe80b0e70 0x7fefe8158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:00.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.495+0000 7fefe6d9d700 1 --2- 172.21.15.60:0/2452428250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefe8142e00 0x7fefe8067980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:00.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.495+0000 7fefe5d9b700 1 -- 172.21.15.60:0/2452428250 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefe80b0e70 msgr2=0x7fefe8158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:00.498 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.495+0000 7fefe5d9b700 1 --2- 172.21.15.60:0/2452428250 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fefe80b0e70 0x7fefe8158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.495+0000 7fefe5d9b700 1 -- 172.21.15.60:0/2452428250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefe8142e00 msgr2=0x7fefe8067980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:00.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.495+0000 7fefe5d9b700 1 --2- 172.21.15.60:0/2452428250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefe8142e00 0x7fefe8067980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.495+0000 7fefe5d9b700 1 -- 172.21.15.60:0/2452428250 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd80094f0 con 0x7fefe8142a30 2023-10-06T04:32:00.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.495+0000 7fefe6d9d700 1 --2- 172.21.15.60:0/2452428250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefe8142e00 0x7fefe8067980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:32:00.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.496+0000 7fefe5d9b700 1 --2- 172.21.15.60:0/2452428250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe8142a30 0x7fefe813e120 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fefdc00b840 tx=0x7fefdc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:00.499 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.496+0000 7fefd67fc700 1 -- 172.21.15.60:0/2452428250 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc00f510 con 0x7fefe8142a30 2023-10-06T04:32:00.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.496+0000 7fefd67fc700 1 -- 172.21.15.60:0/2452428250 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefdc00f670 con 0x7fefe8142a30 2023-10-06T04:32:00.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.496+0000 7fefd67fc700 1 -- 172.21.15.60:0/2452428250 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc00fa30 con 0x7fefe8142a30 2023-10-06T04:32:00.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.496+0000 7fefe759e700 1 -- 172.21.15.60:0/2452428250 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe8169bf0 con 0x7fefe8142a30 2023-10-06T04:32:00.500 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.496+0000 7fefe759e700 1 -- 172.21.15.60:0/2452428250 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe816a490 con 0x7fefe8142a30 2023-10-06T04:32:00.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.497+0000 7fefe759e700 1 -- 172.21.15.60:0/2452428250 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fefe8169ff0 con 0x7fefe8142a30 2023-10-06T04:32:00.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.498+0000 7fefd67fc700 1 -- 172.21.15.60:0/2452428250 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fefdc01a400 con 0x7fefe8142a30 2023-10-06T04:32:00.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.499+0000 7fefd67fc700 1 --2- 172.21.15.60:0/2452428250 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fefc8066f30 0x7fefc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.499+0000 7fefd67fc700 1 -- 172.21.15.60:0/2452428250 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fefdc084070 con 0x7fefe8142a30 2023-10-06T04:32:00.501 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.499+0000 7fefe659c700 1 --2- 172.21.15.60:0/2452428250 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fefc8066f30 0x7fefc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:00.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.499+0000 7fefd67fc700 1 --2- 172.21.15.60:0/2452428250 >> [v2:172.21.15.135:6816/85815,v1:172.21.15.135:6817/85815] conn(0x7fefc806d850 0x7fefc806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.499+0000 7fefd67fc700 1 -- 172.21.15.60:0/2452428250 --> [v2:172.21.15.135:6816/85815,v1:172.21.15.135:6817/85815] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fefc8070370 con 0x7fefc806d850 2023-10-06T04:32:00.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.499+0000 7fefd67fc700 1 -- 172.21.15.60:0/2452428250 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefdc086570 con 0x7fefe8142a30 2023-10-06T04:32:00.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.500+0000 7fefe6d9d700 1 --2- 172.21.15.60:0/2452428250 >> [v2:172.21.15.135:6816/85815,v1:172.21.15.135:6817/85815] conn(0x7fefc806d850 0x7fefc806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:00.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.500+0000 7fefe659c700 1 --2- 172.21.15.60:0/2452428250 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fefc8066f30 0x7fefc80693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fefd80099b0 tx=0x7fefd8016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:00.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.500+0000 7fefe6d9d700 1 --2- 172.21.15.60:0/2452428250 >> [v2:172.21.15.135:6816/85815,v1:172.21.15.135:6817/85815] conn(0x7fefc806d850 0x7fefc806fca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:00.502 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.501+0000 7fefd67fc700 1 -- 172.21.15.60:0/2452428250 <== osd.4 v2:172.21.15.135:6816/85815 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fefc8070370 con 0x7fefc806d850 2023-10-06T04:32:00.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.516+0000 7fefe759e700 1 -- 172.21.15.60:0/2452428250 --> [v2:172.21.15.135:6816/85815,v1:172.21.15.135:6817/85815] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fefe805f230 con 0x7fefc806d850 2023-10-06T04:32:00.517 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.516+0000 7fefd67fc700 1 -- 172.21.15.60:0/2452428250 <== osd.4 v2:172.21.15.135:6816/85815 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fefe805f230 con 0x7fefc806d850 2023-10-06T04:32:00.518 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-06T04:32:00.518 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:32:00.518 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-06T04:32:00.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.517+0000 7fefe759e700 1 -- 172.21.15.60:0/2452428250 >> [v2:172.21.15.135:6816/85815,v1:172.21.15.135:6817/85815] conn(0x7fefc806d850 msgr2=0x7fefc806fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:00.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.517+0000 7fefe759e700 1 --2- 172.21.15.60:0/2452428250 >> [v2:172.21.15.135:6816/85815,v1:172.21.15.135:6817/85815] conn(0x7fefc806d850 0x7fefc806fca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.517+0000 7fefe759e700 1 -- 172.21.15.60:0/2452428250 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fefc8066f30 msgr2=0x7fefc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:00.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.517+0000 7fefe759e700 1 --2- 172.21.15.60:0/2452428250 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fefc8066f30 0x7fefc80693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fefd80099b0 tx=0x7fefd8016000 comp rx=0 tx=0).stop 2023-10-06T04:32:00.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.517+0000 7fefe759e700 1 -- 172.21.15.60:0/2452428250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe8142a30 msgr2=0x7fefe813e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:00.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.517+0000 7fefe759e700 1 --2- 172.21.15.60:0/2452428250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe8142a30 0x7fefe813e120 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fefdc00b840 tx=0x7fefdc0091d0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.517+0000 7fefe6d9d700 1 -- 172.21.15.60:0/2452428250 reap_dead start 2023-10-06T04:32:00.519 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.517+0000 7fefe759e700 1 -- 172.21.15.60:0/2452428250 shutdown_connections 2023-10-06T04:32:00.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.517+0000 7fefe759e700 1 -- 172.21.15.60:0/2452428250 >> 172.21.15.60:0/2452428250 conn(0x7fefe80675b0 msgr2=0x7fefe8137790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:00.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.517+0000 7fefe759e700 1 -- 172.21.15.60:0/2452428250 shutdown_connections 2023-10-06T04:32:00.520 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.517+0000 7fefe759e700 1 -- 172.21.15.60:0/2452428250 wait complete. 2023-10-06T04:32:00.535 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T04:32:00.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.722+0000 7f335b59e700 1 Processor -- start 2023-10-06T04:32:00.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.722+0000 7f335b59e700 1 -- start start 2023-10-06T04:32:00.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.723+0000 7f335b59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f335c0af560 0x7f335c0ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.723+0000 7f335b59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f335c15cff0 con 0x7f335c159660 2023-10-06T04:32:00.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.723+0000 7f335b59e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f335c0cb2d0 con 0x7f335c159290 2023-10-06T04:32:00.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.723+0000 7f335b59e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f335c0ce9f0 con 0x7f335c0af560 2023-10-06T04:32:00.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.723+0000 7f3359d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f335c159660 0x7f335c0aee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34966/0 (socket says 172.21.15.60:34966) 2023-10-06T04:32:00.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.724+0000 7f3359d9b700 1 -- 172.21.15.60:0/1142186160 learned_addr learned my addr 172.21.15.60:0/1142186160 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:32:00.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.724+0000 7f335ad9d700 1 --2- 172.21.15.60:0/1142186160 >> v2:172.21.15.135:3300/0 conn(0x7f335c0af560 0x7f335c0ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:00.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.724+0000 7f335959a700 1 -- 172.21.15.60:0/1142186160 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008796713 0 0) 0x7f335c15cff0 con 0x7f335c159660 2023-10-06T04:32:00.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.724+0000 7f335959a700 1 -- 172.21.15.60:0/1142186160 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3344003570 con 0x7f335c159660 2023-10-06T04:32:00.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.724+0000 7f335959a700 1 -- 172.21.15.60:0/1142186160 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2645023969 0 0) 0x7f3344003570 con 0x7f335c159660 2023-10-06T04:32:00.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.724+0000 7f335959a700 1 -- 172.21.15.60:0/1142186160 >> v2:172.21.15.135:3300/0 conn(0x7f335c0af560 msgr2=0x7f335c0ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:32:00.729 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.724+0000 7f335959a700 1 --2- 172.21.15.60:0/1142186160 >> v2:172.21.15.135:3300/0 conn(0x7f335c0af560 0x7f335c0ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.724+0000 7f335959a700 1 -- 172.21.15.60:0/1142186160 >> v1:172.21.15.135:6789/0 conn(0x7f335c159290 legacy=0x7f335c0ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:00.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.724+0000 7f335959a700 1 -- 172.21.15.60:0/1142186160 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c0cb570 con 0x7f335c159660 2023-10-06T04:32:00.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.724+0000 7f335959a700 1 -- 172.21.15.60:0/1142186160 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 464145320 0 0) 0x7f3350001470 con 0x7f335c159660 2023-10-06T04:32:00.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.724+0000 7f335959a700 1 -- 172.21.15.60:0/1142186160 >> v1:172.21.15.60:6789/0 conn(0x7f335c159660 legacy=0x7f335c0aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:00.730 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.724+0000 7f335959a700 1 --2- 172.21.15.60:0/1142186160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3344003ab0 0x7f3344003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.724+0000 7f335959a700 1 --2- 172.21.15.60:0/1142186160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3344004810 0x7f3344004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.724+0000 7f335959a700 1 --2- 172.21.15.60:0/1142186160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3344005210 0x7f334400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.725+0000 7f335959a700 1 -- 172.21.15.60:0/1142186160 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c0ce9f0 con 0x7f3344005210 2023-10-06T04:32:00.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.725+0000 7f335959a700 1 -- 172.21.15.60:0/1142186160 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334400c130 con 0x7f3344004810 2023-10-06T04:32:00.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.725+0000 7f335959a700 1 -- 172.21.15.60:0/1142186160 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334400c2f0 con 0x7f3344003ab0 2023-10-06T04:32:00.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.725+0000 7f335ad9d700 1 --2- 172.21.15.60:0/1142186160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3344005210 0x7f334400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:00.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.725+0000 7f335a59c700 1 --2- 172.21.15.60:0/1142186160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3344003ab0 0x7f3344003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:00.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.725+0000 7f3359d9b700 1 --2- 172.21.15.60:0/1142186160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3344004810 0x7f3344004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:00.731 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.725+0000 7f335ad9d700 1 -- 172.21.15.60:0/1142186160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3344003ab0 msgr2=0x7f3344003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:32:00.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.725+0000 7f335ad9d700 1 --2- 172.21.15.60:0/1142186160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3344003ab0 0x7f3344003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.725+0000 7f335ad9d700 1 -- 172.21.15.60:0/1142186160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3344004810 msgr2=0x7f3344004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:32:00.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.725+0000 7f335ad9d700 1 --2- 172.21.15.60:0/1142186160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3344004810 0x7f3344004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.725+0000 7f335ad9d700 1 -- 172.21.15.60:0/1142186160 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3344003570 con 0x7f3344005210 2023-10-06T04:32:00.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.725+0000 7f335ad9d700 1 -- 172.21.15.60:0/1142186160 reap_dead start 2023-10-06T04:32:00.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.725+0000 7f335ad9d700 1 --2- 172.21.15.60:0/1142186160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3344005210 0x7f334400ba60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f335c0896a0 tx=0x7f335400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b87f6f268c630e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:00.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.726+0000 7f335959a700 1 -- 172.21.15.60:0/1142186160 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335400ea60 con 0x7f3344005210 2023-10-06T04:32:00.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.726+0000 7f335959a700 1 -- 172.21.15.60:0/1142186160 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335400f040 con 0x7f3344005210 2023-10-06T04:32:00.732 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.726+0000 7f335959a700 1 -- 172.21.15.60:0/1142186160 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335400ee30 con 0x7f3344005210 2023-10-06T04:32:00.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.726+0000 7f335b59e700 1 -- 172.21.15.60:0/1142186160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3344005210 msgr2=0x7f334400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:00.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.726+0000 7f335b59e700 1 --2- 172.21.15.60:0/1142186160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3344005210 0x7f334400ba60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f335c0896a0 tx=0x7f335400b040 comp rx=0 tx=0).stop 2023-10-06T04:32:00.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.726+0000 7f335b59e700 1 -- 172.21.15.60:0/1142186160 shutdown_connections 2023-10-06T04:32:00.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.726+0000 7f335b59e700 1 --2- 172.21.15.60:0/1142186160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3344005210 0x7f334400ba60 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.726+0000 7f335b59e700 1 -- 172.21.15.60:0/1142186160 >> 172.21.15.60:0/1142186160 conn(0x7f335c0680f0 msgr2=0x7f335c0684f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:00.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.726+0000 7f335b59e700 1 -- 172.21.15.60:0/1142186160 shutdown_connections 2023-10-06T04:32:00.733 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.726+0000 7f335b59e700 1 -- 172.21.15.60:0/1142186160 wait complete. 2023-10-06T04:32:00.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.728+0000 7f335b59e700 1 Processor -- start 2023-10-06T04:32:00.736 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.728+0000 7f335b59e700 1 -- start start 2023-10-06T04:32:00.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.729+0000 7f335b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3344005210 0x7f335c0c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.729+0000 7f335b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f335c0c6900 0x7f335c15bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.729+0000 7f335b59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f335c15c130 0x7f335c150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.729+0000 7f335b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c0b38f0 con 0x7f3344005210 2023-10-06T04:32:00.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.729+0000 7f335b59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c159e50 con 0x7f335c15c130 2023-10-06T04:32:00.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.729+0000 7f335b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335c15a130 con 0x7f335c0c6900 2023-10-06T04:32:00.737 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.729+0000 7f335a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3344005210 0x7f335c0c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:00.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.729+0000 7f335a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3344005210 0x7f335c0c63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42746/0 (socket says 172.21.15.60:42746) 2023-10-06T04:32:00.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.729+0000 7f335a59c700 1 -- 172.21.15.60:0/3603268089 learned_addr learned my addr 172.21.15.60:0/3603268089 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:00.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.729+0000 7f335ad9d700 1 --2- 172.21.15.60:0/3603268089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f335c15c130 0x7f335c150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:00.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.729+0000 7f3359d9b700 1 --2- 172.21.15.60:0/3603268089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f335c0c6900 0x7f335c15bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:00.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.729+0000 7f335a59c700 1 -- 172.21.15.60:0/3603268089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f335c0c6900 msgr2=0x7f335c15bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:00.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.729+0000 7f335a59c700 1 --2- 172.21.15.60:0/3603268089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f335c0c6900 0x7f335c15bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.729+0000 7f335a59c700 1 -- 172.21.15.60:0/3603268089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f335c15c130 msgr2=0x7f335c150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:00.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.729+0000 7f335a59c700 1 --2- 172.21.15.60:0/3603268089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f335c15c130 0x7f335c150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.729+0000 7f335a59c700 1 -- 172.21.15.60:0/3603268089 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c15a410 con 0x7f3344005210 2023-10-06T04:32:00.739 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.729+0000 7f3359d9b700 1 --2- 172.21.15.60:0/3603268089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f335c0c6900 0x7f335c15bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:32:00.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.730+0000 7f335a59c700 1 --2- 172.21.15.60:0/3603268089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3344005210 0x7f335c0c63c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f334c002950 tx=0x7f334c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:00.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.730+0000 7f334a7fc700 1 -- 172.21.15.60:0/3603268089 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c00f8d0 con 0x7f3344005210 2023-10-06T04:32:00.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.730+0000 7f334a7fc700 1 -- 172.21.15.60:0/3603268089 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c00fa30 con 0x7f3344005210 2023-10-06T04:32:00.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.730+0000 7f335b59e700 1 -- 172.21.15.60:0/3603268089 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f335c15a6f0 con 0x7f3344005210 2023-10-06T04:32:00.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.730+0000 7f334a7fc700 1 -- 172.21.15.60:0/3603268089 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c00fdf0 con 0x7f3344005210 2023-10-06T04:32:00.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.730+0000 7f335b59e700 1 -- 172.21.15.60:0/3603268089 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335c1510e0 con 0x7f3344005210 2023-10-06T04:32:00.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.731+0000 7f335b59e700 1 -- 172.21.15.60:0/3603268089 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f335c15a930 con 0x7f3344005210 2023-10-06T04:32:00.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.732+0000 7f334a7fc700 1 -- 172.21.15.60:0/3603268089 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f334c006a30 con 0x7f3344005210 2023-10-06T04:32:00.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.733+0000 7f334a7fc700 1 --2- 172.21.15.60:0/3603268089 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f333c066f60 0x7f333c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:00.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.733+0000 7f334a7fc700 1 -- 172.21.15.60:0/3603268089 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f334c084690 con 0x7f3344005210 2023-10-06T04:32:00.740 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.733+0000 7f3359d9b700 1 --2- 172.21.15.60:0/3603268089 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f333c066f60 0x7f333c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:00.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.734+0000 7f3359d9b700 1 --2- 172.21.15.60:0/3603268089 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f333c066f60 0x7f333c069410 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f33500011e0 tx=0x7f3350009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:00.741 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.737+0000 7f334a7fc700 1 -- 172.21.15.60:0/3603268089 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f334c051a10 con 0x7f3344005210 2023-10-06T04:32:00.941 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.940+0000 7f335b59e700 1 -- 172.21.15.60:0/3603268089 --> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f335c05f230 con 0x7f333c066f60 2023-10-06T04:32:00.942 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.940+0000 7f334a7fc700 1 -- 172.21.15.60:0/3603268089 <== mgr.4098 v2:172.21.15.60:6832/85285 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f335c05f230 con 0x7f333c066f60 2023-10-06T04:32:00.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.942+0000 7f335b59e700 1 -- 172.21.15.60:0/3603268089 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f333c066f60 msgr2=0x7f333c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:00.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.942+0000 7f335b59e700 1 --2- 172.21.15.60:0/3603268089 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f333c066f60 0x7f333c069410 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f33500011e0 tx=0x7f3350009040 comp rx=0 tx=0).stop 2023-10-06T04:32:00.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.942+0000 7f335b59e700 1 -- 172.21.15.60:0/3603268089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3344005210 msgr2=0x7f335c0c63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:00.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.942+0000 7f335b59e700 1 --2- 172.21.15.60:0/3603268089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3344005210 0x7f335c0c63c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f334c002950 tx=0x7f334c007d30 comp rx=0 tx=0).stop 2023-10-06T04:32:00.944 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.942+0000 7f335b59e700 1 -- 172.21.15.60:0/3603268089 shutdown_connections 2023-10-06T04:32:00.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.942+0000 7f335b59e700 1 --2- 172.21.15.60:0/3603268089 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f333c066f60 0x7f333c069410 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.942+0000 7f335b59e700 1 --2- 172.21.15.60:0/3603268089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3344005210 0x7f335c0c63c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.942+0000 7f335b59e700 1 --2- 172.21.15.60:0/3603268089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f335c15c130 0x7f335c150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.942+0000 7f335b59e700 1 --2- 172.21.15.60:0/3603268089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f335c0c6900 0x7f335c15bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:00.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.942+0000 7f335b59e700 1 -- 172.21.15.60:0/3603268089 >> 172.21.15.60:0/3603268089 conn(0x7f335c0680f0 msgr2=0x7f335c0d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:00.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.943+0000 7f335b59e700 1 -- 172.21.15.60:0/3603268089 shutdown_connections 2023-10-06T04:32:00.945 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:00.943+0000 7f335b59e700 1 -- 172.21.15.60:0/3603268089 wait complete. 2023-10-06T04:32:00.946 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T04:32:00.962 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T04:32:00.962 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:32:01.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.151+0000 7fc70259d700 1 Processor -- start 2023-10-06T04:32:01.153 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.151+0000 7fc70259d700 1 -- start start 2023-10-06T04:32:01.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.153+0000 7fc70259d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6fc155e90 0x7fc6fc0c8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:01.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.153+0000 7fc70259d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc6fc0c8e50 0x7fc6fc0b0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:01.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.153+0000 7fc70259d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6fc0ac970 con 0x7fc6fc156260 2023-10-06T04:32:01.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.153+0000 7fc70259d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6fc0acc50 con 0x7fc6fc0c8e50 2023-10-06T04:32:01.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.153+0000 7fc70259d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc0acf30 con 0x7fc6fc155e90 2023-10-06T04:32:01.156 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.153+0000 7fc700d9a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc6fc0c8e50 0x7fc6fc0b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:01.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.153+0000 7fc700d9a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc6fc0c8e50 0x7fc6fc0b0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42748/0 (socket says 172.21.15.60:42748) 2023-10-06T04:32:01.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.153+0000 7fc700d9a700 1 -- 172.21.15.60:0/2848966185 learned_addr learned my addr 172.21.15.60:0/2848966185 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:01.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.153+0000 7fc70159b700 1 --2- 172.21.15.60:0/2848966185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6fc155e90 0x7fc6fc0c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:01.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.153+0000 7fc700d9a700 1 -- 172.21.15.60:0/2848966185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6fc155e90 msgr2=0x7fc6fc0c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:32:01.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.153+0000 7fc700d9a700 1 --2- 172.21.15.60:0/2848966185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6fc155e90 0x7fc6fc0c8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.153+0000 7fc700d9a700 1 -- 172.21.15.60:0/2848966185 >> v1:172.21.15.135:6789/0 conn(0x7fc6fc156260 legacy=0x7fc6fc06e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:32:01.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.153+0000 7fc700d9a700 1 -- 172.21.15.60:0/2848966185 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6fc0ad210 con 0x7fc6fc0c8e50 2023-10-06T04:32:01.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.153+0000 7fc70159b700 1 --2- 172.21.15.60:0/2848966185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6fc155e90 0x7fc6fc0c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:32:01.157 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.154+0000 7fc700d9a700 1 --2- 172.21.15.60:0/2848966185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc0c8e50 0x7fc6fc0b0090 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec0099b0 tx=0x7fc6ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d25b7d29a1cd54 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:01.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.154+0000 7fc6f3fff700 1 -- 172.21.15.60:0/2848966185 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec00b820 con 0x7fc6fc0c8e50 2023-10-06T04:32:01.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.154+0000 7fc6f3fff700 1 -- 172.21.15.60:0/2848966185 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ec00b980 con 0x7fc6fc0c8e50 2023-10-06T04:32:01.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.154+0000 7fc6f3fff700 1 -- 172.21.15.60:0/2848966185 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec00bd20 con 0x7fc6fc0c8e50 2023-10-06T04:32:01.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.154+0000 7fc70259d700 1 -- 172.21.15.60:0/2848966185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc0c8e50 msgr2=0x7fc6fc0b0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:01.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.154+0000 7fc70259d700 1 --2- 172.21.15.60:0/2848966185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc0c8e50 0x7fc6fc0b0090 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec0099b0 tx=0x7fc6ec009250 comp rx=0 tx=0).stop 2023-10-06T04:32:01.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.154+0000 7fc70259d700 1 -- 172.21.15.60:0/2848966185 shutdown_connections 2023-10-06T04:32:01.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.155+0000 7fc70259d700 1 --2- 172.21.15.60:0/2848966185 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6fc155e90 0x7fc6fc0c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.155+0000 7fc70259d700 1 --2- 172.21.15.60:0/2848966185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc0c8e50 0x7fc6fc0b0090 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.158 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.155+0000 7fc70259d700 1 -- 172.21.15.60:0/2848966185 >> 172.21.15.60:0/2848966185 conn(0x7fc6fc0cbea0 msgr2=0x7fc6fc0cc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:01.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.155+0000 7fc70259d700 1 -- 172.21.15.60:0/2848966185 shutdown_connections 2023-10-06T04:32:01.159 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.155+0000 7fc70259d700 1 -- 172.21.15.60:0/2848966185 wait complete. 2023-10-06T04:32:01.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.156+0000 7fc70259d700 1 Processor -- start 2023-10-06T04:32:01.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.156+0000 7fc70259d700 1 -- start start 2023-10-06T04:32:01.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.157+0000 7fc70259d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6fc0c8e50 0x7fc6fc1453b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:01.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.157+0000 7fc70259d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6fc155e90 0x7fc6fc154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:01.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.157+0000 7fc70259d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc156260 0x7fc6fc0adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:01.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.157+0000 7fc70259d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc158330 con 0x7fc6fc156260 2023-10-06T04:32:01.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.157+0000 7fc70259d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc154cb0 con 0x7fc6fc155e90 2023-10-06T04:32:01.162 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.157+0000 7fc70259d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc157720 con 0x7fc6fc0c8e50 2023-10-06T04:32:01.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.157+0000 7fc701d9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc156260 0x7fc6fc0adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:01.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.157+0000 7fc701d9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc156260 0x7fc6fc0adbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42758/0 (socket says 172.21.15.60:42758) 2023-10-06T04:32:01.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.157+0000 7fc701d9c700 1 -- 172.21.15.60:0/1778161772 learned_addr learned my addr 172.21.15.60:0/1778161772 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:01.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.158+0000 7fc70159b700 1 --2- 172.21.15.60:0/1778161772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6fc0c8e50 0x7fc6fc1453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:01.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.158+0000 7fc700d9a700 1 --2- 172.21.15.60:0/1778161772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6fc155e90 0x7fc6fc154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:01.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.158+0000 7fc701d9c700 1 -- 172.21.15.60:0/1778161772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6fc0c8e50 msgr2=0x7fc6fc1453b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:01.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.158+0000 7fc701d9c700 1 --2- 172.21.15.60:0/1778161772 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc6fc0c8e50 0x7fc6fc1453b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.158+0000 7fc701d9c700 1 -- 172.21.15.60:0/1778161772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6fc155e90 msgr2=0x7fc6fc154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:01.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.158+0000 7fc701d9c700 1 --2- 172.21.15.60:0/1778161772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6fc155e90 0x7fc6fc154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.163 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.158+0000 7fc701d9c700 1 -- 172.21.15.60:0/1778161772 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ec0094f0 con 0x7fc6fc156260 2023-10-06T04:32:01.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.158+0000 7fc701d9c700 1 --2- 172.21.15.60:0/1778161772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc156260 0x7fc6fc0adbf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc6f400bb30 tx=0x7fc6f40097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:01.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.158+0000 7fc6f17fa700 1 -- 172.21.15.60:0/1778161772 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f400c7c0 con 0x7fc6fc156260 2023-10-06T04:32:01.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.158+0000 7fc6f17fa700 1 -- 172.21.15.60:0/1778161772 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f400c920 con 0x7fc6fc156260 2023-10-06T04:32:01.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.158+0000 7fc70259d700 1 -- 172.21.15.60:0/1778161772 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6fc157a00 con 0x7fc6fc156260 2023-10-06T04:32:01.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.158+0000 7fc6f17fa700 1 -- 172.21.15.60:0/1778161772 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f400cce0 con 0x7fc6fc156260 2023-10-06T04:32:01.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.159+0000 7fc70259d700 1 -- 172.21.15.60:0/1778161772 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6fc157fc0 con 0x7fc6fc156260 2023-10-06T04:32:01.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.159+0000 7fc70259d700 1 -- 172.21.15.60:0/1778161772 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc6fc05f230 con 0x7fc6fc156260 2023-10-06T04:32:01.164 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.160+0000 7fc6f17fa700 1 -- 172.21.15.60:0/1778161772 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6f4014620 con 0x7fc6fc156260 2023-10-06T04:32:01.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.161+0000 7fc6f17fa700 1 --2- 172.21.15.60:0/1778161772 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc6e0066f30 0x7fc6e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:01.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.161+0000 7fc6f17fa700 1 -- 172.21.15.60:0/1778161772 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fc6f4084470 con 0x7fc6fc156260 2023-10-06T04:32:01.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.161+0000 7fc70159b700 1 --2- 172.21.15.60:0/1778161772 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc6e0066f30 0x7fc6e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:01.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.161+0000 7fc6f17fa700 1 --2- 172.21.15.60:0/1778161772 >> [v2:172.21.15.135:6800/85791,v1:172.21.15.135:6802/85791] conn(0x7fc6e006d850 0x7fc6e006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:01.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.161+0000 7fc6f17fa700 1 -- 172.21.15.60:0/1778161772 --> [v2:172.21.15.135:6800/85791,v1:172.21.15.135:6802/85791] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6e0070370 con 0x7fc6e006d850 2023-10-06T04:32:01.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.161+0000 7fc6f17fa700 1 -- 172.21.15.60:0/1778161772 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6f40869d0 con 0x7fc6fc156260 2023-10-06T04:32:01.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.162+0000 7fc700d9a700 1 --2- 172.21.15.60:0/1778161772 >> [v2:172.21.15.135:6800/85791,v1:172.21.15.135:6802/85791] conn(0x7fc6e006d850 0x7fc6e006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:01.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.162+0000 7fc70159b700 1 --2- 172.21.15.60:0/1778161772 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc6e0066f30 0x7fc6e00693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800adc0 tx=0x7fc6f8006f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:01.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.162+0000 7fc700d9a700 1 --2- 172.21.15.60:0/1778161772 >> [v2:172.21.15.135:6800/85791,v1:172.21.15.135:6802/85791] conn(0x7fc6e006d850 0x7fc6e006fca0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:01.166 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.163+0000 7fc6f17fa700 1 -- 172.21.15.60:0/1778161772 <== osd.5 v2:172.21.15.135:6800/85791 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc6e0070370 con 0x7fc6e006d850 2023-10-06T04:32:01.179 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.178+0000 7fc70259d700 1 -- 172.21.15.60:0/1778161772 --> [v2:172.21.15.135:6800/85791,v1:172.21.15.135:6802/85791] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc6fc0ad4f0 con 0x7fc6e006d850 2023-10-06T04:32:01.180 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.178+0000 7fc6f17fa700 1 -- 172.21.15.60:0/1778161772 <== osd.5 v2:172.21.15.135:6800/85791 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc6fc0ad4f0 con 0x7fc6e006d850 2023-10-06T04:32:01.180 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-06T04:32:01.180 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:32:01.180 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-06T04:32:01.181 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.179+0000 7fc70259d700 1 -- 172.21.15.60:0/1778161772 >> [v2:172.21.15.135:6800/85791,v1:172.21.15.135:6802/85791] conn(0x7fc6e006d850 msgr2=0x7fc6e006fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:01.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.179+0000 7fc70259d700 1 --2- 172.21.15.60:0/1778161772 >> [v2:172.21.15.135:6800/85791,v1:172.21.15.135:6802/85791] conn(0x7fc6e006d850 0x7fc6e006fca0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.179+0000 7fc70259d700 1 -- 172.21.15.60:0/1778161772 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc6e0066f30 msgr2=0x7fc6e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:01.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.179+0000 7fc70259d700 1 --2- 172.21.15.60:0/1778161772 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fc6e0066f30 0x7fc6e00693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800adc0 tx=0x7fc6f8006f90 comp rx=0 tx=0).stop 2023-10-06T04:32:01.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.179+0000 7fc70259d700 1 -- 172.21.15.60:0/1778161772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc156260 msgr2=0x7fc6fc0adbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:01.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.179+0000 7fc70259d700 1 --2- 172.21.15.60:0/1778161772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6fc156260 0x7fc6fc0adbf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc6f400bb30 tx=0x7fc6f40097c0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.179+0000 7fc701d9c700 1 -- 172.21.15.60:0/1778161772 reap_dead start 2023-10-06T04:32:01.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.179+0000 7fc70259d700 1 -- 172.21.15.60:0/1778161772 shutdown_connections 2023-10-06T04:32:01.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.179+0000 7fc70259d700 1 -- 172.21.15.60:0/1778161772 >> 172.21.15.60:0/1778161772 conn(0x7fc6fc0cbea0 msgr2=0x7fc6fc0c8620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:01.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.179+0000 7fc70259d700 1 -- 172.21.15.60:0/1778161772 shutdown_connections 2023-10-06T04:32:01.182 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.179+0000 7fc70259d700 1 -- 172.21.15.60:0/1778161772 wait complete. 2023-10-06T04:32:01.197 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T04:32:01.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.385+0000 7ff34359d700 1 Processor -- start 2023-10-06T04:32:01.387 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.386+0000 7ff34359d700 1 -- start start 2023-10-06T04:32:01.388 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.387+0000 7ff34359d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff33c159320 0x7ff33c0cc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:01.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.387+0000 7ff34359d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33c0c16f0 con 0x7ff33c15cfb0 2023-10-06T04:32:01.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.387+0000 7ff34359d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33c0c2550 con 0x7ff33c15db60 2023-10-06T04:32:01.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.387+0000 7ff34359d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c0c1940 con 0x7ff33c159320 2023-10-06T04:32:01.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.387+0000 7ff341d9a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff33c15cfb0 0x7ff33c15d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34970/0 (socket says 172.21.15.60:34970) 2023-10-06T04:32:01.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.387+0000 7ff341d9a700 1 -- 172.21.15.60:0/3535932705 learned_addr learned my addr 172.21.15.60:0/3535932705 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:32:01.389 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.387+0000 7ff34259b700 1 --2- 172.21.15.60:0/3535932705 >> v2:172.21.15.135:3300/0 conn(0x7ff33c159320 0x7ff33c0cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:01.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.388+0000 7ff341599700 1 -- 172.21.15.60:0/3535932705 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69702802 0 0) 0x7ff33c0c16f0 con 0x7ff33c15cfb0 2023-10-06T04:32:01.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.388+0000 7ff341599700 1 -- 172.21.15.60:0/3535932705 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff328003570 con 0x7ff33c15cfb0 2023-10-06T04:32:01.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.388+0000 7ff34259b700 1 -- 172.21.15.60:0/3535932705 >> v1:172.21.15.135:6789/0 conn(0x7ff33c15db60 legacy=0x7ff33c0675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:01.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.388+0000 7ff34259b700 1 -- 172.21.15.60:0/3535932705 >> v1:172.21.15.60:6789/0 conn(0x7ff33c15cfb0 legacy=0x7ff33c15d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:01.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.388+0000 7ff34259b700 1 -- 172.21.15.60:0/3535932705 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c0c1c20 con 0x7ff33c159320 2023-10-06T04:32:01.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.388+0000 7ff34259b700 1 --2- 172.21.15.60:0/3535932705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff33c159320 0x7ff33c0cc090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff3380098e0 tx=0x7ff3380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=627fafbb4fd72a55 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:01.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.389+0000 7ff341599700 1 -- 172.21.15.60:0/3535932705 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33800b640 con 0x7ff33c159320 2023-10-06T04:32:01.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.389+0000 7ff341599700 1 -- 172.21.15.60:0/3535932705 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33800b7a0 con 0x7ff33c159320 2023-10-06T04:32:01.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.389+0000 7ff341599700 1 -- 172.21.15.60:0/3535932705 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33800bb40 con 0x7ff33c159320 2023-10-06T04:32:01.391 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.389+0000 7ff34359d700 1 -- 172.21.15.60:0/3535932705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff33c159320 msgr2=0x7ff33c0cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:01.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.389+0000 7ff34359d700 1 --2- 172.21.15.60:0/3535932705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff33c159320 0x7ff33c0cc090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff3380098e0 tx=0x7ff3380091a0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.392 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.389+0000 7ff34359d700 1 -- 172.21.15.60:0/3535932705 shutdown_connections 2023-10-06T04:32:01.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.389+0000 7ff34359d700 1 --2- 172.21.15.60:0/3535932705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff33c159320 0x7ff33c0cc090 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.389+0000 7ff34359d700 1 -- 172.21.15.60:0/3535932705 >> 172.21.15.60:0/3535932705 conn(0x7ff33c0c91a0 msgr2=0x7ff33c0c95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:01.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.389+0000 7ff34359d700 1 -- 172.21.15.60:0/3535932705 shutdown_connections 2023-10-06T04:32:01.393 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.389+0000 7ff34359d700 1 -- 172.21.15.60:0/3535932705 wait complete. 2023-10-06T04:32:01.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.391+0000 7ff34359d700 1 Processor -- start 2023-10-06T04:32:01.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.391+0000 7ff34359d700 1 -- start start 2023-10-06T04:32:01.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.392+0000 7ff34359d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c159320 0x7ff33c0ae740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:01.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.392+0000 7ff34359d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff33c15cfb0 0x7ff33c15b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:01.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.392+0000 7ff34359d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff33c15db60 0x7ff33c0b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:01.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.392+0000 7ff34359d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0b0fd0 con 0x7ff33c159320 2023-10-06T04:32:01.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.392+0000 7ff34359d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c14dbc0 con 0x7ff33c15cfb0 2023-10-06T04:32:01.396 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.392+0000 7ff34359d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0aec80 con 0x7ff33c15db60 2023-10-06T04:32:01.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.392+0000 7ff34259b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c159320 0x7ff33c0ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:01.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.392+0000 7ff34259b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c159320 0x7ff33c0ae740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42764/0 (socket says 172.21.15.60:42764) 2023-10-06T04:32:01.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.392+0000 7ff34259b700 1 -- 172.21.15.60:0/570000479 learned_addr learned my addr 172.21.15.60:0/570000479 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:01.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.392+0000 7ff341d9a700 1 --2- 172.21.15.60:0/570000479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff33c15cfb0 0x7ff33c15b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:01.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.392+0000 7ff342d9c700 1 --2- 172.21.15.60:0/570000479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff33c15db60 0x7ff33c0b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:01.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.392+0000 7ff34259b700 1 -- 172.21.15.60:0/570000479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff33c15db60 msgr2=0x7ff33c0b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:01.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.392+0000 7ff34259b700 1 --2- 172.21.15.60:0/570000479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff33c15db60 0x7ff33c0b16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.392+0000 7ff34259b700 1 -- 172.21.15.60:0/570000479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff33c15cfb0 msgr2=0x7ff33c15b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:01.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.392+0000 7ff34259b700 1 --2- 172.21.15.60:0/570000479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff33c15cfb0 0x7ff33c15b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.392+0000 7ff34259b700 1 -- 172.21.15.60:0/570000479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff338009420 con 0x7ff33c159320 2023-10-06T04:32:01.397 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.392+0000 7ff342d9c700 1 --2- 172.21.15.60:0/570000479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff33c15db60 0x7ff33c0b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:32:01.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.393+0000 7ff34259b700 1 --2- 172.21.15.60:0/570000479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c159320 0x7ff33c0ae740 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff33800bf80 tx=0x7ff338017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:01.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.393+0000 7ff3327fc700 1 -- 172.21.15.60:0/570000479 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33800bb20 con 0x7ff33c159320 2023-10-06T04:32:01.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.393+0000 7ff3327fc700 1 -- 172.21.15.60:0/570000479 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff338011420 con 0x7ff33c159320 2023-10-06T04:32:01.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.393+0000 7ff3327fc700 1 -- 172.21.15.60:0/570000479 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3380117c0 con 0x7ff33c159320 2023-10-06T04:32:01.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.393+0000 7ff34359d700 1 -- 172.21.15.60:0/570000479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33c0ac4b0 con 0x7ff33c159320 2023-10-06T04:32:01.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.393+0000 7ff34359d700 1 -- 172.21.15.60:0/570000479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33c0b0a10 con 0x7ff33c159320 2023-10-06T04:32:01.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.394+0000 7ff34359d700 1 -- 172.21.15.60:0/570000479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33c0ac670 con 0x7ff33c159320 2023-10-06T04:32:01.398 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.395+0000 7ff3327fc700 1 -- 172.21.15.60:0/570000479 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff338011b30 con 0x7ff33c159320 2023-10-06T04:32:01.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.396+0000 7ff3327fc700 1 --2- 172.21.15.60:0/570000479 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff320066f30 0x7ff3200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:01.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.396+0000 7ff3327fc700 1 -- 172.21.15.60:0/570000479 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7ff338085c60 con 0x7ff33c159320 2023-10-06T04:32:01.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.396+0000 7ff341d9a700 1 --2- 172.21.15.60:0/570000479 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff320066f30 0x7ff3200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:01.399 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.397+0000 7ff341d9a700 1 --2- 172.21.15.60:0/570000479 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff320066f30 0x7ff3200693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0c8bd0 tx=0x7ff32c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:01.401 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.400+0000 7ff3327fc700 1 -- 172.21.15.60:0/570000479 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff338052e90 con 0x7ff33c159320 2023-10-06T04:32:01.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.603+0000 7ff34359d700 1 -- 172.21.15.60:0/570000479 --> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7ff33c05f230 con 0x7ff320066f30 2023-10-06T04:32:01.605 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.604+0000 7ff3327fc700 1 -- 172.21.15.60:0/570000479 <== mgr.4098 v2:172.21.15.60:6832/85285 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff33c05f230 con 0x7ff320066f30 2023-10-06T04:32:01.607 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.606+0000 7ff34359d700 1 -- 172.21.15.60:0/570000479 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff320066f30 msgr2=0x7ff3200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:01.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.606+0000 7ff34359d700 1 --2- 172.21.15.60:0/570000479 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff320066f30 0x7ff3200693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0c8bd0 tx=0x7ff32c009040 comp rx=0 tx=0).stop 2023-10-06T04:32:01.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.606+0000 7ff34359d700 1 -- 172.21.15.60:0/570000479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c159320 msgr2=0x7ff33c0ae740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:01.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.606+0000 7ff34359d700 1 --2- 172.21.15.60:0/570000479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c159320 0x7ff33c0ae740 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff33800bf80 tx=0x7ff338017000 comp rx=0 tx=0).stop 2023-10-06T04:32:01.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.606+0000 7ff34359d700 1 -- 172.21.15.60:0/570000479 shutdown_connections 2023-10-06T04:32:01.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.606+0000 7ff34359d700 1 --2- 172.21.15.60:0/570000479 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7ff320066f30 0x7ff3200693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.606+0000 7ff34359d700 1 --2- 172.21.15.60:0/570000479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c159320 0x7ff33c0ae740 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.606+0000 7ff34359d700 1 --2- 172.21.15.60:0/570000479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff33c15db60 0x7ff33c0b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.606+0000 7ff34359d700 1 --2- 172.21.15.60:0/570000479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff33c15cfb0 0x7ff33c15b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.608 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.606+0000 7ff34359d700 1 -- 172.21.15.60:0/570000479 >> 172.21.15.60:0/570000479 conn(0x7ff33c0c91a0 msgr2=0x7ff33c157360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:01.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.606+0000 7ff34359d700 1 -- 172.21.15.60:0/570000479 shutdown_connections 2023-10-06T04:32:01.609 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.606+0000 7ff34359d700 1 -- 172.21.15.60:0/570000479 wait complete. 2023-10-06T04:32:01.609 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T04:32:01.625 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T04:32:01.625 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:32:01.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.815+0000 7fa86979d700 1 Processor -- start 2023-10-06T04:32:01.817 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.815+0000 7fa86979d700 1 -- start start 2023-10-06T04:32:01.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.817+0000 7fa86979d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa864159490 0x7fa8640aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:01.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.817+0000 7fa86979d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa864067bd0 0x7fa8640af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:01.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.817+0000 7fa86979d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8640af600 con 0x7fa864067800 2023-10-06T04:32:01.819 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.817+0000 7fa86979d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8640a9e10 con 0x7fa864159490 2023-10-06T04:32:01.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.817+0000 7fa86979d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8640abb70 con 0x7fa864067bd0 2023-10-06T04:32:01.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.817+0000 7fa863fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa864067800 0x7fa864158d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34974/0 (socket says 172.21.15.60:34974) 2023-10-06T04:32:01.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.817+0000 7fa863fff700 1 -- 172.21.15.60:0/294970737 learned_addr learned my addr 172.21.15.60:0/294970737 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:32:01.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.817+0000 7fa8637fe700 1 --2- 172.21.15.60:0/294970737 >> v2:172.21.15.135:3300/0 conn(0x7fa864159490 0x7fa8640aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:01.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.817+0000 7fa868f9c700 1 --2- 172.21.15.60:0/294970737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa864067bd0 0x7fa8640af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:01.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.817+0000 7fa862ffd700 1 -- 172.21.15.60:0/294970737 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185108728 0 0) 0x7fa8640af600 con 0x7fa864067800 2023-10-06T04:32:01.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.817+0000 7fa862ffd700 1 -- 172.21.15.60:0/294970737 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa84c003570 con 0x7fa864067800 2023-10-06T04:32:01.820 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.818+0000 7fa8637fe700 1 -- 172.21.15.60:0/294970737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa864067bd0 msgr2=0x7fa8640af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:32:01.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.818+0000 7fa8637fe700 1 --2- 172.21.15.60:0/294970737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa864067bd0 0x7fa8640af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.818+0000 7fa862ffd700 1 -- 172.21.15.60:0/294970737 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 229645589 0 0) 0x7fa84c003570 con 0x7fa864067800 2023-10-06T04:32:01.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.818+0000 7fa8637fe700 1 -- 172.21.15.60:0/294970737 >> v1:172.21.15.60:6789/0 conn(0x7fa864067800 legacy=0x7fa864158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:01.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.818+0000 7fa8637fe700 1 -- 172.21.15.60:0/294970737 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8640afd60 con 0x7fa864159490 2023-10-06T04:32:01.821 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.818+0000 7fa8637fe700 1 --2- 172.21.15.60:0/294970737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa864159490 0x7fa8640aeb80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa8580098e0 tx=0x7fa8580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8371f90ed166bc10 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:01.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.818+0000 7fa862ffd700 1 -- 172.21.15.60:0/294970737 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa854001470 con 0x7fa864159490 2023-10-06T04:32:01.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.818+0000 7fa862ffd700 1 -- 172.21.15.60:0/294970737 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa858011420 con 0x7fa864159490 2023-10-06T04:32:01.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.818+0000 7fa862ffd700 1 -- 172.21.15.60:0/294970737 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8580117c0 con 0x7fa864159490 2023-10-06T04:32:01.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.819+0000 7fa86979d700 1 -- 172.21.15.60:0/294970737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa864159490 msgr2=0x7fa8640aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:01.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.819+0000 7fa86979d700 1 --2- 172.21.15.60:0/294970737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa864159490 0x7fa8640aeb80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa8580098e0 tx=0x7fa8580091a0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.819+0000 7fa86979d700 1 -- 172.21.15.60:0/294970737 shutdown_connections 2023-10-06T04:32:01.825 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.819+0000 7fa86979d700 1 --2- 172.21.15.60:0/294970737 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa864067bd0 0x7fa8640af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.819+0000 7fa86979d700 1 --2- 172.21.15.60:0/294970737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa864159490 0x7fa8640aeb80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.819+0000 7fa86979d700 1 -- 172.21.15.60:0/294970737 >> 172.21.15.60:0/294970737 conn(0x7fa8640cda20 msgr2=0x7fa8640686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:01.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.819+0000 7fa86979d700 1 -- 172.21.15.60:0/294970737 shutdown_connections 2023-10-06T04:32:01.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.819+0000 7fa86979d700 1 -- 172.21.15.60:0/294970737 wait complete. 2023-10-06T04:32:01.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.820+0000 7fa86979d700 1 Processor -- start 2023-10-06T04:32:01.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.821+0000 7fa86979d700 1 -- start start 2023-10-06T04:32:01.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.822+0000 7fa86979d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa864067800 0x7fa86414b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:01.826 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.822+0000 7fa86979d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa864067bd0 0x7fa864152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:01.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.822+0000 7fa86979d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa864159490 0x7fa86406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:01.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.822+0000 7fa86979d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86414bcb0 con 0x7fa864159490 2023-10-06T04:32:01.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.822+0000 7fa86979d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86416a680 con 0x7fa864067bd0 2023-10-06T04:32:01.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.822+0000 7fa86979d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa864169830 con 0x7fa864067800 2023-10-06T04:32:01.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.822+0000 7fa868f9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa864159490 0x7fa86406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:01.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.822+0000 7fa868f9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa864159490 0x7fa86406e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42770/0 (socket says 172.21.15.60:42770) 2023-10-06T04:32:01.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.822+0000 7fa868f9c700 1 -- 172.21.15.60:0/2128080704 learned_addr learned my addr 172.21.15.60:0/2128080704 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:01.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.822+0000 7fa8637fe700 1 --2- 172.21.15.60:0/2128080704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa864067bd0 0x7fa864152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:01.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.822+0000 7fa863fff700 1 --2- 172.21.15.60:0/2128080704 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa864067800 0x7fa86414b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:01.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.822+0000 7fa868f9c700 1 -- 172.21.15.60:0/2128080704 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa864067800 msgr2=0x7fa86414b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:01.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.822+0000 7fa868f9c700 1 --2- 172.21.15.60:0/2128080704 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa864067800 0x7fa86414b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.822+0000 7fa868f9c700 1 -- 172.21.15.60:0/2128080704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa864067bd0 msgr2=0x7fa864152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:01.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.822+0000 7fa868f9c700 1 --2- 172.21.15.60:0/2128080704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa864067bd0 0x7fa864152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.822+0000 7fa868f9c700 1 -- 172.21.15.60:0/2128080704 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa858009420 con 0x7fa864159490 2023-10-06T04:32:01.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.822+0000 7fa863fff700 1 --2- 172.21.15.60:0/2128080704 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa864067800 0x7fa86414b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:32:01.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.823+0000 7fa868f9c700 1 --2- 172.21.15.60:0/2128080704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa864159490 0x7fa86406e3b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009e20 tx=0x7fa85c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:01.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.823+0000 7fa84bfff700 1 -- 172.21.15.60:0/2128080704 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c00caf0 con 0x7fa864159490 2023-10-06T04:32:01.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.823+0000 7fa84bfff700 1 -- 172.21.15.60:0/2128080704 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85c00f040 con 0x7fa864159490 2023-10-06T04:32:01.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.823+0000 7fa84bfff700 1 -- 172.21.15.60:0/2128080704 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c00cec0 con 0x7fa864159490 2023-10-06T04:32:01.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.823+0000 7fa86979d700 1 -- 172.21.15.60:0/2128080704 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa864169a70 con 0x7fa864159490 2023-10-06T04:32:01.828 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.823+0000 7fa86979d700 1 -- 172.21.15.60:0/2128080704 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa86416a030 con 0x7fa864159490 2023-10-06T04:32:01.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.824+0000 7fa86979d700 1 -- 172.21.15.60:0/2128080704 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa86405f230 con 0x7fa864159490 2023-10-06T04:32:01.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.825+0000 7fa84bfff700 1 -- 172.21.15.60:0/2128080704 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa85c014690 con 0x7fa864159490 2023-10-06T04:32:01.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.826+0000 7fa84bfff700 1 --2- 172.21.15.60:0/2128080704 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa850066f30 0x7fa8500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:01.830 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.826+0000 7fa84bfff700 1 -- 172.21.15.60:0/2128080704 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fa85c084e20 con 0x7fa864159490 2023-10-06T04:32:01.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.826+0000 7fa84bfff700 1 --2- 172.21.15.60:0/2128080704 >> [v2:172.21.15.135:6801/85790,v1:172.21.15.135:6803/85790] conn(0x7fa85006d850 0x7fa85006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:01.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.826+0000 7fa84bfff700 1 -- 172.21.15.60:0/2128080704 --> [v2:172.21.15.135:6801/85790,v1:172.21.15.135:6803/85790] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa850070370 con 0x7fa85006d850 2023-10-06T04:32:01.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.826+0000 7fa84bfff700 1 -- 172.21.15.60:0/2128080704 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa85c087380 con 0x7fa864159490 2023-10-06T04:32:01.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.826+0000 7fa863fff700 1 --2- 172.21.15.60:0/2128080704 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa850066f30 0x7fa8500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:01.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.827+0000 7fa8637fe700 1 --2- 172.21.15.60:0/2128080704 >> [v2:172.21.15.135:6801/85790,v1:172.21.15.135:6803/85790] conn(0x7fa85006d850 0x7fa85006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:01.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.827+0000 7fa863fff700 1 --2- 172.21.15.60:0/2128080704 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa850066f30 0x7fa8500693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa854001620 tx=0x7fa854001550 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:01.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.827+0000 7fa8637fe700 1 --2- 172.21.15.60:0/2128080704 >> [v2:172.21.15.135:6801/85790,v1:172.21.15.135:6803/85790] conn(0x7fa85006d850 0x7fa85006fca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:01.831 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.828+0000 7fa84bfff700 1 -- 172.21.15.60:0/2128080704 <== osd.6 v2:172.21.15.135:6801/85790 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa850070370 con 0x7fa85006d850 2023-10-06T04:32:01.844 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.843+0000 7fa86979d700 1 -- 172.21.15.60:0/2128080704 --> [v2:172.21.15.135:6801/85790,v1:172.21.15.135:6803/85790] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa864153ea0 con 0x7fa85006d850 2023-10-06T04:32:01.845 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.844+0000 7fa84bfff700 1 -- 172.21.15.60:0/2128080704 <== osd.6 v2:172.21.15.135:6801/85790 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa864153ea0 con 0x7fa85006d850 2023-10-06T04:32:01.845 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-06T04:32:01.845 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:32:01.845 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-06T04:32:01.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.844+0000 7fa86979d700 1 -- 172.21.15.60:0/2128080704 >> [v2:172.21.15.135:6801/85790,v1:172.21.15.135:6803/85790] conn(0x7fa85006d850 msgr2=0x7fa85006fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:01.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.844+0000 7fa86979d700 1 --2- 172.21.15.60:0/2128080704 >> [v2:172.21.15.135:6801/85790,v1:172.21.15.135:6803/85790] conn(0x7fa85006d850 0x7fa85006fca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:01.846 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.844+0000 7fa86979d700 1 -- 172.21.15.60:0/2128080704 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa850066f30 msgr2=0x7fa8500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:01.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.844+0000 7fa86979d700 1 --2- 172.21.15.60:0/2128080704 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fa850066f30 0x7fa8500693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa854001620 tx=0x7fa854001550 comp rx=0 tx=0).stop 2023-10-06T04:32:01.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.844+0000 7fa86979d700 1 -- 172.21.15.60:0/2128080704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa864159490 msgr2=0x7fa86406e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:01.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.844+0000 7fa86979d700 1 --2- 172.21.15.60:0/2128080704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa864159490 0x7fa86406e3b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009e20 tx=0x7fa85c00b040 comp rx=0 tx=0).stop 2023-10-06T04:32:01.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.844+0000 7fa868f9c700 1 -- 172.21.15.60:0/2128080704 reap_dead start 2023-10-06T04:32:01.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.844+0000 7fa86979d700 1 -- 172.21.15.60:0/2128080704 shutdown_connections 2023-10-06T04:32:01.847 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.844+0000 7fa86979d700 1 -- 172.21.15.60:0/2128080704 >> 172.21.15.60:0/2128080704 conn(0x7fa8640cda20 msgr2=0x7fa86414deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:01.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.844+0000 7fa86979d700 1 -- 172.21.15.60:0/2128080704 shutdown_connections 2023-10-06T04:32:01.848 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:01.844+0000 7fa86979d700 1 -- 172.21.15.60:0/2128080704 wait complete. 2023-10-06T04:32:01.862 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T04:32:02.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.050+0000 7fd2d0f9d700 1 Processor -- start 2023-10-06T04:32:02.052 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.050+0000 7fd2d0f9d700 1 -- start start 2023-10-06T04:32:02.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.052+0000 7fd2d0f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2cc0acc50 0x7fd2cc0698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:02.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.052+0000 7fd2d0f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd2cc0cece0 0x7fd2cc069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:02.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.052+0000 7fd2d0f9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2cc068760 con 0x7fd2cc159350 2023-10-06T04:32:02.053 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.052+0000 7fd2d0f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2cc159e30 con 0x7fd2cc0cece0 2023-10-06T04:32:02.054 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.052+0000 7fd2d0f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc068a40 con 0x7fd2cc0acc50 2023-10-06T04:32:02.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.052+0000 7fd2caffd700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2cc0acc50 0x7fd2cc0698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:02.055 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.052+0000 7fd2cb7fe700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fd2cc159350 0x7fd2cc159720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.60:41328/0 (socket says 172.21.15.60:41328) 2023-10-06T04:32:02.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.052+0000 7fd2cb7fe700 1 -- 172.21.15.60:0/2179409114 learned_addr learned my addr 172.21.15.60:0/2179409114 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:32:02.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.052+0000 7fd2cbfff700 1 --2- 172.21.15.60:0/2179409114 >> v2:172.21.15.135:3300/0 conn(0x7fd2cc0cece0 0x7fd2cc069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:02.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.053+0000 7fd2ca7fc700 1 -- 172.21.15.60:0/2179409114 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3933969609 0 0) 0x7fd2cc068760 con 0x7fd2cc159350 2023-10-06T04:32:02.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.053+0000 7fd2ca7fc700 1 -- 172.21.15.60:0/2179409114 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2b4003570 con 0x7fd2cc159350 2023-10-06T04:32:02.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.053+0000 7fd2caffd700 1 -- 172.21.15.60:0/2179409114 >> v2:172.21.15.135:3300/0 conn(0x7fd2cc0cece0 msgr2=0x7fd2cc069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:32:02.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.053+0000 7fd2caffd700 1 --2- 172.21.15.60:0/2179409114 >> v2:172.21.15.135:3300/0 conn(0x7fd2cc0cece0 0x7fd2cc069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.056 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.053+0000 7fd2caffd700 1 -- 172.21.15.60:0/2179409114 >> v1:172.21.15.135:6789/0 conn(0x7fd2cc159350 legacy=0x7fd2cc159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:02.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.053+0000 7fd2caffd700 1 -- 172.21.15.60:0/2179409114 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2cc068d20 con 0x7fd2cc0acc50 2023-10-06T04:32:02.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.053+0000 7fd2caffd700 1 --2- 172.21.15.60:0/2179409114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2cc0acc50 0x7fd2cc0698a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00098e0 tx=0x7fd2c00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d93956eda2125a1b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:02.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.054+0000 7fd2ca7fc700 1 -- 172.21.15.60:0/2179409114 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0011630 con 0x7fd2cc0acc50 2023-10-06T04:32:02.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.054+0000 7fd2ca7fc700 1 -- 172.21.15.60:0/2179409114 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c0011790 con 0x7fd2cc0acc50 2023-10-06T04:32:02.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.054+0000 7fd2ca7fc700 1 -- 172.21.15.60:0/2179409114 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0011b30 con 0x7fd2cc0acc50 2023-10-06T04:32:02.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.054+0000 7fd2d0f9d700 1 -- 172.21.15.60:0/2179409114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2cc0acc50 msgr2=0x7fd2cc0698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:02.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.054+0000 7fd2d0f9d700 1 --2- 172.21.15.60:0/2179409114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2cc0acc50 0x7fd2cc0698a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00098e0 tx=0x7fd2c00091a0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.054+0000 7fd2d0f9d700 1 -- 172.21.15.60:0/2179409114 shutdown_connections 2023-10-06T04:32:02.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.054+0000 7fd2d0f9d700 1 --2- 172.21.15.60:0/2179409114 >> v2:172.21.15.135:3300/0 conn(0x7fd2cc0cece0 0x7fd2cc069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.054+0000 7fd2d0f9d700 1 --2- 172.21.15.60:0/2179409114 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2cc0acc50 0x7fd2cc0698a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.057 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.054+0000 7fd2d0f9d700 1 -- 172.21.15.60:0/2179409114 >> 172.21.15.60:0/2179409114 conn(0x7fd2cc067d90 msgr2=0x7fd2cc0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:02.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.054+0000 7fd2d0f9d700 1 -- 172.21.15.60:0/2179409114 shutdown_connections 2023-10-06T04:32:02.058 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.054+0000 7fd2d0f9d700 1 -- 172.21.15.60:0/2179409114 wait complete. 2023-10-06T04:32:02.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.056+0000 7fd2d0f9d700 1 Processor -- start 2023-10-06T04:32:02.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.056+0000 7fd2d0f9d700 1 -- start start 2023-10-06T04:32:02.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.057+0000 7fd2d0f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2cc0acc50 0x7fd2cc151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:02.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.057+0000 7fd2d0f9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc0cece0 0x7fd2cc153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:02.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.057+0000 7fd2d0f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2cc159350 0x7fd2cc15bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:02.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.057+0000 7fd2d0f9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc169630 con 0x7fd2cc0cece0 2023-10-06T04:32:02.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.057+0000 7fd2d0f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc153d50 con 0x7fd2cc0acc50 2023-10-06T04:32:02.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.057+0000 7fd2d0f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc154030 con 0x7fd2cc159350 2023-10-06T04:32:02.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.057+0000 7fd2caffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc0cece0 0x7fd2cc153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:02.060 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.057+0000 7fd2caffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc0cece0 0x7fd2cc153450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42776/0 (socket says 172.21.15.60:42776) 2023-10-06T04:32:02.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.057+0000 7fd2caffd700 1 -- 172.21.15.60:0/1417510898 learned_addr learned my addr 172.21.15.60:0/1417510898 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:02.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.057+0000 7fd2cb7fe700 1 --2- 172.21.15.60:0/1417510898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2cc0acc50 0x7fd2cc151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:02.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.057+0000 7fd2cbfff700 1 --2- 172.21.15.60:0/1417510898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2cc159350 0x7fd2cc15bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:02.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.058+0000 7fd2caffd700 1 -- 172.21.15.60:0/1417510898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2cc159350 msgr2=0x7fd2cc15bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:02.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.058+0000 7fd2caffd700 1 --2- 172.21.15.60:0/1417510898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2cc159350 0x7fd2cc15bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.058+0000 7fd2caffd700 1 -- 172.21.15.60:0/1417510898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2cc0acc50 msgr2=0x7fd2cc151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:02.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.058+0000 7fd2caffd700 1 --2- 172.21.15.60:0/1417510898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2cc0acc50 0x7fd2cc151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.058+0000 7fd2caffd700 1 -- 172.21.15.60:0/1417510898 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c0009420 con 0x7fd2cc0cece0 2023-10-06T04:32:02.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.058+0000 7fd2cb7fe700 1 --2- 172.21.15.60:0/1417510898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2cc0acc50 0x7fd2cc151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:32:02.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.058+0000 7fd2caffd700 1 --2- 172.21.15.60:0/1417510898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc0cece0 0x7fd2cc153450 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0b41f0 tx=0x7fd2c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:02.061 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.058+0000 7fd2b37fe700 1 -- 172.21.15.60:0/1417510898 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0011b10 con 0x7fd2cc0cece0 2023-10-06T04:32:02.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.058+0000 7fd2b37fe700 1 -- 172.21.15.60:0/1417510898 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c00253f0 con 0x7fd2cc0cece0 2023-10-06T04:32:02.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.058+0000 7fd2b37fe700 1 -- 172.21.15.60:0/1417510898 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c00257b0 con 0x7fd2cc0cece0 2023-10-06T04:32:02.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.058+0000 7fd2d0f9d700 1 -- 172.21.15.60:0/1417510898 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2cc154310 con 0x7fd2cc0cece0 2023-10-06T04:32:02.062 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.058+0000 7fd2d0f9d700 1 -- 172.21.15.60:0/1417510898 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2cc169250 con 0x7fd2cc0cece0 2023-10-06T04:32:02.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.059+0000 7fd2d0f9d700 1 -- 172.21.15.60:0/1417510898 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2cc1697a0 con 0x7fd2cc0cece0 2023-10-06T04:32:02.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.060+0000 7fd2b37fe700 1 -- 172.21.15.60:0/1417510898 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd2c0025ba0 con 0x7fd2cc0cece0 2023-10-06T04:32:02.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.061+0000 7fd2b37fe700 1 --2- 172.21.15.60:0/1417510898 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd2b8066f30 0x7fd2b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:02.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.061+0000 7fd2b37fe700 1 -- 172.21.15.60:0/1417510898 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fd2c0085e50 con 0x7fd2cc0cece0 2023-10-06T04:32:02.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.061+0000 7fd2cb7fe700 1 --2- 172.21.15.60:0/1417510898 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd2b8066f30 0x7fd2b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:02.063 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.062+0000 7fd2cb7fe700 1 --2- 172.21.15.60:0/1417510898 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd2b8066f30 0x7fd2b80693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc0058d0 tx=0x7fd2bc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:02.067 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.065+0000 7fd2b37fe700 1 -- 172.21.15.60:0/1417510898 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2c0053080 con 0x7fd2cc0cece0 2023-10-06T04:32:02.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.265+0000 7fd2d0f9d700 1 -- 172.21.15.60:0/1417510898 --> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2cc153ec0 con 0x7fd2b8066f30 2023-10-06T04:32:02.268 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.266+0000 7fd2b37fe700 1 -- 172.21.15.60:0/1417510898 <== mgr.4098 v2:172.21.15.60:6832/85285 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd2cc153ec0 con 0x7fd2b8066f30 2023-10-06T04:32:02.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.268+0000 7fd2d0f9d700 1 -- 172.21.15.60:0/1417510898 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd2b8066f30 msgr2=0x7fd2b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:02.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.268+0000 7fd2d0f9d700 1 --2- 172.21.15.60:0/1417510898 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd2b8066f30 0x7fd2b80693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc0058d0 tx=0x7fd2bc009040 comp rx=0 tx=0).stop 2023-10-06T04:32:02.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.268+0000 7fd2d0f9d700 1 -- 172.21.15.60:0/1417510898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc0cece0 msgr2=0x7fd2cc153450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:02.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.268+0000 7fd2d0f9d700 1 --2- 172.21.15.60:0/1417510898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc0cece0 0x7fd2cc153450 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0b41f0 tx=0x7fd2c0017000 comp rx=0 tx=0).stop 2023-10-06T04:32:02.270 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.268+0000 7fd2d0f9d700 1 -- 172.21.15.60:0/1417510898 shutdown_connections 2023-10-06T04:32:02.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.268+0000 7fd2d0f9d700 1 --2- 172.21.15.60:0/1417510898 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fd2b8066f30 0x7fd2b80693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.268+0000 7fd2d0f9d700 1 --2- 172.21.15.60:0/1417510898 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2cc159350 0x7fd2cc15bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.268+0000 7fd2d0f9d700 1 --2- 172.21.15.60:0/1417510898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2cc0acc50 0x7fd2cc151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.268+0000 7fd2d0f9d700 1 --2- 172.21.15.60:0/1417510898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc0cece0 0x7fd2cc153450 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.268+0000 7fd2d0f9d700 1 -- 172.21.15.60:0/1417510898 >> 172.21.15.60:0/1417510898 conn(0x7fd2cc067d90 msgr2=0x7fd2cc06b470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:02.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.268+0000 7fd2d0f9d700 1 -- 172.21.15.60:0/1417510898 shutdown_connections 2023-10-06T04:32:02.271 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.268+0000 7fd2d0f9d700 1 -- 172.21.15.60:0/1417510898 wait complete. 2023-10-06T04:32:02.272 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T04:32:02.287 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T04:32:02.288 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T04:32:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.478+0000 7fb266b9d700 1 Processor -- start 2023-10-06T04:32:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.478+0000 7fb266b9d700 1 -- start start 2023-10-06T04:32:02.480 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.479+0000 7fb266b9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb2600cb680 0x7fb260156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:02.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.479+0000 7fb266b9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb2600cba50 0x7fb2600ade40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:02.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.479+0000 7fb266b9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb260156e10 con 0x7fb2600ae380 2023-10-06T04:32:02.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.479+0000 7fb266b9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb260156b30 con 0x7fb2600cba50 2023-10-06T04:32:02.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.479+0000 7fb266b9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2600ad360 con 0x7fb2600cb680 2023-10-06T04:32:02.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.479+0000 7fb26539a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb2600cba50 0x7fb2600ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:02.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.479+0000 7fb26539a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb2600cba50 0x7fb2600ade40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42788/0 (socket says 172.21.15.60:42788) 2023-10-06T04:32:02.481 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.479+0000 7fb26539a700 1 -- 172.21.15.60:0/3947629901 learned_addr learned my addr 172.21.15.60:0/3947629901 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:02.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.480+0000 7fb265b9b700 1 --2- 172.21.15.60:0/3947629901 >> v2:172.21.15.135:3300/0 conn(0x7fb2600cb680 0x7fb260156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:02.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.480+0000 7fb26539a700 1 -- 172.21.15.60:0/3947629901 >> v2:172.21.15.135:3300/0 conn(0x7fb2600cb680 msgr2=0x7fb260156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:32:02.483 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.480+0000 7fb26539a700 1 --2- 172.21.15.60:0/3947629901 >> v2:172.21.15.135:3300/0 conn(0x7fb2600cb680 0x7fb260156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.480+0000 7fb26539a700 1 -- 172.21.15.60:0/3947629901 >> v1:172.21.15.135:6789/0 conn(0x7fb2600ae380 legacy=0x7fb260155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:32:02.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.480+0000 7fb26539a700 1 -- 172.21.15.60:0/3947629901 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2600ad640 con 0x7fb2600cba50 2023-10-06T04:32:02.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.480+0000 7fb26539a700 1 --2- 172.21.15.60:0/3947629901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2600cba50 0x7fb2600ade40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb26006cbd0 tx=0x7fb250009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69dc8aa3f4b3b43d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:02.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.480+0000 7fb264b99700 1 -- 172.21.15.60:0/3947629901 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25000b860 con 0x7fb2600cba50 2023-10-06T04:32:02.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.481+0000 7fb264b99700 1 -- 172.21.15.60:0/3947629901 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25000b9c0 con 0x7fb2600cba50 2023-10-06T04:32:02.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.481+0000 7fb264b99700 1 -- 172.21.15.60:0/3947629901 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25000bd60 con 0x7fb2600cba50 2023-10-06T04:32:02.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.481+0000 7fb266b9d700 1 -- 172.21.15.60:0/3947629901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2600cba50 msgr2=0x7fb2600ade40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:02.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.481+0000 7fb266b9d700 1 --2- 172.21.15.60:0/3947629901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2600cba50 0x7fb2600ade40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb26006cbd0 tx=0x7fb250009250 comp rx=0 tx=0).stop 2023-10-06T04:32:02.484 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.481+0000 7fb266b9d700 1 -- 172.21.15.60:0/3947629901 shutdown_connections 2023-10-06T04:32:02.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.481+0000 7fb266b9d700 1 --2- 172.21.15.60:0/3947629901 >> v2:172.21.15.135:3300/0 conn(0x7fb2600cb680 0x7fb260156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.481+0000 7fb266b9d700 1 --2- 172.21.15.60:0/3947629901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2600cba50 0x7fb2600ade40 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.481+0000 7fb266b9d700 1 -- 172.21.15.60:0/3947629901 >> 172.21.15.60:0/3947629901 conn(0x7fb2600cbea0 msgr2=0x7fb2600cc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:02.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.481+0000 7fb266b9d700 1 -- 172.21.15.60:0/3947629901 shutdown_connections 2023-10-06T04:32:02.485 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.481+0000 7fb266b9d700 1 -- 172.21.15.60:0/3947629901 wait complete. 2023-10-06T04:32:02.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.483+0000 7fb266b9d700 1 Processor -- start 2023-10-06T04:32:02.487 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.483+0000 7fb266b9d700 1 -- start start 2023-10-06T04:32:02.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.484+0000 7fb266b9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2600ae380 0x7fb2601437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:02.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.484+0000 7fb266b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2600cb680 0x7fb26016d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:02.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.484+0000 7fb266b9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2600cba50 0x7fb2601367e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:02.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.484+0000 7fb266b9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26014efd0 con 0x7fb2600cba50 2023-10-06T04:32:02.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.484+0000 7fb266b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26014f2b0 con 0x7fb2600cb680 2023-10-06T04:32:02.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.484+0000 7fb266b9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26016ce30 con 0x7fb2600ae380 2023-10-06T04:32:02.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.484+0000 7fb26639c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2600cba50 0x7fb2601367e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:02.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.484+0000 7fb26639c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2600cba50 0x7fb2601367e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42796/0 (socket says 172.21.15.60:42796) 2023-10-06T04:32:02.488 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.484+0000 7fb26639c700 1 -- 172.21.15.60:0/492698974 learned_addr learned my addr 172.21.15.60:0/492698974 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:02.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.484+0000 7fb26539a700 1 --2- 172.21.15.60:0/492698974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2600cb680 0x7fb26016d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:02.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.484+0000 7fb26639c700 1 -- 172.21.15.60:0/492698974 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2600ae380 msgr2=0x7fb2601437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:02.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.484+0000 7fb265b9b700 1 --2- 172.21.15.60:0/492698974 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2600ae380 0x7fb2601437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:02.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.484+0000 7fb26639c700 1 --2- 172.21.15.60:0/492698974 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2600ae380 0x7fb2601437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.484+0000 7fb26639c700 1 -- 172.21.15.60:0/492698974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2600cb680 msgr2=0x7fb26016d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:02.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.484+0000 7fb26639c700 1 --2- 172.21.15.60:0/492698974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2600cb680 0x7fb26016d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.484+0000 7fb26639c700 1 -- 172.21.15.60:0/492698974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2500094f0 con 0x7fb2600cba50 2023-10-06T04:32:02.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.484+0000 7fb26539a700 1 --2- 172.21.15.60:0/492698974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2600cb680 0x7fb26016d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:32:02.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.484+0000 7fb265b9b700 1 --2- 172.21.15.60:0/492698974 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2600ae380 0x7fb2601437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:32:02.489 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.485+0000 7fb26639c700 1 --2- 172.21.15.60:0/492698974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2600cba50 0x7fb2601367e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb25800c840 tx=0x7fb258001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:02.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.485+0000 7fb255ffb700 1 -- 172.21.15.60:0/492698974 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258012630 con 0x7fb2600cba50 2023-10-06T04:32:02.490 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.485+0000 7fb255ffb700 1 -- 172.21.15.60:0/492698974 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2580127b0 con 0x7fb2600cba50 2023-10-06T04:32:02.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.485+0000 7fb266b9d700 1 -- 172.21.15.60:0/492698974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26016d110 con 0x7fb2600cba50 2023-10-06T04:32:02.492 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.485+0000 7fb255ffb700 1 -- 172.21.15.60:0/492698974 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258012b70 con 0x7fb2600cba50 2023-10-06T04:32:02.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.485+0000 7fb266b9d700 1 -- 172.21.15.60:0/492698974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb260136d20 con 0x7fb2600cba50 2023-10-06T04:32:02.493 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.486+0000 7fb266b9d700 1 -- 172.21.15.60:0/492698974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb26005f230 con 0x7fb2600cba50 2023-10-06T04:32:02.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.487+0000 7fb255ffb700 1 -- 172.21.15.60:0/492698974 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb258003030 con 0x7fb2600cba50 2023-10-06T04:32:02.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.488+0000 7fb255ffb700 1 --2- 172.21.15.60:0/492698974 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb244066f30 0x7fb2440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:02.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.488+0000 7fb255ffb700 1 -- 172.21.15.60:0/492698974 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fb2580843f0 con 0x7fb2600cba50 2023-10-06T04:32:02.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.488+0000 7fb265b9b700 1 --2- 172.21.15.60:0/492698974 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb244066f30 0x7fb2440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:02.494 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.488+0000 7fb255ffb700 1 --2- 172.21.15.60:0/492698974 >> [v2:172.21.15.135:6824/85822,v1:172.21.15.135:6825/85822] conn(0x7fb24406d850 0x7fb24406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:02.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.488+0000 7fb255ffb700 1 -- 172.21.15.60:0/492698974 --> [v2:172.21.15.135:6824/85822,v1:172.21.15.135:6825/85822] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb244070370 con 0x7fb24406d850 2023-10-06T04:32:02.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.488+0000 7fb255ffb700 1 -- 172.21.15.60:0/492698974 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb258086950 con 0x7fb2600cba50 2023-10-06T04:32:02.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.489+0000 7fb265b9b700 1 --2- 172.21.15.60:0/492698974 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb244066f30 0x7fb2440693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb25c006fd0 tx=0x7fb25c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:02.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.488+0000 7fb26539a700 1 --2- 172.21.15.60:0/492698974 >> [v2:172.21.15.135:6824/85822,v1:172.21.15.135:6825/85822] conn(0x7fb24406d850 0x7fb24406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:02.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.489+0000 7fb26539a700 1 --2- 172.21.15.60:0/492698974 >> [v2:172.21.15.135:6824/85822,v1:172.21.15.135:6825/85822] conn(0x7fb24406d850 0x7fb24406fca0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:02.495 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.490+0000 7fb255ffb700 1 -- 172.21.15.60:0/492698974 <== osd.7 v2:172.21.15.135:6824/85822 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb244070370 con 0x7fb24406d850 2023-10-06T04:32:02.506 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.505+0000 7fb266b9d700 1 -- 172.21.15.60:0/492698974 --> [v2:172.21.15.135:6824/85822,v1:172.21.15.135:6825/85822] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb260156e10 con 0x7fb24406d850 2023-10-06T04:32:02.507 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.506+0000 7fb255ffb700 1 -- 172.21.15.60:0/492698974 <== osd.7 v2:172.21.15.135:6824/85822 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb260156e10 con 0x7fb24406d850 2023-10-06T04:32:02.507 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2023-10-06T04:32:02.507 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T04:32:02.507 INFO:teuthology.orchestra.run.smithi060.stdout:} 2023-10-06T04:32:02.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.506+0000 7fb266b9d700 1 -- 172.21.15.60:0/492698974 >> [v2:172.21.15.135:6824/85822,v1:172.21.15.135:6825/85822] conn(0x7fb24406d850 msgr2=0x7fb24406fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:02.508 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.506+0000 7fb266b9d700 1 --2- 172.21.15.60:0/492698974 >> [v2:172.21.15.135:6824/85822,v1:172.21.15.135:6825/85822] conn(0x7fb24406d850 0x7fb24406fca0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.506+0000 7fb266b9d700 1 -- 172.21.15.60:0/492698974 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb244066f30 msgr2=0x7fb2440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:02.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.506+0000 7fb266b9d700 1 --2- 172.21.15.60:0/492698974 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb244066f30 0x7fb2440693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb25c006fd0 tx=0x7fb25c008040 comp rx=0 tx=0).stop 2023-10-06T04:32:02.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.506+0000 7fb266b9d700 1 -- 172.21.15.60:0/492698974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2600cba50 msgr2=0x7fb2601367e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:02.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.506+0000 7fb266b9d700 1 --2- 172.21.15.60:0/492698974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2600cba50 0x7fb2601367e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb25800c840 tx=0x7fb258001670 comp rx=0 tx=0).stop 2023-10-06T04:32:02.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.506+0000 7fb26639c700 1 -- 172.21.15.60:0/492698974 reap_dead start 2023-10-06T04:32:02.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.506+0000 7fb266b9d700 1 -- 172.21.15.60:0/492698974 shutdown_connections 2023-10-06T04:32:02.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.506+0000 7fb266b9d700 1 -- 172.21.15.60:0/492698974 >> 172.21.15.60:0/492698974 conn(0x7fb2600cbea0 msgr2=0x7fb260154f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:02.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.506+0000 7fb266b9d700 1 -- 172.21.15.60:0/492698974 shutdown_connections 2023-10-06T04:32:02.509 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.507+0000 7fb266b9d700 1 -- 172.21.15.60:0/492698974 wait complete. 2023-10-06T04:32:02.526 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T04:32:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.711+0000 7fe053fff700 1 Processor -- start 2023-10-06T04:32:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.711+0000 7fe053fff700 1 -- start start 2023-10-06T04:32:02.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.713+0000 7fe053fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe054159320 0x7fe0540cc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:02.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.713+0000 7fe053fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe05415db60 0x7fe0540675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:02.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.713+0000 7fe053fff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0540c16f0 con 0x7fe05415cfb0 2023-10-06T04:32:02.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.713+0000 7fe053fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0540c2550 con 0x7fe054159320 2023-10-06T04:32:02.715 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.713+0000 7fe053fff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0540c1940 con 0x7fe05415db60 2023-10-06T04:32:02.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.713+0000 7fe052ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe054159320 0x7fe0540cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:02.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.713+0000 7fe052ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe054159320 0x7fe0540cc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42812/0 (socket says 172.21.15.60:42812) 2023-10-06T04:32:02.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.713+0000 7fe052ffd700 1 -- 172.21.15.60:0/3838652271 learned_addr learned my addr 172.21.15.60:0/3838652271 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:02.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.713+0000 7fe0537fe700 1 --2- 172.21.15.60:0/3838652271 >> v2:172.21.15.135:3300/0 conn(0x7fe05415db60 0x7fe0540675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:02.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.713+0000 7fe052ffd700 1 -- 172.21.15.60:0/3838652271 >> v2:172.21.15.135:3300/0 conn(0x7fe05415db60 msgr2=0x7fe0540675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:32:02.716 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.713+0000 7fe052ffd700 1 --2- 172.21.15.60:0/3838652271 >> v2:172.21.15.135:3300/0 conn(0x7fe05415db60 0x7fe0540675b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.713+0000 7fe052ffd700 1 -- 172.21.15.60:0/3838652271 >> v1:172.21.15.135:6789/0 conn(0x7fe05415cfb0 legacy=0x7fe05415d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:02.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.713+0000 7fe052ffd700 1 -- 172.21.15.60:0/3838652271 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0540c1c20 con 0x7fe054159320 2023-10-06T04:32:02.717 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.714+0000 7fe052ffd700 1 --2- 172.21.15.60:0/3838652271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe054159320 0x7fe0540cc090 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe0540af240 tx=0x7fe044009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72002ad30a30c38 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:02.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.714+0000 7fe051ffb700 1 -- 172.21.15.60:0/3838652271 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400b860 con 0x7fe054159320 2023-10-06T04:32:02.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.714+0000 7fe051ffb700 1 -- 172.21.15.60:0/3838652271 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04400b9c0 con 0x7fe054159320 2023-10-06T04:32:02.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.714+0000 7fe051ffb700 1 -- 172.21.15.60:0/3838652271 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400bd60 con 0x7fe054159320 2023-10-06T04:32:02.720 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.715+0000 7fe053fff700 1 -- 172.21.15.60:0/3838652271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe054159320 msgr2=0x7fe0540cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:02.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.715+0000 7fe053fff700 1 --2- 172.21.15.60:0/3838652271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe054159320 0x7fe0540cc090 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe0540af240 tx=0x7fe044009250 comp rx=0 tx=0).stop 2023-10-06T04:32:02.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.715+0000 7fe053fff700 1 -- 172.21.15.60:0/3838652271 shutdown_connections 2023-10-06T04:32:02.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.715+0000 7fe053fff700 1 --2- 172.21.15.60:0/3838652271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe054159320 0x7fe0540cc090 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.715+0000 7fe053fff700 1 --2- 172.21.15.60:0/3838652271 >> v2:172.21.15.135:3300/0 conn(0x7fe05415db60 0x7fe0540675b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.721 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.715+0000 7fe053fff700 1 -- 172.21.15.60:0/3838652271 >> 172.21.15.60:0/3838652271 conn(0x7fe0540c91a0 msgr2=0x7fe0540c95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:02.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.715+0000 7fe053fff700 1 -- 172.21.15.60:0/3838652271 shutdown_connections 2023-10-06T04:32:02.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.715+0000 7fe053fff700 1 -- 172.21.15.60:0/3838652271 wait complete. 2023-10-06T04:32:02.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.716+0000 7fe053fff700 1 Processor -- start 2023-10-06T04:32:02.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.716+0000 7fe053fff700 1 -- start start 2023-10-06T04:32:02.722 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.717+0000 7fe053fff700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe054159320 0x7fe05415c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:02.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.717+0000 7fe053fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe05415cfb0 0x7fe054146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:02.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.717+0000 7fe053fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe05415db60 0x7fe0541472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:02.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.717+0000 7fe053fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe054155a10 con 0x7fe05415cfb0 2023-10-06T04:32:02.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.717+0000 7fe053fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540af4d0 con 0x7fe05415db60 2023-10-06T04:32:02.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.717+0000 7fe053fff700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05415a3a0 con 0x7fe054159320 2023-10-06T04:32:02.723 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.717+0000 7fe0527fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe05415cfb0 0x7fe054146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:02.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.718+0000 7fe0527fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe05415cfb0 0x7fe054146d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42824/0 (socket says 172.21.15.60:42824) 2023-10-06T04:32:02.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.718+0000 7fe0527fc700 1 -- 172.21.15.60:0/1480842820 learned_addr learned my addr 172.21.15.60:0/1480842820 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:02.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.718+0000 7fe052ffd700 1 --2- 172.21.15.60:0/1480842820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe054159320 0x7fe05415c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:02.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.718+0000 7fe0527fc700 1 -- 172.21.15.60:0/1480842820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe054159320 msgr2=0x7fe05415c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:02.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.718+0000 7fe0537fe700 1 --2- 172.21.15.60:0/1480842820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe05415db60 0x7fe0541472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:02.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.718+0000 7fe0527fc700 1 --2- 172.21.15.60:0/1480842820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe054159320 0x7fe05415c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.724 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.718+0000 7fe0527fc700 1 -- 172.21.15.60:0/1480842820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe05415db60 msgr2=0x7fe0541472c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:02.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.718+0000 7fe0527fc700 1 --2- 172.21.15.60:0/1480842820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe05415db60 0x7fe0541472c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.718+0000 7fe0527fc700 1 -- 172.21.15.60:0/1480842820 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0440094f0 con 0x7fe05415cfb0 2023-10-06T04:32:02.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.718+0000 7fe052ffd700 1 --2- 172.21.15.60:0/1480842820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe054159320 0x7fe05415c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:32:02.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.718+0000 7fe0537fe700 1 --2- 172.21.15.60:0/1480842820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe05415db60 0x7fe0541472c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T04:32:02.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.718+0000 7fe0527fc700 1 --2- 172.21.15.60:0/1480842820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe05415cfb0 0x7fe054146d80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe04800c590 tx=0x7fe04800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:02.725 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.718+0000 7fe03affd700 1 -- 172.21.15.60:0/1480842820 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048011590 con 0x7fe05415cfb0 2023-10-06T04:32:02.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.718+0000 7fe03affd700 1 -- 172.21.15.60:0/1480842820 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0480116f0 con 0x7fe05415cfb0 2023-10-06T04:32:02.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.718+0000 7fe053fff700 1 -- 172.21.15.60:0/1480842820 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05415a680 con 0x7fe05415cfb0 2023-10-06T04:32:02.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.718+0000 7fe03affd700 1 -- 172.21.15.60:0/1480842820 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048011ab0 con 0x7fe05415cfb0 2023-10-06T04:32:02.726 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.719+0000 7fe053fff700 1 -- 172.21.15.60:0/1480842820 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0540afa00 con 0x7fe05415cfb0 2023-10-06T04:32:02.727 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.720+0000 7fe053fff700 1 -- 172.21.15.60:0/1480842820 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05405f230 con 0x7fe05415cfb0 2023-10-06T04:32:02.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.720+0000 7fe03affd700 1 -- 172.21.15.60:0/1480842820 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe04801b3b0 con 0x7fe05415cfb0 2023-10-06T04:32:02.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.721+0000 7fe03affd700 1 --2- 172.21.15.60:0/1480842820 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe040066f30 0x7fe0400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:02.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.721+0000 7fe03affd700 1 -- 172.21.15.60:0/1480842820 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fe048083b20 con 0x7fe05415cfb0 2023-10-06T04:32:02.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.722+0000 7fe052ffd700 1 --2- 172.21.15.60:0/1480842820 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe040066f30 0x7fe0400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:02.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.722+0000 7fe052ffd700 1 --2- 172.21.15.60:0/1480842820 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe040066f30 0x7fe0400693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe0540af240 tx=0x7fe044017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:02.728 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.725+0000 7fe03affd700 1 -- 172.21.15.60:0/1480842820 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe048050d50 con 0x7fe05415cfb0 2023-10-06T04:32:02.928 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.927+0000 7fe053fff700 1 -- 172.21.15.60:0/1480842820 --> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0540c14d0 con 0x7fe040066f30 2023-10-06T04:32:02.929 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.928+0000 7fe03affd700 1 -- 172.21.15.60:0/1480842820 <== mgr.4098 v2:172.21.15.60:6832/85285 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe0540c14d0 con 0x7fe040066f30 2023-10-06T04:32:02.931 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.930+0000 7fe053fff700 1 -- 172.21.15.60:0/1480842820 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe040066f30 msgr2=0x7fe0400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.930+0000 7fe053fff700 1 --2- 172.21.15.60:0/1480842820 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe040066f30 0x7fe0400693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe0540af240 tx=0x7fe044017000 comp rx=0 tx=0).stop 2023-10-06T04:32:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.930+0000 7fe053fff700 1 -- 172.21.15.60:0/1480842820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe05415cfb0 msgr2=0x7fe054146d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.930+0000 7fe053fff700 1 --2- 172.21.15.60:0/1480842820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe05415cfb0 0x7fe054146d80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe04800c590 tx=0x7fe04800c950 comp rx=0 tx=0).stop 2023-10-06T04:32:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.930+0000 7fe053fff700 1 -- 172.21.15.60:0/1480842820 shutdown_connections 2023-10-06T04:32:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.930+0000 7fe053fff700 1 --2- 172.21.15.60:0/1480842820 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fe040066f30 0x7fe0400693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.930+0000 7fe053fff700 1 --2- 172.21.15.60:0/1480842820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe05415db60 0x7fe0541472c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.930+0000 7fe053fff700 1 --2- 172.21.15.60:0/1480842820 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe054159320 0x7fe05415c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.930+0000 7fe053fff700 1 --2- 172.21.15.60:0/1480842820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe05415cfb0 0x7fe054146d80 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.930+0000 7fe053fff700 1 -- 172.21.15.60:0/1480842820 >> 172.21.15.60:0/1480842820 conn(0x7fe0540c91a0 msgr2=0x7fe0541562a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.930+0000 7fe053fff700 1 -- 172.21.15.60:0/1480842820 shutdown_connections 2023-10-06T04:32:02.932 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:02.930+0000 7fe053fff700 1 -- 172.21.15.60:0/1480842820 wait complete. 2023-10-06T04:32:02.933 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T04:32:02.949 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:32:03.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.134+0000 7f8b20f9d700 1 Processor -- start 2023-10-06T04:32:03.136 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.134+0000 7f8b20f9d700 1 -- start start 2023-10-06T04:32:03.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.136+0000 7f8b20f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b1c159350 0x7f8b1c159720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:03.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.136+0000 7f8b20f9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8b1c0cece0 0x7f8b1c0698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:03.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.136+0000 7f8b20f9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8b1c069de0 0x7f8b1c0abc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:03.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.136+0000 7f8b20f9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b1c06a1e0 con 0x7f8b1c0cece0 2023-10-06T04:32:03.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.136+0000 7f8b20f9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b1c068760 con 0x7f8b1c069de0 2023-10-06T04:32:03.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.136+0000 7f8b20f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c068a40 con 0x7f8b1c159350 2023-10-06T04:32:03.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.136+0000 7f8b1affd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8b1c0cece0 0x7f8b1c0698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:03.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.136+0000 7f8b1affd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8b1c0cece0 0x7f8b1c0698a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52220/0 (socket says 172.21.15.60:52220) 2023-10-06T04:32:03.139 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.136+0000 7f8b1affd700 1 -- 172.21.15.60:0/3137835927 learned_addr learned my addr 172.21.15.60:0/3137835927 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:03.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.136+0000 7f8b1bfff700 1 --2- 172.21.15.60:0/3137835927 >> v2:172.21.15.135:3300/0 conn(0x7f8b1c069de0 0x7f8b1c0abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:03.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.136+0000 7f8b1b7fe700 1 --2- 172.21.15.60:0/3137835927 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b1c159350 0x7f8b1c159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:03.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.136+0000 7f8b1affd700 1 -- 172.21.15.60:0/3137835927 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b1c159350 msgr2=0x7f8b1c159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:32:03.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.136+0000 7f8b1affd700 1 --2- 172.21.15.60:0/3137835927 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b1c159350 0x7f8b1c159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:03.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.136+0000 7f8b1affd700 1 -- 172.21.15.60:0/3137835927 >> v2:172.21.15.135:3300/0 conn(0x7f8b1c069de0 msgr2=0x7f8b1c0abc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:32:03.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.136+0000 7f8b1affd700 1 --2- 172.21.15.60:0/3137835927 >> v2:172.21.15.135:3300/0 conn(0x7f8b1c069de0 0x7f8b1c0abc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:03.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.136+0000 7f8b1affd700 1 -- 172.21.15.60:0/3137835927 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c068d20 con 0x7f8b1c0cece0 2023-10-06T04:32:03.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.137+0000 7f8b1affd700 1 --2- 172.21.15.60:0/3137835927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c0cece0 0x7f8b1c0698a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c088360 tx=0x7f8b10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7749930721b8703 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:03.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.137+0000 7f8b1a7fc700 1 -- 172.21.15.60:0/3137835927 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1000b860 con 0x7f8b1c0cece0 2023-10-06T04:32:03.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.137+0000 7f8b1a7fc700 1 -- 172.21.15.60:0/3137835927 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1000b9c0 con 0x7f8b1c0cece0 2023-10-06T04:32:03.140 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.137+0000 7f8b1a7fc700 1 -- 172.21.15.60:0/3137835927 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1000bd60 con 0x7f8b1c0cece0 2023-10-06T04:32:03.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.137+0000 7f8b20f9d700 1 -- 172.21.15.60:0/3137835927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c0cece0 msgr2=0x7f8b1c0698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:03.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.137+0000 7f8b20f9d700 1 --2- 172.21.15.60:0/3137835927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c0cece0 0x7f8b1c0698a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c088360 tx=0x7f8b10009250 comp rx=0 tx=0).stop 2023-10-06T04:32:03.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.137+0000 7f8b20f9d700 1 -- 172.21.15.60:0/3137835927 shutdown_connections 2023-10-06T04:32:03.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.137+0000 7f8b20f9d700 1 --2- 172.21.15.60:0/3137835927 >> v2:172.21.15.135:3300/0 conn(0x7f8b1c069de0 0x7f8b1c0abc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:03.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.137+0000 7f8b20f9d700 1 --2- 172.21.15.60:0/3137835927 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b1c159350 0x7f8b1c159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:03.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.137+0000 7f8b20f9d700 1 --2- 172.21.15.60:0/3137835927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c0cece0 0x7f8b1c0698a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:03.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.137+0000 7f8b20f9d700 1 -- 172.21.15.60:0/3137835927 >> 172.21.15.60:0/3137835927 conn(0x7f8b1c067d90 msgr2=0x7f8b1c0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:03.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.137+0000 7f8b20f9d700 1 -- 172.21.15.60:0/3137835927 shutdown_connections 2023-10-06T04:32:03.141 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.138+0000 7f8b20f9d700 1 -- 172.21.15.60:0/3137835927 wait complete. 2023-10-06T04:32:03.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.139+0000 7f8b20f9d700 1 Processor -- start 2023-10-06T04:32:03.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.139+0000 7f8b20f9d700 1 -- start start 2023-10-06T04:32:03.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.140+0000 7f8b20f9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c069de0 0x7f8b1c158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:03.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.140+0000 7f8b20f9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b1c0cece0 0x7f8b1c155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:03.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.140+0000 7f8b20f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b1c159350 0x7f8b1c0b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:03.144 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.140+0000 7f8b20f9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c155570 con 0x7f8b1c069de0 2023-10-06T04:32:03.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.140+0000 7f8b20f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c155810 con 0x7f8b1c159350 2023-10-06T04:32:03.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.140+0000 7f8b20f9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c155af0 con 0x7f8b1c0cece0 2023-10-06T04:32:03.147 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.140+0000 7f8b1b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c069de0 0x7f8b1c158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:03.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.140+0000 7f8b1b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c069de0 0x7f8b1c158570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52234/0 (socket says 172.21.15.60:52234) 2023-10-06T04:32:03.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.140+0000 7f8b1b7fe700 1 -- 172.21.15.60:0/3330902673 learned_addr learned my addr 172.21.15.60:0/3330902673 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:03.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.140+0000 7f8b1bfff700 1 --2- 172.21.15.60:0/3330902673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b1c159350 0x7f8b1c0b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:03.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.140+0000 7f8b1affd700 1 --2- 172.21.15.60:0/3330902673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b1c0cece0 0x7f8b1c155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:03.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.141+0000 7f8b1b7fe700 1 -- 172.21.15.60:0/3330902673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b1c0cece0 msgr2=0x7f8b1c155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:03.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.141+0000 7f8b1b7fe700 1 --2- 172.21.15.60:0/3330902673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b1c0cece0 0x7f8b1c155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:03.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.141+0000 7f8b1b7fe700 1 -- 172.21.15.60:0/3330902673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b1c159350 msgr2=0x7f8b1c0b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:03.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.141+0000 7f8b1b7fe700 1 --2- 172.21.15.60:0/3330902673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b1c159350 0x7f8b1c0b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:03.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.141+0000 7f8b1b7fe700 1 -- 172.21.15.60:0/3330902673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b100094f0 con 0x7f8b1c069de0 2023-10-06T04:32:03.148 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.141+0000 7f8b1bfff700 1 --2- 172.21.15.60:0/3330902673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b1c159350 0x7f8b1c0b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T04:32:03.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.141+0000 7f8b1b7fe700 1 --2- 172.21.15.60:0/3330902673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c069de0 0x7f8b1c158570 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00d860 tx=0x7f8b0c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:03.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.141+0000 7f8b037fe700 1 -- 172.21.15.60:0/3330902673 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c0125f0 con 0x7f8b1c069de0 2023-10-06T04:32:03.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.141+0000 7f8b037fe700 1 -- 172.21.15.60:0/3330902673 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0c012750 con 0x7f8b1c069de0 2023-10-06T04:32:03.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.141+0000 7f8b037fe700 1 -- 172.21.15.60:0/3330902673 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c012b10 con 0x7f8b1c069de0 2023-10-06T04:32:03.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.141+0000 7f8b20f9d700 1 -- 172.21.15.60:0/3330902673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1c155dd0 con 0x7f8b1c069de0 2023-10-06T04:32:03.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.141+0000 7f8b20f9d700 1 -- 172.21.15.60:0/3330902673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1c156390 con 0x7f8b1c069de0 2023-10-06T04:32:03.149 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.142+0000 7f8b20f9d700 1 -- 172.21.15.60:0/3330902673 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b1c05f230 con 0x7f8b1c069de0 2023-10-06T04:32:03.150 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.143+0000 7f8b037fe700 1 -- 172.21.15.60:0/3330902673 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b0c01e460 con 0x7f8b1c069de0 2023-10-06T04:32:03.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.144+0000 7f8b037fe700 1 --2- 172.21.15.60:0/3330902673 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8b08066f30 0x7f8b080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:03.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.145+0000 7f8b037fe700 1 -- 172.21.15.60:0/3330902673 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f8b0c084c30 con 0x7f8b1c069de0 2023-10-06T04:32:03.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.145+0000 7f8b1affd700 1 --2- 172.21.15.60:0/3330902673 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8b08066f30 0x7f8b080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:03.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.145+0000 7f8b1affd700 1 --2- 172.21.15.60:0/3330902673 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8b08066f30 0x7f8b080693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c088360 tx=0x7f8b10017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:03.151 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.149+0000 7f8b037fe700 1 -- 172.21.15.60:0/3330902673 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b0c051e60 con 0x7f8b1c069de0 2023-10-06T04:32:03.346 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.345+0000 7f8b20f9d700 1 -- 172.21.15.60:0/3330902673 --> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b1c069000 con 0x7f8b08066f30 2023-10-06T04:32:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.348+0000 7f8b037fe700 1 -- 172.21.15.60:0/3330902673 <== mgr.4098 v2:172.21.15.60:6832/85285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73184 (secure 0 0 0) 0x7f8b1c069000 con 0x7f8b08066f30 2023-10-06T04:32:03.351 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:32:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.351+0000 7f8b20f9d700 1 -- 172.21.15.60:0/3330902673 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8b08066f30 msgr2=0x7f8b080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.351+0000 7f8b20f9d700 1 --2- 172.21.15.60:0/3330902673 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8b08066f30 0x7f8b080693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c088360 tx=0x7f8b10017000 comp rx=0 tx=0).stop 2023-10-06T04:32:03.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.351+0000 7f8b20f9d700 1 -- 172.21.15.60:0/3330902673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c069de0 msgr2=0x7f8b1c158570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:03.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.351+0000 7f8b20f9d700 1 --2- 172.21.15.60:0/3330902673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c069de0 0x7f8b1c158570 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00d860 tx=0x7f8b0c008040 comp rx=0 tx=0).stop 2023-10-06T04:32:03.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.351+0000 7f8b20f9d700 1 -- 172.21.15.60:0/3330902673 shutdown_connections 2023-10-06T04:32:03.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.351+0000 7f8b20f9d700 1 --2- 172.21.15.60:0/3330902673 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f8b08066f30 0x7f8b080693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:03.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.351+0000 7f8b20f9d700 1 --2- 172.21.15.60:0/3330902673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c069de0 0x7f8b1c158570 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:03.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.351+0000 7f8b20f9d700 1 --2- 172.21.15.60:0/3330902673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b1c159350 0x7f8b1c0b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:03.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.351+0000 7f8b20f9d700 1 --2- 172.21.15.60:0/3330902673 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b1c0cece0 0x7f8b1c155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:03.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.351+0000 7f8b20f9d700 1 -- 172.21.15.60:0/3330902673 >> 172.21.15.60:0/3330902673 conn(0x7f8b1c067d90 msgr2=0x7f8b1c0aac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:03.353 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.351+0000 7f8b20f9d700 1 -- 172.21.15.60:0/3330902673 shutdown_connections 2023-10-06T04:32:03.354 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:03.351+0000 7f8b20f9d700 1 -- 172.21.15.60:0/3330902673 wait complete. 2023-10-06T04:32:03.354 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-06T04:32:03.370 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2023-10-06T04:32:01.357570+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404084,"kb_used_data":5300,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752570636,"statfs":{"total":773094113280,"available":770632331264,"internally_reserved":0,"allocated":5427200,"data_stored":3104510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.962142"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:31:51.398156+0000","last_change":"2023-10-06T04:28:00.325832+0000","last_active":"2023-10-06T04:31:51.398156+0000","last_peered":"2023-10-06T04:31:51.398156+0000","last_clean":"2023-10-06T04:31:51.398156+0000","last_became_active":"2023-10-06T04:28:00.325466+0000","last_became_peered":"2023-10-06T04:28:00.325466+0000","last_unstale":"2023-10-06T04:31:51.398156+0000","last_undegraded":"2023-10-06T04:31:51.398156+0000","last_fullsized":"2023-10-06T04:31:51.398156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":36,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:31:52.074772+0000","last_change":"2023-10-06T04:28:00.175241+0000","last_active":"2023-10-06T04:31:52.074772+0000","last_peered":"2023-10-06T04:31:52.074772+0000","last_clean":"2023-10-06T04:31:52.074772+0000","last_became_active":"2023-10-06T04:28:00.174814+0000","last_became_peered":"2023-10-06T04:28:00.174814+0000","last_unstale":"2023-10-06T04:31:52.074772+0000","last_undegraded":"2023-10-06T04:31:52.074772+0000","last_fullsized":"2023-10-06T04:31:52.074772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:31:52.378080+0000","last_change":"2023-10-06T04:28:00.175086+0000","last_active":"2023-10-06T04:31:52.378080+0000","last_peered":"2023-10-06T04:31:52.378080+0000","last_clean":"2023-10-06T04:31:52.378080+0000","last_became_active":"2023-10-06T04:28:00.174735+0000","last_became_peered":"2023-10-06T04:28:00.174735+0000","last_unstale":"2023-10-06T04:31:52.378080+0000","last_undegraded":"2023-10-06T04:31:52.378080+0000","last_fullsized":"2023-10-06T04:31:52.378080+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":185,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:31:52.394959+0000","last_change":"2023-10-06T04:28:01.176177+0000","last_active":"2023-10-06T04:31:52.394959+0000","last_peered":"2023-10-06T04:31:52.394959+0000","last_clean":"2023-10-06T04:31:52.394959+0000","last_became_active":"2023-10-06T04:28:01.175255+0000","last_became_peered":"2023-10-06T04:28:01.175255+0000","last_unstale":"2023-10-06T04:31:52.394959+0000","last_undegraded":"2023-10-06T04:31:52.394959+0000","last_fullsized":"2023-10-06T04:31:52.394959+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:28:00.161020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:28:00.161020+0000","last_clean_scrub_stamp":"2023-10-06T04:28:00.161020+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:29.208067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":36,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:31:52.397103+0000","last_change":"2023-10-06T04:28:00.344573+0000","last_active":"2023-10-06T04:31:52.397103+0000","last_peered":"2023-10-06T04:31:52.397103+0000","last_clean":"2023-10-06T04:31:52.397103+0000","last_became_active":"2023-10-06T04:28:00.344324+0000","last_became_peered":"2023-10-06T04:28:00.344324+0000","last_unstale":"2023-10-06T04:31:52.397103+0000","last_undegraded":"2023-10-06T04:31:52.397103+0000","last_fullsized":"2023-10-06T04:31:52.397103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:24.184826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":36,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:31:52.394845+0000","last_change":"2023-10-06T04:28:00.343571+0000","last_active":"2023-10-06T04:31:52.394845+0000","last_peered":"2023-10-06T04:31:52.394845+0000","last_clean":"2023-10-06T04:31:52.394845+0000","last_became_active":"2023-10-06T04:28:00.343268+0000","last_became_peered":"2023-10-06T04:28:00.343268+0000","last_unstale":"2023-10-06T04:31:52.394845+0000","last_undegraded":"2023-10-06T04:31:52.394845+0000","last_fullsized":"2023-10-06T04:31:52.394845+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:00.931419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":35,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:31:52.397724+0000","last_change":"2023-10-06T04:28:00.344460+0000","last_active":"2023-10-06T04:31:52.397724+0000","last_peered":"2023-10-06T04:31:52.397724+0000","last_clean":"2023-10-06T04:31:52.397724+0000","last_became_active":"2023-10-06T04:28:00.343280+0000","last_became_peered":"2023-10-06T04:28:00.343280+0000","last_unstale":"2023-10-06T04:31:52.397724+0000","last_undegraded":"2023-10-06T04:31:52.397724+0000","last_fullsized":"2023-10-06T04:31:52.397724+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:20.924184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:31:51.399053+0000","last_change":"2023-10-06T04:28:00.343592+0000","last_active":"2023-10-06T04:31:51.399053+0000","last_peered":"2023-10-06T04:31:51.399053+0000","last_clean":"2023-10-06T04:31:51.399053+0000","last_became_active":"2023-10-06T04:28:00.343313+0000","last_became_peered":"2023-10-06T04:28:00.343313+0000","last_unstale":"2023-10-06T04:31:51.399053+0000","last_undegraded":"2023-10-06T04:31:51.399053+0000","last_fullsized":"2023-10-06T04:31:51.399053+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:24.184826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-06T04:31:51.399553+0000","last_change":"2023-10-06T04:28:00.174563+0000","last_active":"2023-10-06T04:31:51.399553+0000","last_peered":"2023-10-06T04:31:51.399553+0000","last_clean":"2023-10-06T04:31:51.399553+0000","last_became_active":"2023-10-06T04:28:00.174265+0000","last_became_peered":"2023-10-06T04:28:00.174265+0000","last_unstale":"2023-10-06T04:31:51.399553+0000","last_undegraded":"2023-10-06T04:31:51.399553+0000","last_fullsized":"2023-10-06T04:31:51.399553+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:27:59.158270+0000","last_clean_scrub_stamp":"2023-10-06T04:27:59.158270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:00.931419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302480,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069360,"statfs":{"total":96636764160,"available":96327024640,"internally_reserved":0,"allocated":1122304,"data_stored":830473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.73299999999999998,"15min":0.78900000000000003},"min":{"1min":0.42699999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79200000000000004,"5min":4.3070000000000004,"15min":4.3070000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.83199999999999996,"15min":0.93999999999999995},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.67500000000000004,"5min":8.1609999999999996,"15min":8.1609999999999996},"last":0.745}]},{"osd":1,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.77700000000000002,"15min":0.83899999999999997},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.755,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.81299999999999994,"15min":0.89200000000000002},"min":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91300000000000003,"5min":6.3079999999999998,"15min":6.3079999999999998},"last":0.59699999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.76100000000000001,"15min":0.79400000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96999999999999997,"5min":4.4619999999999997,"15min":4.4619999999999997},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.92800000000000005,"15min":1.054},"min":{"1min":0.55900000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.73999999999999999,"5min":8.2840000000000007,"15min":8.2840000000000007},"last":0.71599999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.76300000000000001,"15min":0.81499999999999995},"min":{"1min":0.48399999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80200000000000005,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.73799999999999999,"15min":0.76600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.81899999999999995,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.69899999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.876,"15min":0.97399999999999998},"min":{"1min":0.48499999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84799999999999998,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.82799999999999996,"15min":0.86299999999999999},"min":{"1min":0.64800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89000000000000001,"5min":3.3980000000000001,"15min":3.3980000000000001},"last":0.56100000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.86299999999999999,"15min":0.94099999999999995},"min":{"1min":0.499,"5min":0.439,"15min":0.439},"max":{"1min":1.0049999999999999,"5min":6.8200000000000003,"15min":6.8200000000000003},"last":0.441},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.95699999999999996,"15min":1.0629999999999999},"min":{"1min":0.53800000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.88200000000000001,"5min":8.3439999999999994,"15min":8.3439999999999994},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.90800000000000003,"15min":0.98799999999999999},"min":{"1min":0.60399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80300000000000005,"5min":6.2839999999999998,"15min":6.2839999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.83499999999999996,"15min":0.88500000000000001},"min":{"1min":0.53300000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.94199999999999995,"5min":4.1420000000000003,"15min":4.1420000000000003},"last":0.47499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297808,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074032,"statfs":{"total":96636764160,"available":96331808768,"internally_reserved":0,"allocated":532480,"data_stored":241083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.44,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82899999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.78900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.77800000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.51400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.79900000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.53000000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.85599999999999998,"5min":1,"15min":1},"last":0.82499999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81799999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63600000000000001,"15min":0.63200000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.70699999999999996,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.85199999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67500000000000004,"15min":0.68000000000000005},"min":{"1min":0.504,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82899999999999996,"5min":1.018,"15min":1.018},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.53400000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.79000000000000004}]},{"osd":4,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59799999999999998,"15min":0.58599999999999997},"min":{"1min":0.439,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.747,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89600000000000002,"5min":1.052,"15min":1.052},"last":0.67200000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.42799999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.874,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.72299999999999998},"min":{"1min":0.58399999999999996,"5min":0.439,"15min":0.439},"max":{"1min":0.85999999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.80800000000000005}]},{"osd":7,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":4.2709999999999999,"15min":5.8330000000000002},"min":{"1min":0.59599999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.93999999999999995,"5min":165.47,"15min":165.47},"last":0.871},{"interface":"front","average":{"1min":0.76500000000000001,"5min":4.266,"15min":5.8230000000000004},"min":{"1min":0.52400000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92500000000000004,"5min":165.51300000000001,"15min":165.51300000000001},"last":0.76200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302484,"kb_used_data":1100,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069356,"statfs":{"total":96636764160,"available":96327020544,"internally_reserved":0,"allocated":1126400,"data_stored":831451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.436,"15min":0.44400000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56399999999999995,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.48099999999999998,"15min":0.46800000000000003},"min":{"1min":0.30499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.52900000000000003,"5min":3.282,"15min":3.282},"last":0.38900000000000001}]},{"osd":2,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.54200000000000004,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.54000000000000004,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.503,"15min":0.48899999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65900000000000003,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":0.54500000000000004}]},{"osd":3,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.55900000000000005,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.54700000000000004,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.5},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.54900000000000004,"15min":0.54000000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60599999999999998,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.45600000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.55900000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.85999999999999999,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.79800000000000004,"15min":0.79700000000000004},"min":{"1min":0.52800000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95499999999999996,"5min":3.847,"15min":3.847},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.81499999999999995,"15min":0.81299999999999994},"min":{"1min":0.57099999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91800000000000004,"5min":3.9809999999999999,"15min":3.9809999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.81100000000000005,"15min":0.81000000000000005},"min":{"1min":0.60499999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.878,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.91600000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.81000000000000005,"15min":0.81799999999999995},"min":{"1min":0.59699999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.90400000000000003,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.85699999999999998,"15min":0.86899999999999999},"min":{"1min":0.59499999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.98499999999999999,"5min":4.0270000000000001,"15min":4.0270000000000001},"last":0.89000000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.82299999999999995,"15min":0.81799999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93200000000000005,"5min":3.4769999999999999,"15min":3.4769999999999999},"last":0.875},{"interface":"front","average":{"1min":0.75,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.94499999999999995,"5min":3.5720000000000001,"15min":3.5720000000000001},"last":0.81100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":528384,"data_stored":240105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.45300000000000001,"15min":0.46500000000000002},"min":{"1min":0.29899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58799999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.496},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45700000000000002,"15min":0.46300000000000002},"min":{"1min":0.32600000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.36699999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.54900000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.54800000000000004,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.53200000000000003}]},{"osd":3,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.45900000000000002,"15min":0.45800000000000002},"min":{"1min":0.38,"5min":0.309,"15min":0.309},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.44},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54000000000000004,"15min":0.55400000000000005},"min":{"1min":0.436,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.59599999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.46700000000000003}]},{"osd":4,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.75},"min":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.94699999999999995,"5min":1.077,"15min":1.077},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75600000000000001,"15min":0.77000000000000002},"min":{"1min":0.58499999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.99399999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.61299999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97499999999999998,"5min":1.147,"15min":1.147},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.58499999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90700000000000003,"5min":1.167,"15min":1.167},"last":0.60599999999999998}]},{"osd":6,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77900000000000003,"15min":0.78400000000000003},"min":{"1min":0.64900000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.93700000000000006,"5min":1.137,"15min":1.137},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.59099999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.95799999999999996,"5min":1.071,"15min":1.071},"last":0.62}]},{"osd":7,"last update":"Fri Oct 6 04:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.77200000000000002,"15min":0.78400000000000003},"min":{"1min":0.61199999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91800000000000004,"5min":1.048,"15min":1.048},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.60699999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93899999999999995,"5min":1.103,"15min":1.103},"last":0.754}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":528384,"data_stored":240105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42099999999999999,"15min":0.42699999999999999},"min":{"1min":0.30499999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.56999999999999995,"5min":0.877,"15min":0.877},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.46700000000000003,"15min":0.48299999999999998},"min":{"1min":0.34200000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.51600000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45400000000000001,"15min":0.47199999999999998},"min":{"1min":0.32100000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.56100000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.51500000000000001,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.54400000000000004,"5min":1.524,"15min":1.524},"last":0.63300000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.54900000000000004,"15min":0.56699999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.622,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.54400000000000004,"15min":0.56499999999999995},"min":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.61399999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.504}]},{"osd":4,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75,"15min":0.745},"min":{"1min":0.60199999999999998,"5min":0.504,"15min":0.504},"max":{"1min":0.92100000000000004,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78100000000000003,"15min":0.78900000000000003},"min":{"1min":0.52800000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93200000000000005,"5min":1.393,"15min":1.393},"last":0.89900000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.55500000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0369999999999999,"5min":1.381,"15min":1.381},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77500000000000002,"15min":0.78000000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96999999999999997,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.65400000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.79900000000000004,"15min":0.80500000000000005},"min":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98099999999999998,"5min":1.351,"15min":1.351},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.80500000000000005,"15min":0.82099999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.996,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:31:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.98599999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.82199999999999995,"15min":0.83399999999999996},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.97299999999999998,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.72499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":528384,"data_stored":240105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44400000000000001,"15min":0.45200000000000001},"min":{"1min":0.29199999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70299999999999996,"5min":0.873,"15min":0.873},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.47299999999999998,"15min":0.48499999999999999},"min":{"1min":0.32400000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.374}]},{"osd":1,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46600000000000003,"15min":0.46800000000000003},"min":{"1min":0.34999999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.58099999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.502},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.55300000000000005,"15min":0.56499999999999995},"min":{"1min":0.41299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.69499999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.625,"5min":1.248,"15min":1.248},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57099999999999995,"15min":0.59099999999999997},"min":{"1min":0.42799999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77600000000000002,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78400000000000003,"15min":0.82399999999999995},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.28,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.79200000000000004,"15min":0.83199999999999996},"min":{"1min":0.57199999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.83999999999999997,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.94599999999999995}]},{"osd":5,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.81799999999999995,"15min":0.86099999999999999},"min":{"1min":0.61799999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.89700000000000002,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.81299999999999994,"15min":0.85099999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3280000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.88200000000000001}]},{"osd":6,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.83299999999999996,"15min":0.88100000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.94799999999999995,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.82799999999999996,"15min":0.86699999999999999},"min":{"1min":0.60099999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92400000000000004,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.89500000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:31:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.83499999999999996,"15min":0.86899999999999999},"min":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3680000000000001,"5min":1.603,"15min":1.603},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.83199999999999996,"15min":0.876},"min":{"1min":0.624,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.997,"5min":1.534,"15min":1.534},"last":0.91100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297808,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074032,"statfs":{"total":96636764160,"available":96331808768,"internally_reserved":0,"allocated":532480,"data_stored":241083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.44500000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.78300000000000003,"5min":1.177,"15min":1.177},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68799999999999994,"15min":0.70099999999999996},"min":{"1min":0.47599999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88700000000000001,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.77600000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73699999999999999,"15min":0.74299999999999999},"min":{"1min":0.625,"5min":0.434,"15min":0.434},"max":{"1min":0.81999999999999995,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.72199999999999998,"15min":0.746},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.72599999999999998,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.83199999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68999999999999995,"15min":0.70399999999999996},"min":{"1min":0.49099999999999999,"5min":0.441,"15min":0.441},"max":{"1min":0.80500000000000005,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.753,"15min":0.76700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.874,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.98699999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.93899999999999995,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.71799999999999997,"15min":0.74199999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.745,"5min":1.948,"15min":1.948},"last":0.75800000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.746,"15min":0.75600000000000001},"min":{"1min":0.56200000000000006,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0049999999999999,"5min":1.893,"15min":1.893},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.70899999999999996,"15min":0.73099999999999998},"min":{"1min":0.51900000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.80100000000000005,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.80000000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.71099999999999997,"15min":0.73299999999999998},"min":{"1min":0.46400000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85299999999999998,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.505,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97799999999999998,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":0.91600000000000004}]},{"osd":7,"last update":"Fri Oct 6 04:31:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.60099999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91800000000000004,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.59199999999999997,"5min":0.497,"15min":0.497},"max":{"1min":0.92800000000000005,"5min":1.99,"15min":1.99},"last":0.95699999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":528384,"data_stored":240105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.622,"15min":0.60099999999999998},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.754},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.62,"15min":0.622},"min":{"1min":0.46300000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.751,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52400000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.83799999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.76800000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67600000000000005,"15min":0.67400000000000004},"min":{"1min":0.51400000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98099999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91400000000000003,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.68000000000000005}]},{"osd":3,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64000000000000001,"15min":0.64200000000000002},"min":{"1min":0.47399999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.78700000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.621},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.73199999999999998},"min":{"1min":0.61499999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89000000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65400000000000003,"15min":0.63300000000000001},"min":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83899999999999997,"5min":1.004,"15min":1.004},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.41299999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.84899999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.71699999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70399999999999996,"15min":0.68799999999999994},"min":{"1min":0.501,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85099999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.72099999999999997,"15min":0.70499999999999996},"min":{"1min":0.501,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92800000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.85299999999999998}]},{"osd":7,"last update":"Fri Oct 6 04:31:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70399999999999996,"15min":0.70199999999999996},"min":{"1min":0.56200000000000006,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86099999999999999,"5min":1.083,"15min":1.083},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76100000000000001,"15min":0.745},"min":{"1min":0.54000000000000004,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92400000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.86899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:32:03.378 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-10-06T04:27:59.158270+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=27, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=31, tm_sec=56, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:32:03.378 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-10-06T04:27:59.158270+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=27, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=31, tm_sec=56, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:32:03.378 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-10-06T04:27:59.158270+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=27, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=31, tm_sec=56, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:32:03.378 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T04:28:00.161020+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=28, tm_sec=0, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=31, tm_sec=56, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:32:03.379 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-10-06T04:27:59.158270+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=27, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=31, tm_sec=56, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:32:03.379 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T04:27:59.158270+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=27, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=31, tm_sec=56, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:32:03.379 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-10-06T04:27:59.158270+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=27, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=31, tm_sec=56, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:32:03.379 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-10-06T04:27:59.158270+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=27, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=31, tm_sec=56, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:32:03.379 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-10-06T04:27:59.158270+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=27, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=4, tm_min=31, tm_sec=56, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T04:32:03.379 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T04:32:09.775 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:32:09.781 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:32:23.380 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T04:32:23.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.573+0000 7f014dd9d700 1 Processor -- start 2023-10-06T04:32:23.575 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.573+0000 7f014dd9d700 1 -- start start 2023-10-06T04:32:23.577 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.574+0000 7f014dd9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f014813f9f0 0x7f01480c0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:23.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.574+0000 7f014dd9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f014815a5f0 0x7f01480c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:23.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.574+0000 7f014dd9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01480c1240 con 0x7f01480ca490 2023-10-06T04:32:23.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.574+0000 7f014dd9d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01480cb4d0 con 0x7f014815a5f0 2023-10-06T04:32:23.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.574+0000 7f014dd9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014806f480 con 0x7f014813f9f0 2023-10-06T04:32:23.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.574+0000 7f014d59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f014815a5f0 0x7f01480c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:23.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.574+0000 7f014d59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f014815a5f0 0x7f01480c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39770/0 (socket says 172.21.15.60:39770) 2023-10-06T04:32:23.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.574+0000 7f014d59c700 1 -- 172.21.15.60:0/3005843824 learned_addr learned my addr 172.21.15.60:0/3005843824 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:23.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.574+0000 7f014cd9b700 1 --2- 172.21.15.60:0/3005843824 >> v2:172.21.15.135:3300/0 conn(0x7f014813f9f0 0x7f01480c0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:23.578 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.575+0000 7f014d59c700 1 -- 172.21.15.60:0/3005843824 >> v2:172.21.15.135:3300/0 conn(0x7f014813f9f0 msgr2=0x7f01480c0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:32:23.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.575+0000 7f014d59c700 1 --2- 172.21.15.60:0/3005843824 >> v2:172.21.15.135:3300/0 conn(0x7f014813f9f0 0x7f01480c0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:23.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.575+0000 7f014d59c700 1 -- 172.21.15.60:0/3005843824 >> v1:172.21.15.135:6789/0 conn(0x7f01480ca490 legacy=0x7f0148159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:23.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.575+0000 7f014d59c700 1 -- 172.21.15.60:0/3005843824 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01480ca950 con 0x7f014815a5f0 2023-10-06T04:32:23.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.575+0000 7f014d59c700 1 --2- 172.21.15.60:0/3005843824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f014815a5f0 0x7f01480c68d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f014806b4f0 tx=0x7f0140009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89638dcea85a01a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:23.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.575+0000 7f01477fe700 1 -- 172.21.15.60:0/3005843824 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014000e070 con 0x7f014815a5f0 2023-10-06T04:32:23.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.575+0000 7f01477fe700 1 -- 172.21.15.60:0/3005843824 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014000ba20 con 0x7f014815a5f0 2023-10-06T04:32:23.579 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.575+0000 7f01477fe700 1 -- 172.21.15.60:0/3005843824 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01400092e0 con 0x7f014815a5f0 2023-10-06T04:32:23.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.576+0000 7f014dd9d700 1 -- 172.21.15.60:0/3005843824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f014815a5f0 msgr2=0x7f01480c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:23.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.576+0000 7f014dd9d700 1 --2- 172.21.15.60:0/3005843824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f014815a5f0 0x7f01480c68d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f014806b4f0 tx=0x7f0140009840 comp rx=0 tx=0).stop 2023-10-06T04:32:23.582 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.576+0000 7f014dd9d700 1 -- 172.21.15.60:0/3005843824 shutdown_connections 2023-10-06T04:32:23.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.576+0000 7f014dd9d700 1 --2- 172.21.15.60:0/3005843824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f014815a5f0 0x7f01480c68d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:23.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.576+0000 7f014dd9d700 1 --2- 172.21.15.60:0/3005843824 >> v2:172.21.15.135:3300/0 conn(0x7f014813f9f0 0x7f01480c0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:23.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.576+0000 7f014dd9d700 1 -- 172.21.15.60:0/3005843824 >> 172.21.15.60:0/3005843824 conn(0x7f01480cbeb0 msgr2=0x7f01480cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:23.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.576+0000 7f014dd9d700 1 -- 172.21.15.60:0/3005843824 shutdown_connections 2023-10-06T04:32:23.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.576+0000 7f014dd9d700 1 -- 172.21.15.60:0/3005843824 wait complete. 2023-10-06T04:32:23.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.577+0000 7f014dd9d700 1 Processor -- start 2023-10-06T04:32:23.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.578+0000 7f014dd9d700 1 -- start start 2023-10-06T04:32:23.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.578+0000 7f014dd9d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01480ca490 0x7f01480ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:23.583 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.578+0000 7f014dd9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f014813f9f0 0x7f0148156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:23.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.578+0000 7f014dd9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f014815a5f0 0x7f01480a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:23.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.578+0000 7f014dd9d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01480ac680 con 0x7f014813f9f0 2023-10-06T04:32:23.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.578+0000 7f014dd9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01480aba70 con 0x7f014815a5f0 2023-10-06T04:32:23.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.578+0000 7f014dd9d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01480abd50 con 0x7f01480ca490 2023-10-06T04:32:23.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.579+0000 7f0147fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f014813f9f0 0x7f0148156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:23.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.579+0000 7f0147fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f014813f9f0 0x7f0148156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39786/0 (socket says 172.21.15.60:39786) 2023-10-06T04:32:23.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.579+0000 7f0147fff700 1 -- 172.21.15.60:0/1555651010 learned_addr learned my addr 172.21.15.60:0/1555651010 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:23.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.579+0000 7f014d59c700 1 --2- 172.21.15.60:0/1555651010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f014815a5f0 0x7f01480a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:23.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.579+0000 7f014cd9b700 1 --2- 172.21.15.60:0/1555651010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01480ca490 0x7f01480ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:23.584 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.579+0000 7f0147fff700 1 -- 172.21.15.60:0/1555651010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01480ca490 msgr2=0x7f01480ab390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:23.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.579+0000 7f0147fff700 1 --2- 172.21.15.60:0/1555651010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01480ca490 0x7f01480ab390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:23.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.579+0000 7f0147fff700 1 -- 172.21.15.60:0/1555651010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f014815a5f0 msgr2=0x7f01480a9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:23.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.579+0000 7f0147fff700 1 --2- 172.21.15.60:0/1555651010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f014815a5f0 0x7f01480a9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:23.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.579+0000 7f0147fff700 1 -- 172.21.15.60:0/1555651010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0140009ae0 con 0x7f014813f9f0 2023-10-06T04:32:23.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.579+0000 7f0147fff700 1 --2- 172.21.15.60:0/1555651010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f014813f9f0 0x7f0148156170 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f013400c590 tx=0x7f013400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:23.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.580+0000 7f0144ff9700 1 -- 172.21.15.60:0/1555651010 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134011590 con 0x7f014813f9f0 2023-10-06T04:32:23.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.580+0000 7f0144ff9700 1 -- 172.21.15.60:0/1555651010 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0134011710 con 0x7f014813f9f0 2023-10-06T04:32:23.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.580+0000 7f014dd9d700 1 -- 172.21.15.60:0/1555651010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01480ac030 con 0x7f014813f9f0 2023-10-06T04:32:23.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.580+0000 7f0144ff9700 1 -- 172.21.15.60:0/1555651010 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134011ad0 con 0x7f014813f9f0 2023-10-06T04:32:23.585 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.580+0000 7f014dd9d700 1 -- 172.21.15.60:0/1555651010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01481566b0 con 0x7f014813f9f0 2023-10-06T04:32:23.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.581+0000 7f014dd9d700 1 -- 172.21.15.60:0/1555651010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f014805f230 con 0x7f014813f9f0 2023-10-06T04:32:23.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.582+0000 7f0144ff9700 1 -- 172.21.15.60:0/1555651010 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f013401b3b0 con 0x7f014813f9f0 2023-10-06T04:32:23.586 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.582+0000 7f0144ff9700 1 --2- 172.21.15.60:0/1555651010 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f012c066f30 0x7f012c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:23.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.583+0000 7f0144ff9700 1 -- 172.21.15.60:0/1555651010 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f01340839a0 con 0x7f014813f9f0 2023-10-06T04:32:23.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.583+0000 7f014cd9b700 1 --2- 172.21.15.60:0/1555651010 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f012c066f30 0x7f012c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:23.587 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.583+0000 7f014cd9b700 1 --2- 172.21.15.60:0/1555651010 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f012c066f30 0x7f012c0693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f013c009db0 tx=0x7f013c0091a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:23.589 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.587+0000 7f0144ff9700 1 -- 172.21.15.60:0/1555651010 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0134050bd0 con 0x7f014813f9f0 2023-10-06T04:32:23.788 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.786+0000 7f014dd9d700 1 -- 172.21.15.60:0/1555651010 --> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01480cac30 con 0x7f012c066f30 2023-10-06T04:32:23.791 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.789+0000 7f0144ff9700 1 -- 172.21.15.60:0/1555651010 <== mgr.4098 v2:172.21.15.60:6832/85285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73241 (secure 0 0 0) 0x7f01480cac30 con 0x7f012c066f30 2023-10-06T04:32:23.792 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:32:23.794 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.791+0000 7f014dd9d700 1 -- 172.21.15.60:0/1555651010 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f012c066f30 msgr2=0x7f012c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:23.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.791+0000 7f014dd9d700 1 --2- 172.21.15.60:0/1555651010 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f012c066f30 0x7f012c0693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f013c009db0 tx=0x7f013c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:32:23.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.791+0000 7f014dd9d700 1 -- 172.21.15.60:0/1555651010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f014813f9f0 msgr2=0x7f0148156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:23.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.791+0000 7f014dd9d700 1 --2- 172.21.15.60:0/1555651010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f014813f9f0 0x7f0148156170 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f013400c590 tx=0x7f013400c8a0 comp rx=0 tx=0).stop 2023-10-06T04:32:23.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.792+0000 7f014dd9d700 1 -- 172.21.15.60:0/1555651010 shutdown_connections 2023-10-06T04:32:23.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.792+0000 7f014dd9d700 1 --2- 172.21.15.60:0/1555651010 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f012c066f30 0x7f012c0693e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:23.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.792+0000 7f014dd9d700 1 --2- 172.21.15.60:0/1555651010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f014815a5f0 0x7f01480a9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:23.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.792+0000 7f014dd9d700 1 --2- 172.21.15.60:0/1555651010 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f01480ca490 0x7f01480ab390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:23.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.792+0000 7f014dd9d700 1 --2- 172.21.15.60:0/1555651010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f014813f9f0 0x7f0148156170 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:23.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.792+0000 7f014dd9d700 1 -- 172.21.15.60:0/1555651010 >> 172.21.15.60:0/1555651010 conn(0x7f01480cbeb0 msgr2=0x7f01480b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:23.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.792+0000 7f014dd9d700 1 -- 172.21.15.60:0/1555651010 shutdown_connections 2023-10-06T04:32:23.795 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.792+0000 7f014dd9d700 1 -- 172.21.15.60:0/1555651010 wait complete. 2023-10-06T04:32:23.796 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2023-10-06T04:32:23.811 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2023-10-06T04:32:23.362182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404084,"kb_used_data":5300,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752570636,"statfs":{"total":773094113280,"available":770632331264,"internally_reserved":0,"allocated":5427200,"data_stored":3104510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002588"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":48,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:32:05.205561+0000","last_change":"2023-10-06T04:32:05.205514+0000","last_active":"2023-10-06T04:32:05.205561+0000","last_peered":"2023-10-06T04:32:05.205561+0000","last_clean":"2023-10-06T04:32:05.205561+0000","last_became_active":"2023-10-06T04:28:00.325466+0000","last_became_peered":"2023-10-06T04:28:00.325466+0000","last_unstale":"2023-10-06T04:32:05.205561+0000","last_undegraded":"2023-10-06T04:32:05.205561+0000","last_fullsized":"2023-10-06T04:32:05.205561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:32:05.205395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:32:05.205395+0000","last_clean_scrub_stamp":"2023-10-06T04:32:05.205395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:54:06.821736+0000","scrub_duration":0.0021703220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":47,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:32:03.590946+0000","last_change":"2023-10-06T04:32:03.590920+0000","last_active":"2023-10-06T04:32:03.590946+0000","last_peered":"2023-10-06T04:32:03.590946+0000","last_clean":"2023-10-06T04:32:03.590946+0000","last_became_active":"2023-10-06T04:28:00.174814+0000","last_became_peered":"2023-10-06T04:28:00.174814+0000","last_unstale":"2023-10-06T04:32:03.590946+0000","last_undegraded":"2023-10-06T04:32:03.590946+0000","last_fullsized":"2023-10-06T04:32:03.590946+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:32:03.590848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:32:03.590848+0000","last_clean_scrub_stamp":"2023-10-06T04:32:03.590848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:27.450621+0000","scrub_duration":0.001614856,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":45,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:32:00.386488+0000","last_change":"2023-10-06T04:32:00.386462+0000","last_active":"2023-10-06T04:32:00.386488+0000","last_peered":"2023-10-06T04:32:00.386488+0000","last_clean":"2023-10-06T04:32:00.386488+0000","last_became_active":"2023-10-06T04:28:00.174735+0000","last_became_peered":"2023-10-06T04:28:00.174735+0000","last_unstale":"2023-10-06T04:32:00.386488+0000","last_undegraded":"2023-10-06T04:32:00.386488+0000","last_fullsized":"2023-10-06T04:32:00.386488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:32:00.386376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:32:00.386376+0000","last_clean_scrub_stamp":"2023-10-06T04:32:00.386376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:19.428999+0000","scrub_duration":0.0020427560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"45'119","reported_seq":198,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:32:07.553259+0000","last_change":"2023-10-06T04:32:07.553209+0000","last_active":"2023-10-06T04:32:07.553259+0000","last_peered":"2023-10-06T04:32:07.553259+0000","last_clean":"2023-10-06T04:32:07.553259+0000","last_became_active":"2023-10-06T04:28:01.175255+0000","last_became_peered":"2023-10-06T04:28:01.175255+0000","last_unstale":"2023-10-06T04:32:07.553259+0000","last_undegraded":"2023-10-06T04:32:07.553259+0000","last_fullsized":"2023-10-06T04:32:07.553259+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'119","last_scrub_stamp":"2023-10-06T04:32:07.553104+0000","last_deep_scrub":"45'119","last_deep_scrub_stamp":"2023-10-06T04:32:07.553104+0000","last_clean_scrub_stamp":"2023-10-06T04:32:07.553104+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:14.633248+0000","scrub_duration":0.0059966840000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":47,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:32:05.464584+0000","last_change":"2023-10-06T04:32:05.464553+0000","last_active":"2023-10-06T04:32:05.464584+0000","last_peered":"2023-10-06T04:32:05.464584+0000","last_clean":"2023-10-06T04:32:05.464584+0000","last_became_active":"2023-10-06T04:28:00.344324+0000","last_became_peered":"2023-10-06T04:28:00.344324+0000","last_unstale":"2023-10-06T04:32:05.464584+0000","last_undegraded":"2023-10-06T04:32:05.464584+0000","last_fullsized":"2023-10-06T04:32:05.464584+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:32:05.464468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:32:05.464468+0000","last_clean_scrub_stamp":"2023-10-06T04:32:05.464468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:45:01.623350+0000","scrub_duration":0.0023857750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":47,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:32:06.507916+0000","last_change":"2023-10-06T04:32:06.507884+0000","last_active":"2023-10-06T04:32:06.507916+0000","last_peered":"2023-10-06T04:32:06.507916+0000","last_clean":"2023-10-06T04:32:06.507916+0000","last_became_active":"2023-10-06T04:28:00.343268+0000","last_became_peered":"2023-10-06T04:28:00.343268+0000","last_unstale":"2023-10-06T04:32:06.507916+0000","last_undegraded":"2023-10-06T04:32:06.507916+0000","last_fullsized":"2023-10-06T04:32:06.507916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:32:06.507793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:32:06.507793+0000","last_clean_scrub_stamp":"2023-10-06T04:32:06.507793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:27.707452+0000","scrub_duration":0.0023383840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":46,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:32:02.821245+0000","last_change":"2023-10-06T04:32:02.821215+0000","last_active":"2023-10-06T04:32:02.821245+0000","last_peered":"2023-10-06T04:32:02.821245+0000","last_clean":"2023-10-06T04:32:02.821245+0000","last_became_active":"2023-10-06T04:28:00.343280+0000","last_became_peered":"2023-10-06T04:28:00.343280+0000","last_unstale":"2023-10-06T04:32:02.821245+0000","last_undegraded":"2023-10-06T04:32:02.821245+0000","last_fullsized":"2023-10-06T04:32:02.821245+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:32:02.821133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:32:02.821133+0000","last_clean_scrub_stamp":"2023-10-06T04:32:02.821133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:40.504121+0000","scrub_duration":0.0016010740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":48,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:32:02.464889+0000","last_change":"2023-10-06T04:32:02.464856+0000","last_active":"2023-10-06T04:32:02.464889+0000","last_peered":"2023-10-06T04:32:02.464889+0000","last_clean":"2023-10-06T04:32:02.464889+0000","last_became_active":"2023-10-06T04:28:00.343313+0000","last_became_peered":"2023-10-06T04:28:00.343313+0000","last_unstale":"2023-10-06T04:32:02.464889+0000","last_undegraded":"2023-10-06T04:32:02.464889+0000","last_fullsized":"2023-10-06T04:32:02.464889+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:32:02.464745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:32:02.464745+0000","last_clean_scrub_stamp":"2023-10-06T04:32:02.464745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:38.215429+0000","scrub_duration":0.0019173230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":48,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-06T04:32:04.511345+0000","last_change":"2023-10-06T04:32:04.511314+0000","last_active":"2023-10-06T04:32:04.511345+0000","last_peered":"2023-10-06T04:32:04.511345+0000","last_clean":"2023-10-06T04:32:04.511345+0000","last_became_active":"2023-10-06T04:28:00.174265+0000","last_became_peered":"2023-10-06T04:28:00.174265+0000","last_unstale":"2023-10-06T04:32:04.511345+0000","last_undegraded":"2023-10-06T04:32:04.511345+0000","last_fullsized":"2023-10-06T04:32:04.511345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T04:32:04.511208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T04:32:04.511208+0000","last_clean_scrub_stamp":"2023-10-06T04:32:04.511208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:19.323910+0000","scrub_duration":0.0020550830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302480,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069360,"statfs":{"total":96636764160,"available":96327024640,"internally_reserved":0,"allocated":1122304,"data_stored":830473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.69599999999999995,"15min":0.77700000000000002},"min":{"1min":0.41599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.77900000000000003,"5min":4.3070000000000004,"15min":4.3070000000000004},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.755,"15min":0.91400000000000003},"min":{"1min":0.436,"5min":0.373,"15min":0.373},"max":{"1min":0.84799999999999998,"5min":8.1609999999999996,"15min":8.1609999999999996},"last":0.66400000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.73599999999999999,"15min":0.82499999999999996},"min":{"1min":0.442,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84599999999999997,"5min":5.0730000000000004,"15min":5.0730000000000004},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.76100000000000001,"15min":0.875},"min":{"1min":0.46100000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91400000000000003,"5min":6.3079999999999998,"15min":6.3079999999999998},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Oct 6 04:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.73199999999999998,"15min":0.78400000000000003},"min":{"1min":0.48899999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.79200000000000004,"5min":4.4619999999999997,"15min":4.4619999999999997},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.84499999999999997,"15min":1.026},"min":{"1min":0.57199999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80000000000000004,"5min":8.2840000000000007,"15min":8.2840000000000007},"last":0.73499999999999999}]},{"osd":3,"last update":"Fri Oct 6 04:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72799999999999998,"15min":0.80300000000000005},"min":{"1min":0.53600000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88500000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72399999999999998,"15min":0.76100000000000001},"min":{"1min":0.56899999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.86499999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.85899999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.80100000000000005,"15min":0.94899999999999995},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.80200000000000005,"5min":8.0890000000000004,"15min":8.0890000000000004},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.80200000000000005,"15min":0.85399999999999998},"min":{"1min":0.56100000000000005,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91600000000000004,"5min":3.3980000000000001,"15min":3.3980000000000001},"last":0.60899999999999999}]},{"osd":5,"last update":"Fri Oct 6 04:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.80500000000000005,"15min":0.92200000000000004},"min":{"1min":0.441,"5min":0.439,"15min":0.439},"max":{"1min":0.90500000000000003,"5min":6.8200000000000003,"15min":6.8200000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.875,"15min":1.0349999999999999},"min":{"1min":0.496,"5min":0.373,"15min":0.373},"max":{"1min":0.82999999999999996,"5min":8.3439999999999994,"15min":8.3439999999999994},"last":0.53100000000000003}]},{"osd":6,"last update":"Fri Oct 6 04:32:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.84999999999999998,"15min":0.96799999999999997},"min":{"1min":0.54600000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84199999999999997,"5min":6.2839999999999998,"15min":6.2839999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.79800000000000004,"15min":0.873},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85799999999999998,"5min":4.1420000000000003,"15min":4.1420000000000003},"last":0.55700000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297808,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074032,"statfs":{"total":96636764160,"available":96331808768,"internally_reserved":0,"allocated":532480,"data_stored":241083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:32:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63800000000000001,"15min":0.64300000000000002},"min":{"1min":0.44400000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88700000000000001,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63200000000000001,"15min":0.64200000000000002},"min":{"1min":0.44400000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.78300000000000003}]},{"osd":1,"last update":"Fri Oct 6 04:32:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65400000000000003,"15min":0.64600000000000002},"min":{"1min":0.51400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73299999999999998,"15min":0.73799999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.96999999999999997,"5min":1,"15min":1},"last":0.83199999999999996}]},{"osd":2,"last update":"Fri Oct 6 04:32:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65300000000000002,"15min":0.65200000000000002},"min":{"1min":0.54600000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64700000000000002,"15min":0.63600000000000001},"min":{"1min":0.52100000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.71699999999999997}]},{"osd":3,"last update":"Fri Oct 6 04:32:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.51300000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90400000000000003,"5min":1.018,"15min":1.018},"last":0.752},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70699999999999996,"15min":0.70099999999999996},"min":{"1min":0.58899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.80700000000000005}]},{"osd":4,"last update":"Fri Oct 6 04:32:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.61699999999999999,"15min":0.59299999999999997},"min":{"1min":0.497,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.53800000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.877,"5min":1.052,"15min":1.052},"last":0.52600000000000002}]},{"osd":5,"last update":"Fri Oct 6 04:32:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.44600000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84199999999999997,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.74099999999999999,"15min":0.72499999999999998},"min":{"1min":0.58299999999999996,"5min":0.439,"15min":0.439},"max":{"1min":0.90600000000000003,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.82199999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:32:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":3.1000000000000001,"15min":5.4420000000000002},"min":{"1min":0.60399999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.88300000000000001,"5min":165.47,"15min":165.47},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":3.093,"15min":5.4320000000000004},"min":{"1min":0.51800000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85099999999999998,"5min":165.51300000000001,"15min":165.51300000000001},"last":0.69499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302484,"kb_used_data":1100,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069356,"statfs":{"total":96636764160,"available":96327020544,"internally_reserved":0,"allocated":1126400,"data_stored":831451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:32:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.42499999999999999,"15min":0.441},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.64000000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.47599999999999998,"15min":0.46600000000000003},"min":{"1min":0.28899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.57299999999999995,"5min":3.282,"15min":3.282},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri Oct 6 04:32:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.52600000000000002,"15min":0.53400000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.54700000000000004,"5min":3.9380000000000002,"15min":3.9380000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.5,"15min":0.48799999999999999},"min":{"1min":0.36399999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64200000000000002,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":0.621}]},{"osd":3,"last update":"Fri Oct 6 04:32:07 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.42099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.60299999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.54100000000000004,"15min":0.53700000000000003},"min":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.57899999999999996,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri Oct 6 04:32:07 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78500000000000003,"15min":0.79900000000000004},"min":{"1min":0.54200000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.97899999999999998,"5min":3.3929999999999998,"15min":3.3929999999999998},"last":0.88},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79100000000000004,"15min":0.79500000000000004},"min":{"1min":0.501,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0269999999999999,"5min":3.847,"15min":3.847},"last":0.80800000000000005}]},{"osd":5,"last update":"Fri Oct 6 04:32:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.59099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.077,"5min":3.9809999999999999,"15min":3.9809999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.80100000000000005,"15min":0.80700000000000005},"min":{"1min":0.55200000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0009999999999999,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.84199999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:32:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80700000000000005,"15min":0.81699999999999995},"min":{"1min":0.59199999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0249999999999999,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.82999999999999996,"15min":0.85999999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96499999999999997,"5min":4.0270000000000001,"15min":4.0270000000000001},"last":0.96299999999999997}]},{"osd":7,"last update":"Fri Oct 6 04:32:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.81999999999999995,"15min":0.81699999999999995},"min":{"1min":0.65100000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.96299999999999997,"5min":3.4769999999999999,"15min":3.4769999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.82199999999999995,"15min":0.83099999999999996},"min":{"1min":0.626,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.91900000000000004,"5min":3.5720000000000001,"15min":3.5720000000000001},"last":0.82599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":528384,"data_stored":240105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 04:32:07 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.44500000000000001,"15min":0.46300000000000002},"min":{"1min":0.27300000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.54700000000000004,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.46300000000000002},"min":{"1min":0.34999999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59099999999999997,"5min":1.006,"15min":1.006},"last":0.58999999999999997}]},{"osd":2,"last update":"Fri Oct 6 04:32:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47499999999999998,"15min":0.49099999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.625,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.42099999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65400000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.68700000000000006}]},{"osd":3,"last update":"Fri Oct 6 04:32:07 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45500000000000002,"15min":0.45700000000000002},"min":{"1min":0.34100000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.52500000000000002,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53400000000000003,"15min":0.55200000000000005},"min":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.879}]},{"osd":4,"last update":"Fri Oct 6 04:32:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.80800000000000005,"5min":1.077,"15min":1.077},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.748,"15min":0.76800000000000002},"min":{"1min":0.54800000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.92600000000000005,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.79600000000000004}]},{"osd":5,"last update":"Fri Oct 6 04:32:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.746,"15min":0.746},"min":{"1min":0.63400000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.96299999999999997,"5min":1.147,"15min":1.147},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.75800000000000001,"15min":0.77400000000000002},"min":{"1min":0.57099999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.90100000000000002,"5min":1.167,"15min":1.167},"last":0.96899999999999997}]},{"osd":6,"last update":"Fri Oct 6 04:32:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77500000000000002,"15min":0.78300000000000003},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.89700000000000002,"5min":1.137,"15min":1.137},"last":1.002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.747,"15min":0.77400000000000002},"min":{"1min":0.55800000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.83299999999999996,"5min":1.071,"15min":1.071},"last":0.77700000000000002}]},{"osd":7,"last update":"Fri Oct 6 04:32:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.64100000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.86199999999999999,"5min":1.048,"15min":1.048},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.54400000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.91100000000000003,"5min":1.103,"15min":1.103},"last":0.83599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":528384,"data_stored":240105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:32:10 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42299999999999999,"15min":0.42799999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.60599999999999998,"5min":0.877,"15min":0.877},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.45700000000000002,"15min":0.47899999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65200000000000002,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.45100000000000001}]},{"osd":1,"last update":"Fri Oct 6 04:32:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45000000000000001,"15min":0.47099999999999997},"min":{"1min":0.36099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.58099999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.498,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.63300000000000001,"5min":1.524,"15min":1.524},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Oct 6 04:32:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.56299999999999994},"min":{"1min":0.42999999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.67600000000000005,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53500000000000003,"15min":0.56200000000000006},"min":{"1min":0.38700000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76100000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.58699999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:32:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.75,"15min":0.745},"min":{"1min":0.57799999999999996,"5min":0.504,"15min":0.504},"max":{"1min":0.998,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.77100000000000002,"15min":0.78600000000000003},"min":{"1min":0.56599999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97899999999999998,"5min":1.393,"15min":1.393},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Oct 6 04:32:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77200000000000002,"15min":0.79100000000000004},"min":{"1min":0.59299999999999997,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.98199999999999998,"5min":1.381,"15min":1.381},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76600000000000001,"15min":0.77700000000000002},"min":{"1min":0.54300000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.996,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.79700000000000004}]},{"osd":6,"last update":"Fri Oct 6 04:32:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.60999999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0109999999999999,"5min":1.351,"15min":1.351},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.78100000000000003,"15min":0.81299999999999994},"min":{"1min":0.59199999999999997,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0309999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.83199999999999996}]},{"osd":7,"last update":"Fri Oct 6 04:32:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.80300000000000005,"15min":0.83099999999999996},"min":{"1min":0.55200000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.97299999999999998,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.81000000000000005,"15min":0.82999999999999996},"min":{"1min":0.66900000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.94499999999999995,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.77800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":528384,"data_stored":240105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.439,"15min":0.45100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.60099999999999998,"5min":0.873,"15min":0.873},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46100000000000002,"15min":0.48099999999999998},"min":{"1min":0.33900000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55100000000000005,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.52600000000000002}]},{"osd":1,"last update":"Fri Oct 6 04:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46500000000000002,"15min":0.46700000000000003},"min":{"1min":0.32300000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.66800000000000004,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55000000000000004,"15min":0.56399999999999995},"min":{"1min":0.46300000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79700000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.629}]},{"osd":2,"last update":"Fri Oct 6 04:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52100000000000002,"15min":0.54400000000000004},"min":{"1min":0.379,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71699999999999997,"5min":1.248,"15min":1.248},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55500000000000005,"15min":0.58599999999999997},"min":{"1min":0.41899999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73699999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.59199999999999997}]},{"osd":4,"last update":"Fri Oct 6 04:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77000000000000002,"15min":0.81999999999999995},"min":{"1min":0.59199999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97999999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77400000000000002,"15min":0.82599999999999996},"min":{"1min":0.65000000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.94599999999999995,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.75600000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79600000000000004,"15min":0.85399999999999998},"min":{"1min":0.61199999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.90900000000000003,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79100000000000004,"15min":0.84399999999999997},"min":{"1min":0.60599999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96799999999999997,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.93999999999999995}]},{"osd":6,"last update":"Fri Oct 6 04:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80900000000000005,"15min":0.873},"min":{"1min":0.59599999999999997,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.88900000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80700000000000005,"15min":0.85999999999999999},"min":{"1min":0.57799999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.98399999999999999,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.90400000000000003}]},{"osd":7,"last update":"Fri Oct 6 04:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.81299999999999994,"15min":0.86199999999999999},"min":{"1min":0.64800000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.92500000000000004,"5min":1.603,"15min":1.603},"last":1},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.81399999999999995,"15min":0.87},"min":{"1min":0.66100000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.95099999999999996,"5min":1.534,"15min":1.534},"last":0.84199999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297808,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074032,"statfs":{"total":96636764160,"available":96331808768,"internally_reserved":0,"allocated":532480,"data_stored":241083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:32:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63400000000000001,"15min":0.64400000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89000000000000001,"5min":1.177,"15min":1.177},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68200000000000005,"15min":0.69899999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82699999999999996,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.69399999999999995}]},{"osd":1,"last update":"Fri Oct 6 04:32:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73199999999999998,"15min":0.74199999999999999},"min":{"1min":0.57799999999999996,"5min":0.434,"15min":0.434},"max":{"1min":0.94599999999999995,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70799999999999996,"15min":0.74099999999999999},"min":{"1min":0.51800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93200000000000005,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.72299999999999998}]},{"osd":2,"last update":"Fri Oct 6 04:32:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68200000000000005,"15min":0.70199999999999996},"min":{"1min":0.49399999999999999,"5min":0.441,"15min":0.441},"max":{"1min":0.84499999999999997,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.746,"15min":0.76500000000000001},"min":{"1min":0.58699999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98699999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.745}]},{"osd":3,"last update":"Fri Oct 6 04:32:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.53600000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96799999999999997,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.73799999999999999},"min":{"1min":0.52500000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98599999999999999,"5min":1.948,"15min":1.948},"last":0.75800000000000001}]},{"osd":5,"last update":"Fri Oct 6 04:32:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73999999999999999,"15min":0.754},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.90400000000000003,"5min":1.893,"15min":1.893},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70299999999999996,"15min":0.72899999999999998},"min":{"1min":0.48499999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.86199999999999999,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Oct 6 04:32:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69899999999999995,"15min":0.72899999999999998},"min":{"1min":0.45600000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96099999999999997,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80200000000000005,"15min":0.81399999999999995},"min":{"1min":0.57099999999999995,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97799999999999998,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":0.44600000000000001}]},{"osd":7,"last update":"Fri Oct 6 04:32:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.755,"15min":0.78100000000000003},"min":{"1min":0.51600000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88100000000000001,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77400000000000002,"15min":0.79000000000000004},"min":{"1min":0.54700000000000004,"5min":0.497,"15min":0.497},"max":{"1min":0.95699999999999996,"5min":1.99,"15min":1.99},"last":0.52800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":528384,"data_stored":240105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 04:32:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63400000000000001,"15min":0.60499999999999998},"min":{"1min":0.48499999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80200000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.623},"min":{"1min":0.45600000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.68000000000000005}]},{"osd":1,"last update":"Fri Oct 6 04:32:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64200000000000002,"15min":0.63},"min":{"1min":0.46000000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.65000000000000002,"15min":0.64700000000000002},"min":{"1min":0.499,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.76800000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.81399999999999995}]},{"osd":2,"last update":"Fri Oct 6 04:32:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.502,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.85499999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69499999999999995,"15min":0.68100000000000005},"min":{"1min":0.48999999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.72999999999999998}]},{"osd":3,"last update":"Fri Oct 6 04:32:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63900000000000001,"15min":0.64200000000000002},"min":{"1min":0.46500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.56000000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.872,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.74399999999999999}]},{"osd":4,"last update":"Fri Oct 6 04:32:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.67400000000000004,"15min":0.64000000000000001},"min":{"1min":0.51200000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.90200000000000002,"5min":1.004,"15min":1.004},"last":0.625},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.496,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82999999999999996,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.505}]},{"osd":6,"last update":"Fri Oct 6 04:32:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.91500000000000004,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72399999999999998,"15min":0.70599999999999996},"min":{"1min":0.48299999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90200000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.69799999999999995}]},{"osd":7,"last update":"Fri Oct 6 04:32:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.70899999999999996,"15min":0.70399999999999996},"min":{"1min":0.59699999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.83599999999999997,"5min":1.083,"15min":1.083},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76900000000000002,"15min":0.748},"min":{"1min":0.52500000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90200000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.83999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T04:32:23.814 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T04:32:23.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.992+0000 7fb2fd19d700 1 Processor -- start 2023-10-06T04:32:23.994 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.992+0000 7fb2fd19d700 1 -- start start 2023-10-06T04:32:23.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.993+0000 7fb2fd19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2f80cf4e0 0x7fb2f80cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:23.997 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.993+0000 7fb2fd19d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f80cf050 con 0x7fb2f815d590 2023-10-06T04:32:23.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.993+0000 7fb2fd19d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f80ce440 con 0x7fb2f815d960 2023-10-06T04:32:23.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.993+0000 7fb2fd19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f80ce720 con 0x7fb2f80cf4e0 2023-10-06T04:32:23.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.994+0000 7fb2f7fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb2f815d590 0x7fb2f80cc1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54822/0 (socket says 172.21.15.60:54822) 2023-10-06T04:32:23.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.994+0000 7fb2f7fff700 1 -- 172.21.15.60:0/3230846742 learned_addr learned my addr 172.21.15.60:0/3230846742 (peer_addr_for_me v1:172.21.15.60:0/0) 2023-10-06T04:32:23.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.994+0000 7fb2f77fe700 1 --2- 172.21.15.60:0/3230846742 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2f80cf4e0 0x7fb2f80cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:23.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.994+0000 7fb2f6ffd700 1 -- 172.21.15.60:0/3230846742 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515034849 0 0) 0x7fb2f80cf050 con 0x7fb2f815d590 2023-10-06T04:32:23.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.994+0000 7fb2f6ffd700 1 -- 172.21.15.60:0/3230846742 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2e0003570 con 0x7fb2f815d590 2023-10-06T04:32:23.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.994+0000 7fb2f6ffd700 1 -- 172.21.15.60:0/3230846742 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748439476 0 0) 0x7fb2f80ce440 con 0x7fb2f815d960 2023-10-06T04:32:23.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.994+0000 7fb2f6ffd700 1 -- 172.21.15.60:0/3230846742 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2f80cf050 con 0x7fb2f815d960 2023-10-06T04:32:23.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.994+0000 7fb2f77fe700 1 -- 172.21.15.60:0/3230846742 >> v1:172.21.15.135:6789/0 conn(0x7fb2f815d960 legacy=0x7fb2f8159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:23.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.994+0000 7fb2f77fe700 1 -- 172.21.15.60:0/3230846742 >> v1:172.21.15.60:6789/0 conn(0x7fb2f815d590 legacy=0x7fb2f80cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:23.998 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.994+0000 7fb2f77fe700 1 -- 172.21.15.60:0/3230846742 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f80cea00 con 0x7fb2f80cf4e0 2023-10-06T04:32:23.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.995+0000 7fb2f77fe700 1 --2- 172.21.15.60:0/3230846742 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2f80cf4e0 0x7fb2f80cde60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009910 tx=0x7fb2ec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af18c9b84c6679a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:23.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.995+0000 7fb2f6ffd700 1 -- 172.21.15.60:0/3230846742 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec011630 con 0x7fb2f80cf4e0 2023-10-06T04:32:23.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.995+0000 7fb2f6ffd700 1 -- 172.21.15.60:0/3230846742 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ec011790 con 0x7fb2f80cf4e0 2023-10-06T04:32:23.999 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.995+0000 7fb2f6ffd700 1 -- 172.21.15.60:0/3230846742 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec011b30 con 0x7fb2f80cf4e0 2023-10-06T04:32:24.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.995+0000 7fb2fd19d700 1 -- 172.21.15.60:0/3230846742 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2f80cf4e0 msgr2=0x7fb2f80cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:24.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.995+0000 7fb2fd19d700 1 --2- 172.21.15.60:0/3230846742 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2f80cf4e0 0x7fb2f80cde60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009910 tx=0x7fb2ec0091a0 comp rx=0 tx=0).stop 2023-10-06T04:32:24.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.996+0000 7fb2fd19d700 1 -- 172.21.15.60:0/3230846742 shutdown_connections 2023-10-06T04:32:24.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.996+0000 7fb2fd19d700 1 --2- 172.21.15.60:0/3230846742 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2f80cf4e0 0x7fb2f80cde60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:24.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.996+0000 7fb2fd19d700 1 -- 172.21.15.60:0/3230846742 >> 172.21.15.60:0/3230846742 conn(0x7fb2f80994e0 msgr2=0x7fb2f806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:24.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.996+0000 7fb2fd19d700 1 -- 172.21.15.60:0/3230846742 shutdown_connections 2023-10-06T04:32:24.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.996+0000 7fb2fd19d700 1 -- 172.21.15.60:0/3230846742 wait complete. 2023-10-06T04:32:24.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.997+0000 7fb2fd19d700 1 Processor -- start 2023-10-06T04:32:24.000 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.997+0000 7fb2fd19d700 1 -- start start 2023-10-06T04:32:24.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.998+0000 7fb2fd19d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2f80cf4e0 0x7fb2f80b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:24.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.998+0000 7fb2fd19d700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2f815d590 0x7fb2f8157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:24.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.998+0000 7fb2fd19d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2f815d960 0x7fb2f8152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:24.002 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.998+0000 7fb2fd19d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f80b4a40 con 0x7fb2f815d960 2023-10-06T04:32:24.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.998+0000 7fb2fd19d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f81582f0 con 0x7fb2f80cf4e0 2023-10-06T04:32:24.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.998+0000 7fb2fd19d700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f81585c0 con 0x7fb2f815d590 2023-10-06T04:32:24.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.998+0000 7fb2fc99c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2f815d960 0x7fb2f8152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:24.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.998+0000 7fb2fc99c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2f815d960 0x7fb2f8152d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39802/0 (socket says 172.21.15.60:39802) 2023-10-06T04:32:24.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.998+0000 7fb2fc99c700 1 -- 172.21.15.60:0/2675633368 learned_addr learned my addr 172.21.15.60:0/2675633368 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:24.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.998+0000 7fb2f7fff700 1 --2- 172.21.15.60:0/2675633368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2f80cf4e0 0x7fb2f80b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:24.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.998+0000 7fb2f77fe700 1 --2- 172.21.15.60:0/2675633368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2f815d590 0x7fb2f8157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:24.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.999+0000 7fb2fc99c700 1 -- 172.21.15.60:0/2675633368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2f815d590 msgr2=0x7fb2f8157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:24.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.999+0000 7fb2fc99c700 1 --2- 172.21.15.60:0/2675633368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2f815d590 0x7fb2f8157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:24.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.999+0000 7fb2fc99c700 1 -- 172.21.15.60:0/2675633368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2f80cf4e0 msgr2=0x7fb2f80b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:24.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.999+0000 7fb2fc99c700 1 --2- 172.21.15.60:0/2675633368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2f80cf4e0 0x7fb2f80b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:24.003 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.999+0000 7fb2fc99c700 1 -- 172.21.15.60:0/2675633368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec009420 con 0x7fb2f815d960 2023-10-06T04:32:24.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.999+0000 7fb2fc99c700 1 --2- 172.21.15.60:0/2675633368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2f815d960 0x7fb2f8152d40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000c860 tx=0x7fb2f0002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:24.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.999+0000 7fb2dffff700 1 -- 172.21.15.60:0/2675633368 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0002030 con 0x7fb2f815d960 2023-10-06T04:32:24.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.999+0000 7fb2dffff700 1 -- 172.21.15.60:0/2675633368 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f00021b0 con 0x7fb2f815d960 2023-10-06T04:32:24.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.999+0000 7fb2dffff700 1 -- 172.21.15.60:0/2675633368 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0012630 con 0x7fb2f815d960 2023-10-06T04:32:24.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:23.999+0000 7fb2fd19d700 1 -- 172.21.15.60:0/2675633368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f80b4c90 con 0x7fb2f815d960 2023-10-06T04:32:24.004 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.000+0000 7fb2fd19d700 1 -- 172.21.15.60:0/2675633368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f80b5250 con 0x7fb2f815d960 2023-10-06T04:32:24.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.000+0000 7fb2fd19d700 1 -- 172.21.15.60:0/2675633368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f80883a0 con 0x7fb2f815d960 2023-10-06T04:32:24.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.001+0000 7fb2dffff700 1 -- 172.21.15.60:0/2675633368 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2f0012a20 con 0x7fb2f815d960 2023-10-06T04:32:24.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.002+0000 7fb2dffff700 1 --2- 172.21.15.60:0/2675633368 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb2e4066f30 0x7fb2e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:24.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.002+0000 7fb2dffff700 1 -- 172.21.15.60:0/2675633368 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fb2f00844b0 con 0x7fb2f815d960 2023-10-06T04:32:24.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.002+0000 7fb2f7fff700 1 --2- 172.21.15.60:0/2675633368 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb2e4066f30 0x7fb2e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:24.005 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.003+0000 7fb2f7fff700 1 --2- 172.21.15.60:0/2675633368 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb2e4066f30 0x7fb2e40693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8007fd0 tx=0x7fb2e8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:24.008 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.006+0000 7fb2dffff700 1 -- 172.21.15.60:0/2675633368 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2f00516e0 con 0x7fb2f815d960 2023-10-06T04:32:24.210 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.207+0000 7fb2fd19d700 1 -- 172.21.15.60:0/2675633368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fb2f80b5440 con 0x7fb2f815d960 2023-10-06T04:32:24.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.212+0000 7fb2dffff700 1 -- 172.21.15.60:0/2675633368 <== mon.0 v2:172.21.15.60:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb2f00516e0 con 0x7fb2f815d960 2023-10-06T04:32:24.215 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.212+0000 7fb2dffff700 1 -- 172.21.15.60:0/2675633368 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb2f0054d00 con 0x7fb2f815d960 2023-10-06T04:32:24.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.215+0000 7fb2fd19d700 1 -- 172.21.15.60:0/2675633368 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb2e4066f30 msgr2=0x7fb2e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:24.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.215+0000 7fb2fd19d700 1 --2- 172.21.15.60:0/2675633368 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb2e4066f30 0x7fb2e40693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8007fd0 tx=0x7fb2e8009040 comp rx=0 tx=0).stop 2023-10-06T04:32:24.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.215+0000 7fb2fd19d700 1 -- 172.21.15.60:0/2675633368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2f815d960 msgr2=0x7fb2f8152d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:24.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.215+0000 7fb2fd19d700 1 --2- 172.21.15.60:0/2675633368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2f815d960 0x7fb2f8152d40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000c860 tx=0x7fb2f0002700 comp rx=0 tx=0).stop 2023-10-06T04:32:24.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.215+0000 7fb2fd19d700 1 -- 172.21.15.60:0/2675633368 shutdown_connections 2023-10-06T04:32:24.218 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.215+0000 7fb2fd19d700 1 --2- 172.21.15.60:0/2675633368 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7fb2e4066f30 0x7fb2e40693e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:24.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.215+0000 7fb2fd19d700 1 --2- 172.21.15.60:0/2675633368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2f815d960 0x7fb2f8152d40 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:24.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.215+0000 7fb2fd19d700 1 --2- 172.21.15.60:0/2675633368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2f80cf4e0 0x7fb2f80b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:24.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.215+0000 7fb2fd19d700 1 --2- 172.21.15.60:0/2675633368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2f815d590 0x7fb2f8157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:24.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.215+0000 7fb2fd19d700 1 -- 172.21.15.60:0/2675633368 >> 172.21.15.60:0/2675633368 conn(0x7fb2f80994e0 msgr2=0x7fb2f80cb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:24.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.215+0000 7fb2fd19d700 1 -- 172.21.15.60:0/2675633368 shutdown_connections 2023-10-06T04:32:24.219 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.215+0000 7fb2fd19d700 1 -- 172.21.15.60:0/2675633368 wait complete. 2023-10-06T04:32:24.235 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T04:32:24.235 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T04:32:24.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.422+0000 7f488b59e700 1 Processor -- start 2023-10-06T04:32:24.424 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.422+0000 7f488b59e700 1 -- start start 2023-10-06T04:32:24.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.423+0000 7f488b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f488c159320 0x7f488c0cc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:24.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.423+0000 7f488b59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f488c15cfb0 0x7f488c15d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:24.425 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.423+0000 7f488b59e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f488c0c16f0 con 0x7f488c15d960 2023-10-06T04:32:24.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.423+0000 7f488b59e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488c0c2550 con 0x7f488c15cfb0 2023-10-06T04:32:24.426 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.423+0000 7f488b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0c1940 con 0x7f488c159320 2023-10-06T04:32:24.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.424+0000 7f4889d9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f488c15cfb0 0x7f488c15d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:24.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.424+0000 7f488a59c700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f488c159320 0x7f488c0cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:24.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.424+0000 7f4889d9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f488c15cfb0 0x7f488c15d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.60:38508/0 (socket says 172.21.15.60:38508) 2023-10-06T04:32:24.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.424+0000 7f488ad9d700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f488c15d960 0x7f488c1596f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.60:39724/0 (socket says 172.21.15.60:39724) 2023-10-06T04:32:24.427 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.424+0000 7f4889d9b700 1 -- 172.21.15.60:0/2247384442 learned_addr learned my addr 172.21.15.60:0/2247384442 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:24.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.424+0000 7f4889d9b700 1 -- 172.21.15.60:0/2247384442 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f488c159320 msgr2=0x7f488c0cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T04:32:24.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.424+0000 7f4889d9b700 1 --2- 172.21.15.60:0/2247384442 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f488c159320 0x7f488c0cc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:24.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.424+0000 7f4889d9b700 1 -- 172.21.15.60:0/2247384442 >> v1:172.21.15.135:6789/0 conn(0x7f488c15d960 legacy=0x7f488c1596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:24.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.424+0000 7f4889d9b700 1 -- 172.21.15.60:0/2247384442 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c0c1c20 con 0x7f488c15cfb0 2023-10-06T04:32:24.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.424+0000 7f488a59c700 1 --2- 172.21.15.60:0/2247384442 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f488c159320 0x7f488c0cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T04:32:24.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.424+0000 7f488959a700 1 -- 172.21.15.60:0/2247384442 <== mon.1 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579236755 0 0) 0x7f488c0c16f0 con 0x7f488c15d960 2023-10-06T04:32:24.428 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.425+0000 7f4889d9b700 1 --2- 172.21.15.60:0/2247384442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f488c15cfb0 0x7f488c15d420 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f48800099b0 tx=0x7f4880009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c45172506d30b88 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:24.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.425+0000 7f488959a700 1 -- 172.21.15.60:0/2247384442 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880009ea0 con 0x7f488c15cfb0 2023-10-06T04:32:24.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.425+0000 7f488959a700 1 -- 172.21.15.60:0/2247384442 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f488000b860 con 0x7f488c15cfb0 2023-10-06T04:32:24.429 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.425+0000 7f488959a700 1 -- 172.21.15.60:0/2247384442 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488000bc20 con 0x7f488c15cfb0 2023-10-06T04:32:24.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.425+0000 7f488b59e700 1 -- 172.21.15.60:0/2247384442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f488c15cfb0 msgr2=0x7f488c15d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:24.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.425+0000 7f488b59e700 1 --2- 172.21.15.60:0/2247384442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f488c15cfb0 0x7f488c15d420 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f48800099b0 tx=0x7f4880009250 comp rx=0 tx=0).stop 2023-10-06T04:32:24.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.426+0000 7f488b59e700 1 -- 172.21.15.60:0/2247384442 shutdown_connections 2023-10-06T04:32:24.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.426+0000 7f488b59e700 1 --2- 172.21.15.60:0/2247384442 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f488c159320 0x7f488c0cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:24.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.426+0000 7f488b59e700 1 --2- 172.21.15.60:0/2247384442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f488c15cfb0 0x7f488c15d420 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:24.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.426+0000 7f488b59e700 1 -- 172.21.15.60:0/2247384442 >> 172.21.15.60:0/2247384442 conn(0x7f488c0c91a0 msgr2=0x7f488c0c95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:24.430 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.426+0000 7f488b59e700 1 -- 172.21.15.60:0/2247384442 shutdown_connections 2023-10-06T04:32:24.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.426+0000 7f488b59e700 1 -- 172.21.15.60:0/2247384442 wait complete. 2023-10-06T04:32:24.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.427+0000 7f488b59e700 1 Processor -- start 2023-10-06T04:32:24.431 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.427+0000 7f488b59e700 1 -- start start 2023-10-06T04:32:24.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.428+0000 7f488b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f488c159320 0x7f488c0ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:24.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.428+0000 7f488b59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f488c15cfb0 0x7f488c16dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:24.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.428+0000 7f488b59e700 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f488c15d960 0x7f488c0aa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:24.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.428+0000 7f488b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c16a780 con 0x7f488c159320 2023-10-06T04:32:24.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.428+0000 7f488b59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0adda0 con 0x7f488c15cfb0 2023-10-06T04:32:24.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.428+0000 7f488b59e700 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c16a130 con 0x7f488c15d960 2023-10-06T04:32:24.433 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.428+0000 7f488a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f488c159320 0x7f488c0ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.428+0000 7f488a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f488c159320 0x7f488c0ad7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39818/0 (socket says 172.21.15.60:39818) 2023-10-06T04:32:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.428+0000 7f488a59c700 1 -- 172.21.15.60:0/272084027 learned_addr learned my addr 172.21.15.60:0/272084027 (peer_addr_for_me v2:172.21.15.60:0/0) 2023-10-06T04:32:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.429+0000 7f488ad9d700 1 --2- 172.21.15.60:0/272084027 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f488c15d960 0x7f488c0aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.429+0000 7f4889d9b700 1 --2- 172.21.15.60:0/272084027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f488c15cfb0 0x7f488c16dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.429+0000 7f488a59c700 1 -- 172.21.15.60:0/272084027 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f488c15d960 msgr2=0x7f488c0aa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.429+0000 7f488a59c700 1 --2- 172.21.15.60:0/272084027 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f488c15d960 0x7f488c0aa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:24.434 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.429+0000 7f488a59c700 1 -- 172.21.15.60:0/272084027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f488c15cfb0 msgr2=0x7f488c16dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.429+0000 7f488a59c700 1 --2- 172.21.15.60:0/272084027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f488c15cfb0 0x7f488c16dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.429+0000 7f488a59c700 1 -- 172.21.15.60:0/272084027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c009420 con 0x7f488c159320 2023-10-06T04:32:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.429+0000 7f488a59c700 1 --2- 172.21.15.60:0/272084027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f488c159320 0x7f488c0ad7c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f487c00ec80 tx=0x7f487c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.429+0000 7f487a7fc700 1 -- 172.21.15.60:0/272084027 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c00c850 con 0x7f488c159320 2023-10-06T04:32:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.429+0000 7f487a7fc700 1 -- 172.21.15.60:0/272084027 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f487c00c9b0 con 0x7f488c159320 2023-10-06T04:32:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.429+0000 7f487a7fc700 1 -- 172.21.15.60:0/272084027 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c00cd50 con 0x7f488c159320 2023-10-06T04:32:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.429+0000 7f488b59e700 1 -- 172.21.15.60:0/272084027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48800094f0 con 0x7f488c159320 2023-10-06T04:32:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.430+0000 7f488b59e700 1 -- 172.21.15.60:0/272084027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488c16e2e0 con 0x7f488c159320 2023-10-06T04:32:24.435 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.431+0000 7f488b59e700 1 -- 172.21.15.60:0/272084027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488c16aa60 con 0x7f488c159320 2023-10-06T04:32:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.431+0000 7f487a7fc700 1 -- 172.21.15.60:0/272084027 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f487c013680 con 0x7f488c159320 2023-10-06T04:32:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.432+0000 7f487a7fc700 1 --2- 172.21.15.60:0/272084027 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f486c066f30 0x7f486c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T04:32:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.432+0000 7f487a7fc700 1 -- 172.21.15.60:0/272084027 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f487c0846e0 con 0x7f488c159320 2023-10-06T04:32:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.433+0000 7f4889d9b700 1 --2- 172.21.15.60:0/272084027 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f486c066f30 0x7f486c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T04:32:24.436 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.433+0000 7f4889d9b700 1 --2- 172.21.15.60:0/272084027 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f486c066f30 0x7f486c0693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f48800099b0 tx=0x7f4880009250 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T04:32:24.439 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.437+0000 7f487a7fc700 1 -- 172.21.15.60:0/272084027 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f487c051990 con 0x7f488c159320 2023-10-06T04:32:24.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.687+0000 7f488b59e700 1 -- 172.21.15.60:0/272084027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f488c0cc050 con 0x7f488c159320 2023-10-06T04:32:24.689 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.687+0000 7f487a7fc700 1 -- 172.21.15.60:0/272084027 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f487c021de0 con 0x7f488c159320 2023-10-06T04:32:24.690 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-10-06T04:32:24.690 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6834/1681836371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1681836371},{"type":"v1","addr":"172.21.15.135:6834","nonce":1681836371}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/823204172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6833","nonce":823204172},{"type":"v1","addr":"172.21.15.135:6835","nonce":823204172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4963,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1348379028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1348379028},{"type":"v1","addr":"172.21.15.60:6836","nonce":1348379028}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5388,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1065170980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1065170980},{"type":"v1","addr":"172.21.15.60:6837","nonce":1065170980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2023-10-06T04:32:24.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.689+0000 7f488b59e700 1 -- 172.21.15.60:0/272084027 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f486c066f30 msgr2=0x7f486c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:24.692 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.689+0000 7f488b59e700 1 --2- 172.21.15.60:0/272084027 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f486c066f30 0x7f486c0693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f48800099b0 tx=0x7f4880009250 comp rx=0 tx=0).stop 2023-10-06T04:32:24.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.689+0000 7f488b59e700 1 -- 172.21.15.60:0/272084027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f488c159320 msgr2=0x7f488c0ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T04:32:24.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.689+0000 7f488b59e700 1 --2- 172.21.15.60:0/272084027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f488c159320 0x7f488c0ad7c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f487c00ec80 tx=0x7f487c0091a0 comp rx=0 tx=0).stop 2023-10-06T04:32:24.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.690+0000 7f488b59e700 1 -- 172.21.15.60:0/272084027 shutdown_connections 2023-10-06T04:32:24.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.690+0000 7f488b59e700 1 --2- 172.21.15.60:0/272084027 >> [v2:172.21.15.60:6832/85285,v1:172.21.15.60:6833/85285] conn(0x7f486c066f30 0x7f486c0693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:24.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.690+0000 7f488b59e700 1 --2- 172.21.15.60:0/272084027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f488c159320 0x7f488c0ad7c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:24.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.690+0000 7f488b59e700 1 --2- 172.21.15.60:0/272084027 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f488c15d960 0x7f488c0aa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:24.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.690+0000 7f488b59e700 1 --2- 172.21.15.60:0/272084027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f488c15cfb0 0x7f488c16dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T04:32:24.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.690+0000 7f488b59e700 1 -- 172.21.15.60:0/272084027 >> 172.21.15.60:0/272084027 conn(0x7f488c0c91a0 msgr2=0x7f488c156c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T04:32:24.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.690+0000 7f488b59e700 1 -- 172.21.15.60:0/272084027 shutdown_connections 2023-10-06T04:32:24.693 INFO:teuthology.orchestra.run.smithi060.stderr:2023-10-06T04:32:24.690+0000 7f488b59e700 1 -- 172.21.15.60:0/272084027 wait complete. 2023-10-06T04:32:24.694 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 18 2023-10-06T04:32:24.710 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T04:32:24.710 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T04:32:24.710 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T04:32:24.711 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:32:24.724 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T04:32:24.724 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T04:32:24.724 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:32:24.777 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T04:32:24.777 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T04:32:24.777 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:32:24.793 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T04:32:24.794 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T04:32:24.794 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:32:24.849 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T04:32:24.849 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T04:32:24.849 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T04:32:24.850 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:32:24.894 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T04:32:24.894 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T04:32:24.894 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:32:24.943 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T04:32:24.943 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T04:32:24.943 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:32:24.997 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T04:32:24.997 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T04:32:24.998 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:32:25.045 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T04:32:25.045 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T04:32:25.045 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:32:25.088 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T04:32:25.089 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T04:32:25.089 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:32:25.140 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T04:32:25.140 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T04:32:25.140 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:32:25.188 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T04:32:25.188 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T04:32:25.188 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:32:25.240 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T04:32:25.240 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T04:32:25.240 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T04:32:25.240 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:32:25.303 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T04:32:25.303 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T04:32:25.303 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:32:25.361 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T04:32:25.361 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T04:32:25.361 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T04:32:25.361 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:32:25.387 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T04:32:25.387 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T04:32:25.387 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:32:25.405 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T04:32:25.406 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T04:32:25.406 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T04:32:25.464 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T04:32:25.464 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T04:32:25.464 DEBUG:teuthology.orchestra.run.smithi060:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T04:32:25.537 INFO:teuthology.orchestra.run.smithi060.stdout:1696566480.1605613 mon.a (mon.0) 106 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T04:32:25.538 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T04:32:25.538 DEBUG:teuthology.orchestra.run.smithi060:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T04:32:25.609 DEBUG:teuthology.orchestra.run.smithi060:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T04:32:25.683 DEBUG:teuthology.orchestra.run.smithi060:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T04:32:25.754 INFO:teuthology.orchestra.run.smithi060.stdout:1696566480.1605613 mon.a (mon.0) 106 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T04:32:25.755 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi060.front.sepia.ceph.com 2023-10-06T04:32:25.755 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T04:32:26.091 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi060.front.sepia.ceph.com 2023-10-06T04:32:26.092 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T04:32:26.348 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi060.front.sepia.ceph.com 2023-10-06T04:32:26.348 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T04:32:26.543 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi060.front.sepia.ceph.com 2023-10-06T04:32:26.543 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T04:32:26.771 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi135.front.sepia.ceph.com 2023-10-06T04:32:26.771 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T04:32:27.069 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi135.front.sepia.ceph.com 2023-10-06T04:32:27.070 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T04:32:27.263 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi135.front.sepia.ceph.com 2023-10-06T04:32:27.337 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T04:32:27.551 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi135.front.sepia.ceph.com 2023-10-06T04:32:27.551 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T04:32:27.752 INFO:tasks.ceph:Archiving mon data... 2023-10-06T04:32:27.756 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412260/data/mon.a.tgz 2023-10-06T04:32:27.756 DEBUG:teuthology.orchestra.run.smithi060:> mktemp 2023-10-06T04:32:27.798 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.FsTxeailxK 2023-10-06T04:32:27.799 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.FsTxeailxK 2023-10-06T04:32:27.992 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.FsTxeailxK 2023-10-06T04:32:28.094 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.FsTxeailxK is 320KB 2023-10-06T04:32:28.184 DEBUG:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.FsTxeailxK 2023-10-06T04:32:28.219 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412260/data/mon.b.tgz 2023-10-06T04:32:28.220 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2023-10-06T04:32:28.256 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.88fRTcmR4S 2023-10-06T04:32:28.256 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.88fRTcmR4S 2023-10-06T04:32:28.451 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.88fRTcmR4S 2023-10-06T04:32:28.552 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.88fRTcmR4S is 421KB 2023-10-06T04:32:28.642 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.88fRTcmR4S 2023-10-06T04:32:28.677 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412260/data/mon.c.tgz 2023-10-06T04:32:28.677 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2023-10-06T04:32:28.753 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.xKJsPAhc8U 2023-10-06T04:32:28.753 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.xKJsPAhc8U 2023-10-06T04:32:28.939 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.xKJsPAhc8U 2023-10-06T04:32:29.037 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.xKJsPAhc8U is 421KB 2023-10-06T04:32:29.127 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.xKJsPAhc8U 2023-10-06T04:32:29.162 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T04:32:29.162 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T04:32:29.167 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T04:32:29.262 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T04:32:29.263 DEBUG:teuthology.orchestra.run.smithi060:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T04:32:29.267 DEBUG:teuthology.orchestra.run.smithi135:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T04:32:29.339 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T04:32:29.340 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T04:32:29.355 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T04:32:29.357 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412260/remote/smithi060/crash 2023-10-06T04:32:29.358 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T04:32:29.419 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412260/remote/smithi135/crash 2023-10-06T04:32:29.420 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T04:32:29.479 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T04:32:29.479 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:32:29.483 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T04:32:29.587 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T04:32:29.649 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T04:32:29.710 INFO:tasks.ceph:Compressing logs... 2023-10-06T04:32:29.710 DEBUG:teuthology.orchestra.run.smithi060:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:32:29.715 DEBUG:teuthology.orchestra.run.smithi135:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:32:34.450 INFO:tasks.ceph:Archiving logs... 2023-10-06T04:32:34.451 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412260/remote/smithi060/log 2023-10-06T04:32:34.452 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T04:32:35.126 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412260/remote/smithi135/log 2023-10-06T04:32:35.127 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T04:32:35.580 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T04:32:35.592 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T04:32:35.592 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T04:32:35.597 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T04:32:35.719 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T04:32:35.728 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T04:32:35.729 DEBUG:teuthology.orchestra.run.smithi060:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:32:35.733 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T04:32:35.764 INFO:teuthology.orchestra.run.smithi060.stderr:bash: ntpq: command not found 2023-10-06T04:32:35.767 INFO:teuthology.orchestra.run.smithi135.stderr:bash: ntpq: command not found 2023-10-06T04:32:35.769 INFO:teuthology.orchestra.run.smithi060.stdout:210 Number of sources = 4 2023-10-06T04:32:35.769 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:32:35.769 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2023-10-06T04:32:35.769 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 8 +458us[ +477us] +/- 70ms 2023-10-06T04:32:35.770 INFO:teuthology.orchestra.run.smithi060.stdout:^* hv02.front.sepia.ceph.com 3 6 377 6 -512us[ -493us] +/- 74ms 2023-10-06T04:32:35.770 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 +94us[ +113us] +/- 81ms 2023-10-06T04:32:35.770 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:32:35.772 INFO:teuthology.orchestra.run.smithi135.stdout:210 Number of sources = 4 2023-10-06T04:32:35.773 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T04:32:35.773 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2023-10-06T04:32:35.773 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 7 +438us[ +465us] +/- 70ms 2023-10-06T04:32:35.774 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv02.front.sepia.ceph.com 3 6 377 7 -497us[ -469us] +/- 74ms 2023-10-06T04:32:35.774 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 +114us[ +141us] +/- 81ms 2023-10-06T04:32:35.774 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T04:32:35.775 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T04:32:35.784 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T04:32:35.785 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T04:32:35.797 DEBUG:teuthology.orchestra.run.smithi060:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T04:32:35.981 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T04:32:36.137 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:32:36.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:32:36.207 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T04:32:36.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:32:36.275 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T04:32:36.285 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T04:32:36.296 INFO:teuthology.task.internal:Duration was 1148.576999 seconds 2023-10-06T04:32:36.296 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T04:32:36.308 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T04:32:36.308 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T04:32:36.313 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T04:32:36.420 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:32:36.422 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T04:32:36.706 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T04:32:36.707 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi060.front.sepia.ceph.com 2023-10-06T04:32:36.707 DEBUG:teuthology.orchestra.run.smithi060:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T04:32:36.759 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2023-10-06T04:32:36.759 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T04:32:36.810 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T04:32:36.810 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:32:36.815 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T04:32:36.892 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T04:32:36.892 DEBUG:teuthology.orchestra.run.smithi060:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T04:32:36.897 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T04:32:37.015 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T04:32:37.027 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T04:32:37.027 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T04:32:37.091 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T04:32:37.152 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T04:32:37.164 DEBUG:teuthology.orchestra.run.smithi060:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:32:37.168 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:32:37.226 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = core 2023-10-06T04:32:37.228 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2023-10-06T04:32:37.263 DEBUG:teuthology.orchestra.run.smithi060:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:32:37.297 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:32:37.298 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T04:32:37.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T04:32:37.332 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T04:32:37.343 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T04:32:37.343 DEBUG:teuthology.misc:Transferring archived files from smithi060:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412260/remote/smithi060 2023-10-06T04:32:37.344 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T04:32:37.417 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412260/remote/smithi135 2023-10-06T04:32:37.417 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T04:32:37.490 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T04:32:37.490 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T04:32:37.495 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T04:32:37.531 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T04:32:37.545 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T04:32:37.545 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T04:32:37.556 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T04:32:37.556 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T04:32:37.572 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T04:32:37.604 INFO:teuthology.orchestra.run.smithi060.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 04:32 /home/ubuntu/cephtest 2023-10-06T04:32:37.607 INFO:teuthology.orchestra.run.smithi135.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 04:32 /home/ubuntu/cephtest 2023-10-06T04:32:37.611 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T04:32:37.622 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T04:32:37.646 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T04:32:37.673 DEBUG:teuthology.nuke:shortname: smithi060 2023-10-06T04:32:37.673 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:32:37.698 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412260', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:04:31.241305', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMVOnWzSqUPydJV3XCwvfYgNl6e6b5Jw6JKDCvniUJDn9u8TBV3JlpyRnzOsbda1moAJgq/s42Y4Uiiv5riGegQ='} 2023-10-06T04:32:37.703 DEBUG:teuthology.nuke:shortname: smithi135 2023-10-06T04:32:37.703 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T04:32:37.740 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412260', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 04:04:31.239965', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGYm5XCchr5cYsUBiHMbdCdN7DT6uOWCv3DehH55x9W3V7CcFFddTd9K6VQM6WlY72JboXRbPAGGu8Hp4ADsufg='} 2023-10-06T04:32:37.754 INFO:teuthology.orchestra.console.smithi060:Power off 2023-10-06T04:32:37.754 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T04:32:37.777 DEBUG:teuthology.orchestra.console.smithi060:power off output: Chassis Power Control: Down/Off 2023-10-06T04:32:37.778 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:32:37.794 INFO:teuthology.orchestra.console.smithi135:Power off 2023-10-06T04:32:37.795 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T04:32:37.804 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2023-10-06T04:32:37.817 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-10-06T04:32:37.817 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:32:37.844 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-10-06T04:32:41.804 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:32:41.845 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:32:41.915 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2023-10-06T04:32:41.954 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-10-06T04:32:45.918 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:32:45.954 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:32:46.028 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2023-10-06T04:32:46.065 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-10-06T04:32:46.129 INFO:teuthology.orchestra.console.smithi060:Power off completed 2023-10-06T04:32:50.070 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T04:32:50.182 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-10-06T04:32:50.283 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-10-06T04:32:50.388 INFO:teuthology.run:Summary data: client.0-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c client.1-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} duration: 1148.576998949051 failure_reason: '"1696566480.1605613 mon.a (mon.0) 106 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T04:32:50.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T04:32:50.476 INFO:teuthology.run:FAIL